Automated High-Frequency Geomagnetic Disturbance Classifier: A Machine Learning Approach to Identifying Noise While Retaining High-Frequency Components of the Geomagnetic Field

• Main Authors: McCuen, Brett A., Moldwin, Mark B., Steinmetz, Erik S., Engebretson, Mark J.
• Format: Article in Journal/Newspaper
• Language: unknown
• Published: Springer 2023
• Subjects: support vector classifier; machine learning; high-frequency geomagnetic signatures; magnetic noise; noise identification; geomagnetically induced currents; Astronomy and Astrophysics; Science; Arctic
• Online Access: https://hdl.handle.net/2027.42/175883; https://doi.org/10.1029/2022JA030842

We present an automated method to identify high-frequency geomagnetic disturbances in ground magnetometer data and classify the events by the source of the perturbations. We developed an algorithm to search for and identify changes in the surface magnetic field, dB/dt, with user-specified amplitude and timescale. We used this algorithm to identify transient-large-amplitude (TLA) dB/dt events that have timescale less than 60 s and amplitude >6 nT/s. Because these magnetic variations have similar amplitude and time characteristics to instrumental or man-made noise, the algorithm identified a large number of noise-type signatures as well as geophysical signatures. We manually classified these events by their sources (noise-type or geophysical) and statistically characterized each type of event; the insights gained were used to more specifically define a TLA geophysical event and greatly reduce the number of noise-type dB/dt identified. Next, we implemented a support vector machine classification algorithm to classify the remaining events in order to further reduce the number of noise-type dB/dt in the final data set. We examine the performance of our complete dB/dt search algorithm in widely used magnetometer databases and the effect of a common data processing technique on the results. The automated algorithm is a new technique to identify geomagnetic disturbances and instrumental or man-made noise, enabling systematic identification and analysis of space weather related dB/dt events and automated detection of magnetometer noise intervals in magnetic field databases.Plain Language SummaryHigh-frequency (second-timescale) components of the surface geomagnetic field are not often included in studies on geomagnetically induced currents (GICs) because they do not pose a direct threat to technological infrastructure. However, high-frequency intervals occur prior to and within some larger space weather events that can lead to GICs. Because these perturbations are very similar to signals that arise due to ...