(43-6) 15 * << * >> * Russian * English * Content * All Issues

Approach to the recovery of geomagnetic data by comparing daily fragments of a time series with equal geomagnetic activity

G.R. Vorobeva1

1 Ufa State Aviation Technical University, Ufa, Russia

 PDF, 1228 kB

DOI: 10.18287/2412-6179-2019-43-6-1053-1063

Pages: 1053-1063.

Full text of article: Russian language.

Abstract:
Monitoring of geomagnetic field parameters and its variations is mainly carried out using ground-based magnetic observatories and variational stations. However, the imperfection of equipment used and the communication channels involved causes the presence of gaps in the time series of geomagnetic data, which, along with the spatial anisotropy of data sources, creates significant obstacles to their automated processing. In addition, the well-known methods for imputation of time series gaps provide the root-mean-square recovery error significantly exceeding the level acceptable for geophysical observations. Thus, the paper proposes a method for recovering geomagnetic data based on statistical methods for processing time series and machine learning principles using marked data and characterized by the fact that a pair of the time series fragments preceding and succeeding a missing fragment provide an indicative description of the time series fragment of interest, which together form a training sample to search for the missing fragment by a set of its attributes, followed by linear scaling to restore the original trend of an information signal. Analytical estimates of parameters of geomagnetic data time series are given, under which it is possible to apply the proposed method to recover both daily variations and several-minutes-long fragments.

Keywords:
time series recovery, time series processing, geomagnetic data, machine learning, statistical analysis.

Citation:
Vorobeva GR. Approach to the recovery of geomagnetic data by comparing daily fragments of a time series with equal geomagnetic activity. Computer Optics 2019; 43(6): 1053-1063. DOI: 10.18287/2412-6179-2019-43-6-1053-1063.

Acknowledgements:
The results presented in the article are based on data collected by magnetic observatories. The authors thank the national institutions that support them for ensuring high standards of magnetic measurements (www.intermagnet.org).

References:
  1. Love JJ. Missing data and accuracy of magnetic-observatory hour means. Ann Geophys 2001; 27: 3601-3610.
  2. Barkhatov NA, Levitin AE, Sakharov SY. The method of artificial neuron networks as a procedure for reconstructing gaps in records of individual magnetic observatories from the data at other stations. Geomag Aeron 2002; 42: 187-190.
  3. Vorobev AV, Vorobeva GR. Approach to assessment of the relative informational efficiency of intermagnet magnetic observatories. Geomagn Aeron 2018; 58(5): 625-628.
  4. Mandea M, Korte M, eds. Geomagnetic observations and models. Netherlands: Springer; 2011: 149-181.
  5. INTERMAGNET technical reference manual. Edinburgh: INTERMAGNET, BGS; 2012.
  6. Soloviev A. Mathematical tools for geomagnetic data monitoring and the INTERMAGNET Russian segment. Data Sci J 2013; 12: WDS114-WDS119.
  7. Khomutov SYu. Processing of magnetic data in observatories (description of a specialized software package) [In Russian]. Paratunka: IKIR FEB RAS Publisher; 2017.
  8. Richman M, et al. Missing data imputation through machine learning algorithms // Artificial Intelligence Methods in the Environmental Sciences 2009: 153-169.
  9. Bertsimas D, et al. From predictive methods to missing data imputation: An optimization approach. Journal of Machine Learning Research 2018; 18: 1-39.
  10. Lopes N. Handling missing values via a neural selective input model. Neural Network World 2012; 4/12: 357-370.
  11. Abidin NZ, et al. Performance analysis of machine learning algorithms for missing value imputation. International Journal of Advanced Computer Science and Applications (IJACSA) 2018; 9(6): 442-447.
  12. Liu Yu, Gopalakrishnan V. An overview and evaluation of recent machine learning imputation methods using Cardiac imaging data. Data 2017; 2(1): 8.
  13. Kulaichev AP. Methods and tools for integrated data analysis [In Russian]. Moscow: “FORUM-INFRA” Publisher; 2006.
  14. Volkov EA Numerical methods [In Russian]. Moscow: “Nauka” Publisher; 1987.
  15. Box J, Jenkins G. Time series analysis (Forecast and management) [In Russian]. Vol 1. Moscow: :Mir” Publisher; 1974.
  16. Vorobev AV, Vorobeva GR. Inductive method for recovering geomagnetic data time series [In Russian]. SPIIRAS Proceedings 2018; 57: 104-133.
  17. Takens F. Detecting strange attractors in turbulence. In Book: Rand D, Young L-S. Dynamical systems and turbulence, Warwick 1980. Berlin, Heidelberg: Springer, 1981: 366-381.
  18. Yumagulov MG. Introduction to the theory of dynamical systems [In Russian]. Saint-Peterburg: “Lan” Publisher; 2015.
  19. Lukashin YuP. Adaptive methods for short-term time series forecasting [In Russian]. Moscow: “Financy i statistika” Publisher; 2003.
  20. Gadzikovsky VI. Digital signal processing [In Russian]. Moscow: “SOLON-Press” Publisher; 2015.
  21. Allen BD. Think DSP: Digital signal processing with Python [In Russian]. Moscow: “DMK Press” Publisher; 2017.
  22. Kharchenko MA. Correlation analysis [In Russian]. Voronezh: “VGU” Publisher; 2008.

 

© 2009, IPSI RAS
151, Molodogvardeiskaya str., Samara, 443001, Russia; E-mail: ko@smr.ru ; Tel: +7 (846) 242-41-24 (Executive secretary), +7 (846) 332-56-22 (Issuing editor), Fax: +7 (846) 332-56-20