(50-3) 16 * << * >> * Russian * English * Content * All Issues

Service-based analysis and processing of meteorological data for environmental monitoring of natural territories
I.V. Bychkov1, A.G. Feoktistov1, E.A. Yumashev1,2, M.L. Voskoboinikov1, D.N. Karamov1,3

1 Matrosov Institute for System Dynamics and Control Theory of the Siberian Branch of the RAS, 664033, Irkutsk, Russia, Lermontov Street, 134;
2 Irkutsk State Transport University, 664074, Irkutsk, Russia, Chernyshevsky Street, 15;
3 Irkutsk National Research Technical University, Baikal School of BRICS, 664074, Irkutsk, Russia, Lermontov Street, 83a

  Full text (PDF)

DOI: 10.18287/COJ1733

Article ID: 1733

Language: English

Abstract:
The development and use of a service-oriented application for processing and analyzing meteorological data for solving environmental monitoring problems for the Baikal Natural Territory are considered. The application uses the Web Processing Service standard for creating services. This ensures the ability to work with spatio-temporal data which is typically used in environmental monitoring. As part of the research, algorithms for data normalization, detection of individual and contextual anomalies, and correction of missing and anomalous values, were developed. A distinctive feature of the developed algorithms is the use of a machine learning model based on decision trees to analyze data series when detecting missing values, and the analysis of temporal and seasonal patterns when identifying individual and contextual anomalies using specialized Python programming libraries. The application, utilizing web services, represents an effective tool for comprehensive work with meteorological data for environmental monitoring. The application's use in the study of an autonomous energy complex facilitated the selection of its rational structure and operating parameters to meet electricity demand while maintaining ecological sustainability and resource conservation.

Keywords:
meteorological data, data processing, machine learning, services, environmental monitoring, Baikal Natural Territory.

Acknowledgements:
The work was carried out within the framework of the grant № 075-15-2024-533 of the Ministry of Science and Higher Education of the Russian Federation for the implementation of a major scientific project on priority directions of scientific and technological development (reg. № 124052100088-3).

Citation:
Bychkov IV, Feoktistov AG, Yumashev EA, Voskoboinikov ML, Karamov DN. Service-based analysis and processing of meteorological data for environmental monitoring of natural territories. Computer Optics 2026; 50(3): 1733. doi: 10.18287/COJ1733.

References:

  1. Karamov DN, Edelev AV, Feoktistov AG. Modeling energy supply of objects located in the protected Baikal natural territory on the basis of renewable energy sources [in Russian]. Int Tech Econ J 2020; 5: 7-24. doi:10.34286/1995-4646-2020-74-5-7-24.
  2. Perera ATD, Nik VM, Chen D, Scartezzini JL, Hong T. Quantifying the impacts of climate change and extreme climate events on energy systems. Nat Energy 2020; 5(2): 150-159. doi:10.1038/s41560-020-0558-0.
  3. Shershakova AO, Parkhomenko VP. Methods of data mining in the nowcasting model of dangerous phenomena [in Russian]. Matematicheskoe Modelirovanie i Vychislitelnye Metody 2021; 3(31): 88-104. doi:10.18698/2309-3684-2021-3-88-104.
  4. Zhao T, Li Z, Li J, et al. Artificial intelligence for geoscience: progress, challenges, and perspectives. The Innovation 2024; 5(5): 100691. doi:10.1016/j.xinn.2024.100691.
  5. Bychkov IV, Feoktistov AG, Gorsky SA, Kostromin RO, Fedorov RK. Automation in integrating web processing services of environmental monitoring data with distributed scientific applications. Avtometriya 2022; 58(4): 67-75. doi:10.15372/AUT20220407.
  6. Rupasov KS, Ponkina EV. Comparative analysis of gap-filling methods in spatially distributed meteorological monitoring data [in Russian]. MAK: Mathematics for the Altai Region 2022; 4: 187-190.
  7. Makushkin MS, Lapshin VA. Treatment of missing market data: case of bond yield curve estimation. Finance Theory Pract 2023; 27(6): 44-53. doi:10.26794/2587-5671-2023-27-6-44-53.
  8. Darban ZZ, Webb GI, Pan S, Aggarwal C, Salehi M. Deep learning for time series anomaly detection: a survey. ACM Comput Surv 2024; 57(1): 15. doi:10.1145/3691338.
  9. metaf2xml -- parse and decode METAR, TAF, SYNOP, BUOY, AMDAR and write data as XML. Available at: https://metaf2xml.sourceforge.io/#Data.
  10. Grigoryuk AP, Braginskaya LB, Seminskiy IK, Seminskiy KZ, Kovalevskiy VV. A digital platform for integration and analysis of geophysical monitoring data from the Baikal natural zone [in Russian]. Rus Digit Libr J 2022; 25(4): 303-316. doi:10.26907/1562-5419-2022-25-4-303-316.
  11. Titov AG, Okladnikov IG, Gordov EP. Web mapping system development based on geospatial data processing and visualization services for regional climate change [in Russian]. Inf Mat Tekhnol Nauke Upravl 2016; 4(2): 96-109.
  12. Kazakov EE, Zhuravlev SA, Kurochkina LS, Ayzel GV. Analytical geoinformation web service about the past and future of the hydrological regime and climate in the north-west of Russia [in Russian]. In: Proc 4th Vinogradov Readings \"Hydrology: From Knowledge to Worldview\"; 2020. pp. 659-664.
  13. Smelik VA, Savinykh PA, Kipriyanov FA. Practical application of web weather forecast service in agriculture [in Russian]. AgroEcoEngineering 2022; 2(111): 116-126.
  14. Vikhlyaev DR. A method for building a distributed system for collecting, processing and storing climate data based on a microservice architecture [in Russian]. Postulat 2024; 12: 1-9.
  15. Mayorov AA, Gvozdev OG, Belysheva YV. Concept of developing geoinformation technology for monitoring and geomodelling of meteorological events [in Russian]. Vestn SGUGiT 2024; 29(2): 73-85. doi:10.33764/2411-1759-2024-29-2-73-85.
  16. Foerster T, Stoter J. Establishing an OGC Web Processing Service for generalization processes. In: Proc ICA Workshop on Generalization and Multiple Representation; 2006. pp. 1-7.
  17. WOUDC -- World Ozone and Ultraviolet Radiation Data Centre. Available at: https://woudc.org/.
  18. AERONET -- AErosol RObotic NETwork. Available at: https://aeronet.gsfc.nasa.gov/.
  19. Karamov DN. Formation of initial meteorological arrays using long-term series FM 12 SYNOP and METAR in system energy studies [in Russian]. Bull Tomsk Polytech Univ Geo Assets Eng 2018; 329(1): 69-88.
  20. Wong LT, Chow WK. Solar radiation model. Appl Energy 2001; 69(3): 191-224. doi:10.1016/S0306-2619(01)00012-5.
  21. Ernst M, Gooday J. Methodology for generating high time resolution typical meteorological year data for accurate photovoltaic energy yield modelling. Sol Energy 2019; 189: 299-306. doi:10.1016/j.solener.2019.07.069.
  22. Ershov SV, Sokolov VG, Voloboy AG, Galaktionov VA. Effective simulation of spatial daylight autonomy and annual sunlight exposure. In: Proc Int Conf Comput Graphics Vis (GraphiCon); 2022; 32: 64-72. doi:10.20948/graphicon-2022-64-72.
  23. Polo J, Alonso-Abella M, Martín-Chivelet N, Alonso-Montesinos J, López G, Marzo A, Nofuentes G, Vela-Barrionuevo N. Typical meteorological year methodologies applied to solar spectral irradiance for PV applications. Energy 2020; 190: 116453. doi:10.1016/j.energy.2019.116453.
  24. Yuan J, Huang P, Chai J. Development of a calibrated typical meteorological year weather file in system design of zero-energy building for performance improvements. Energy 2022; 259: 125031. doi:10.1016/j.energy.2022.125031.
  25. Karamov DN. Mathematical modeling of solar radiation based on open access long-term meteorological observation data [in Russian]. Bull Tomsk Polytech Univ Geo Assets Eng 2017; 328(6): 28-37.
  26. Voskoboinikov M, Feoktistov A, Tchernykh A. Framework for development and execution of scientific workflows: designing service-oriented applications. Program Comput Software 2024; 50: 900-913. doi:10.1134/S0361768824700828.
  27. rp5 -- weather forecasting website. Available at: https://rp5.ru/Weather_in_the_world.
  28. Renewables.ninja -- web service for simulation of hourly power output from wind and solar power plants worldwide. Available at: https://www.renewables.ninja/.
  29. Liu Y, Yang S. Application of decision tree-based classification algorithm on content marketing. J Math 2022; 2022: 6469054. doi:10.1155/2022/6469054.
  30. Dinh D, Huynh V, Sriboonchitta S. Clustering mixed numerical and categorical data with missing values. Inf Sci 2021; 571: 418-442. doi:10.1016/j.ins.2021.04.076.
  31. Golub YI, Starovoitov VV. Data normalization in machine learning [in Russian]. Informatika 2021; 18(3): 83-96. doi:10.37661/1816-0301-2021-18-3-83-96.
  32. Li R, Li S. Multimedia image data analysis based on KNN algorithm. Comput Intell Neurosci 2022; 2022: 7963603. doi:10.1155/2022/7963603.
  33. Azim M, Sharif MJ. Usability of Z score: a case study on Peoples Leasing and Financial Services Limited and Bangladesh Industrial Finance Company Limited. Int J Manag Account 2020; 2(3): 38-46. doi:10.34104/ijma.020.038046.
  34. Pasini K, Khouadjia M, Samé A, Trépanier M, Oukhellou L. Contextual anomaly detection on time series: a case study of metro ridership analysis. Neural Comput Appl 2022; 34: 1483-1507. doi:10.1007/s00521-021-06455-z.
  35. Afriyanto A, Wibawa YE. Development of chatbot services for ordering media support using fuzzy logic algorithm: case study of PT Pemuda Cari Cuan (Mangkokku). J Electr Eng Comput Sci 2024; 9(1): 9-18. doi:10.54732/jeecs.v9i1.2.
  36. Edelev AV, Karamov DN, Ogorodnikov VA, Kargapolova NA, Akentyeva MS. Use of stochastic weather generators in structural and parametric optimization of natural-technical systems [in Russian]. In: Marchuk Scientific Readings: Abstracts of the Int Conf; 2024. p. 148.

151, Molodogvardeiskaya str., Samara, 443001, Russia; E-mail: journal@computeroptics.ru; Tel: +7 (846) 242-41-24 (Executive secretary), +7 (846) 332-56-22 (Issuing editor), Fax: +7 (846) 332-56-20