(38-4) 34 * << * >> * Russian * English * Content * All Issues

Comparison of system performance for streaming data analysis in image processing tasks by sliding window
N.L. Kazanskiy, V.I. Protsenko, P.G. Serafimovich

 

Samara State Aerospace University,

Image Processing Systems Institute, Russian Academy of Sciences

PDF, 578 kB

Full text of article: Russian language.

DOI: 10.18287/0134-2452-2014-38-4-804-810

Pages: 804-810.

Abstract:
Comparison of two streaming systems: Apache Storm and IBM InfoSphere Streams was performed in solving image sliding window filtering task. Analysis was focused on two parameters: throughput and memory consumption. Profiling was held under CentOS operating systems running on two virtual machines for each system. First, the most cheap in developing cost realizations were compared. After analysis optimization of memory consumption was performed.  Final suggestions on applicability of two systems were made at the end of the article.

Key words:
big data, stream processing, a set of images, a sliding window, used computer memory, image processing.

Citation:
Kazanskiy NL, Protsenko VI, Serafimovich PG. Comparison of system performance for streaming data analysis in image processing tasks by sliding window. Computer Optics 2014; 38(4): 804-810. DOI: 10.18287/0134-2452-2014-38-4-804-810.

References:

  1. Kazanskiy, N.L. The distributed vision system of the registration of the railway train / N.L. Kazanskiy, S.B. Popov // Computer Optics. – 2012. – Vol. 36(3). – P. 419-428.
  2. Zhuravel, Yu.N. The features of hyperspectral remote sensing data processing under environment monitoring task solution / Yu.N. Zhuravel, A.A. Fedoseev // Computer Optics. – 2013. – Vol. 37(4). – P. 471-476.
  3. Kazanskiy, N.L. Machine Vision System for Singularity Detection in Monitoring the Long Process / N.L. Kazanskiy, S.B. Popov // Optical Memory and Neural Networks (Information Optics). – 2010. – Vol. 19, Issue 1. – P. 23-30.
  4. Gashnikov, M.V. Hierarchical grid interpolation for hyperspectral image compression / M.V. Gashnikov, N.I. Glumov // Computer Optics. – 2014. – Vol. 38(1). – P. 87-93 – (In Russian).
  5. Zimichev, E.A. Spectral-spatial classification with k-me­ans++ particional clustering / E.A. Zimichev, N.L. Kazanskiy, P.G. Serafimovich // Computer Optics. – 2014. – Vol. 38(2). – P. 281-286. – (In Russian).
  6. Popov, S.B. The concept of distributed storage and parallel processing of large-format images / S.B. Popov // Computer Optics. – 2007. – Vol. 31(4). – P. 77-85 – (In Russian).
  7. Kazanskiy, N.L. Cloud computing for nanophotonics simulations / N.L. Kazanskiy, P.G. Serafimovich // Computer Optics. – 2011. – Vol. 35(3). – P. 320-328. – (In Russian).
  8. Kazanskiy, N.L. Cloud Computing for Rigorous Coupled-Wave Analysis / N.L. Kazanskiy, P.G. Serafimovich // Advances in Optical Technologies. – 2012. – Vol. 2012. – Article ID 398341, 7 pages. – Doi:10.1155/2012/398341.
  9. Kazanskiy, N.L. Cloud Computing for Nanophotonic Simulations / N.L. Kazanskiy, P.G. Serafimovich // Lecture Notes in Computer Science. – 2013. – Vol. 7715. – P. 54-67. – DOI: 10.1007/978-3-642-38250-5_7.
  10. Volotovsky, S.G. Evaluation of the performance of applications in parallel image processing / S.G. Volotovsky, N.L. Kazanskiy, S.B. Popov, P.G. Serafimovich // Computer Optics. – 2010. – Vol. 34(4). – P. 567-573. – (In Russian).
  11. Popov, S.B. Modeling information structure of parallel image processing / S.B. Popov // Computer Optics. – 2010. – Vol. 34(2). – P. 231-242. – (In Russian).
  12. Pereira, R. An architecture for distributed high performance video processing in the cloud / M. Azambuja, K. Breitman, M. Endler // Cloud Computing (CLOUD), 2010 IEEE 3rd International Conference on. – IEEE, 2010. – P. 482-489.
  13. Almeer, M.H. Cloud Hadoop map reduce for remote sensing image analysis / M.H. Almeer // Journal of Emerging Trends in Computing and Information Sciences. – 2012. – Vol. 3, Issue 4. – P. 637-644.
  14. Perry, R. High Speed Raster Image Streaming For Digital Presses Using the Hadoop File System [Electronical resource] / R. Perry // HP Laboratories, HPL-2009-345. – 2009. – URL: http://www.hpl.hp.com/techreports/2009/HPL-2009-345.html.
  15. Maxwell, D. Crisees: Real-time monitoring of social media streams to support crisis management / D. Maxwell, S. Raue, L. Azzopardi, C. Johnson and S. Oates // Advances in Information Retrieval. – Springer Berlin Heidelberg, 2012. – P. 573-575.
  16. Nabi, Z. Benchmark «Of Streams and Storm» / E. Bouillet, A. Bainbridge, C.Thomas [Электронный ресурс]. – 2014. – URL: https://developer.ibm.com/streamsdev/wp-content/up­loads/sites/15/2014/04/Streams-and-Storm-April-2014-Fi­nal.pdf (дата обращения 12.08.2014).
  17. Real-time Stream Processing Architecture for Comcast IP Video [Электронный ресурс]. – URL: http://strata­conf.com/stratany2013/public/schedule/detail/30915\%29 (дата обращения 12.08.2014).
  18. Glumov, N.I. Application of polynomial bases for image processing in a sliding window / N.I. Glumov, V.V. Myasnikov, V.V. Sergeyev // Computer Optics. – 1995. – Vol. 14-15, Part 1. – P. 55-67. – (In Russian).
  19. Glumov, N.I. Detection of objects on the image using a sliding window mоde / N.I. Glumov, E.I. Kolomiyetz, V.V. Sergeyev // Optics & Laser Technology. – 1995. – Vol. 27(4). – P. 241-249.
  20. Methods for computer image processing / M.V. Gashnikov, N.I. Glumov, N.Yu. Ilyasova, V.V. Myasnikov, S.B. Popov, V.V. Sergeev, V.A. Soifer, A.G. Khramov, A.V. Chernov, V.M. Chernov, M.A. Chicheva, V.A. Fursov. – Ed. by V.A. Soi­fer. – 2nd ed., revised. – Moscow: “Fizmatlit” Publisher, 2003. – 784 p. – (In Russian).
  21. Zookeeper [electronic resource]. – URL: http://zookee­per.apache.org/ (request date 12.08.2014).
  22. ZeroMQ [electronic resource]. – URL:http://zeromq.org/ (request date 3.08.2014).
  23. The framework Netty [electronic resource]. – URL: http://zeromq.org/ (request date 3.08.2014).
  24. LMax Disruptor [electronic resource]. – URL: http://disrup­tor.googlecode.com/files/Disruptor-1.0.pdf (request date 3.08.2014).
  25. Thrift Protocol [electronic resource]. – URL: http://thrift.apache.org/ (access date 7.08.2014).
  26. The image processing library OpenCV [electronic resource].  – URL: http://opencv.org/ (request date 1.08.2014).
  27. A set of operators OpenCV Toolkit [electronic resource].  – URL: http://github.com/ejpring/OpenCVToolkit (request date 8.08.2014).
  28. Hirzel, M. IBM Streams Processing Language: Analyzing Big Data in motion / M. Hirzel, H. Andrade, B. Gedik, G. Jacques-Silva, R. Khandekar, V. Kumar, M. Mendell, H. Nasgaard, S. Schneider, R. Soule´ and K.-L. Wu // IBM Journal of Research and Development. – 2013. – Vol. 57. – Issue 3/4. – P. 7:1-7:11. – DOI: 10.1147/JRD.2013.2243535.
  29. Hirzel, M. A catalog of stream processing optimizations / M. Hirzel, R. Soulé, S. Schneider, B. Gedik, R. Grimm // ACM Computing Surveys (CSUR). – 2014. – Vol. 46, Issue 4. – Article Number: 46. – DOI: 10.1145/2528412.
© 2009, IPSI RAS
151, Molodogvardeiskaya str., Samara, 443001, Russia; E-mail:journal@computeroptics.ru; Tel: +7 (846) 242-41-24 (Executive secretary), +7 (846) 332-56-22 (Issuing editor), Fax: +7 (846) 332-56-20