Distributed Data Processing and Real-Time Query Optimization in Microservice Architecture
DOI:
https://doi.org/10.71222/3rm8gb33Keywords:
microservice architecture, distributed data processing, real time query optimization, query cache, performance monitoringAbstract
Today, the rapid advancement of information technology, the Internet, and big data has promoted the widespread application of microservice architecture in contemporary software engineering, especially in distributed data processing and real-time query optimization, which shows great potential for development. This article explores the optimization path of data distributed processing and real-time queries under microservice architecture. A series of real-time query performance optimization strategies have been proposed based on the characteristics of microservice architecture, such as caching mechanism for query results, optimization of indexes, monitoring and analysis of query performance, as well as the use of asynchronous processing and message queues. By adopting appropriate technology and architecture design, microservice architecture improves the operational performance and fast response to queries of distributed systems, meeting the constantly evolving needs for efficient data processing.
References
1. H. Raza, W. Abbasi, K. Aurangzeb, N. M. Khan, M. S. Anwar, and M. Alhussein, "Parameter estimation of the systems with irregularly missing data by using sequentially parallel distributed adaptive signal processing architecture," Alexandria Eng. J., vol. 82, pp. 139–144, 2023, doi: 10.1016/j.aej.2023.09.051.
2. R. Chen, G. Cai, J. Chen, and Y. Hong, "Integrated method for distributed processing of large XML data," Cluster Comput., vol. 27, no. 2, pp. 1375–1399, 2024, doi: 10.1007/s10586-023-04010-0.
3. M. A. Poltavtseva and V. A. Torgov, "Applying distributed ledger technology to auditing and incident investigation in big data processing systems," Autom. Control Comput. Sci., vol. 56, no. 8, pp. 874–882, 2022, doi: 10.3103/S0146411622080193.
4. A. Alexandrescu, "Parallel processing of sensor data in a distributed rules engine environment through clustering and data flow reconfiguration," Sensors, vol. 23, no. 3, p. 1543, 2023, doi: 10.3390/s23031543.
5. S. Cui, "Online education based on distributed multi-layer data processing technology," Procedia Comput. Sci., vol. 228, pp. 688–700, 2023, doi: 10.1016/j.procs.2023.11.080.
6. H. Miyajima, N. Shigei, H. Miyajima, and N. Shiratori, "Scalability improvement of simplified, secure distributed processing with decomposition data," Nonlinear Theory Its Appl., IEICE, vol. 14, no. 2, pp. 140–151, 2023, doi: 10.1587/nolta.14.140.
7. L. Wang, B. Yu, F. Chen, C. Li, B. Li, and N. Wang, "A cluster-based partition method of remote sensing data for efficient dis-tributed image processing," Remote Sens., vol. 14, no. 19, p. 4964, 2022, doi: 10.3390/rs14194964.
8. E. Fakiris, G. Papatheodorou, D. Christodoulou, Z. Roumelioti, E. Sokos, M. Geraga, et al., "Using distributed temperature sensing for long-term monitoring of pockmark activity in the Gulf of Patras (Greece): Data processing hints and preliminary findings," Sensors, vol. 23, no. 20, p. 8520, 2023, doi: 10.3390/s23208520.
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Jin Li (Author)
This work is licensed under a Creative Commons Attribution 4.0 International License.
