SmartMLOps Studio: Design of an LLM-Integrated IDE with Automated MLOps Pipelines for Model Development and Monitoring

Authors

  • Jiawei Jin Technical University of Munich, Munich, German Author
  • Yingxin Su University of California, Davis, CA, USA Author
  • Xiaotong Zhu Carnegie Mellon University, Pittsburgh, PA, USA Author

DOI:

https://doi.org/10.71222/1381fw57

Keywords:

LLM-integrated IDE, MLOps, continuous model development, AI lifecycle automation, model drift monitoring, code intelligence, AI engineering

Abstract

The rapid expansion of artificial intelligence and machine learning (ML) applications has intensified the demand for integrated environments that unify model development, deployment, and monitoring. Traditional Integrated Development Environments (IDEs) focus primarily on code authoring, lacking intelligent support for the full ML lifecycle, while existing MLOps platforms remain detached from the coding workflow. To address this gap, this study proposes the design of an LLM-Integrated IDE with automated MLOps pipelines that enables continuous model development and monitoring within a single environment. The proposed system embeds a Large Language Model (LLM) assistant capable of code generation, debugging recommendation, and automatic pipeline configuration. The backend incorporates automated data validation, feature storage, drift detection, retraining triggers, and CI/CD deployment orchestration. This framework was implemented in a prototype named SmartMLOps Studio and evaluated using classification and forecasting tasks on the UCI Adult and M5 datasets. Experimental results demonstrate that SmartMLOps Studio reduces pipeline configuration time by 61%, improves experiment reproducibility by 45%, and increases drift detection accuracy by 14% compared to traditional workflows. By bridging intelligent code assistance and automated operational pipelines, this research establishes a novel paradigm for AI engineering-transforming the IDE from a static coding tool into a dynamic, lifecycle-aware intelligent platform for scalable and efficient model development.

References

1. Q. Sun, X. Zhao, and X. Lin, "Design of a Hardware-Software Co-designed Real-Time Machine Learning System for Big Data Streams," In Proceedings of the 2nd International Symposium on Integrated Circuit Design and Integrated Systems, September, 2025, pp. 265-271. doi: 10.1145/3772326.3774742

2. M. Chen, J. Tworek, H. Jun, Q. Yuan, H. P. D. O. Pinto, J. Kaplan, and W. Zaremba, "Evaluating large language models trained on code," arXiv preprint arXiv:2107.03374, 2021.

3. S. Kotsiantis, V. Verykios, and M. Tzagarakis, "AI-assisted programming tasks using code embeddings and transformers," Electronics, vol. 13, no. 4, p. 767, 2024. doi: 10.3390/electronics13040767

4. S. Suddala, "Automating the data science lifecycle: CI/CD for machine learning deployment," Int J Multidiscip Res, vol. 8, no. 3, pp. 45-53, 2022.

5. S. Chitraju, "End-to-End ML Operations (MLOps): Enhancing Model Reliability and Performance at Scale," Available at SSRN 5226793, 2024.

6. A. Enemosah, "Implementing DevOps Pipelines to Accelerate Software Deployment in Oil and Gas Operational Technology Environments," International Journal of Computer Applications Technology and Research, vol. 8, no. 12, pp. 501-515, 2019.

7. J. F. Kurian, and M. Allali, "Detecting drifts in data streams using Kullback-Leibler (KL) divergence measure for data engineering applications," Journal of Data, Information and Management, vol. 6, no. 3, pp. 207-216, 2024. doi: 10.1007/s42488-024-00119-y

8. C. Joshua, "Automating Model Drift Detection in Production ML Pipelines Using Anomaly Detection Techniques,".

9. B. M. Dias Bahmed, "Integrated Development Environments: Exploring the Impact of the Implementation of Artificial Intelligence on Workflow Efficiency and its Potential for Developer Displacement," 2024.

10. Z. Liang, W. Wei, K. Zhang, and H. Chen, "Research on multi-hop inference optimization of llm based on mquake framework," arXiv preprint arXiv:2509.04770, 2025.

Downloads

Published

18 March 2026

Issue

Section

Article

How to Cite

Jin, J., Su, Y., & Zhu, X. (2026). SmartMLOps Studio: Design of an LLM-Integrated IDE with Automated MLOps Pipelines for Model Development and Monitoring. Journal of Computer, Signal, and System Research, 3(2), 74-82. https://doi.org/10.71222/1381fw57