大语言模型服务系统服务级目标和系统级指标优化

王智彬, 李世鹏, 周宇航, 李雪, 张中辉, 蒋智威, 顾荣, 田臣, 陈贵海, 仲盛

Optimization of Service Level Objectives and System Level Metrics in Large Language ModelServing System

WANG Zhibin, LI Shipeng, ZHOU Yuhang, LI Xue, ZHANG Zhonghui, JIANG Zhiwei, GU Rong, TIAN Chen, CHEN Guihai, ZHONG Sheng

计算机科学 . 2026, (3): 23 -32 . DOI: 10.11896/jsjkx.250900173