2026/09/29 Semantic Scholar

Batched in Back: Characterizing and Optimizing Offline LLM Inference in Production with ACDC

作者：Le-Ping Yang, Xue Li, Kun Qian, Er-Ci Xu, Ming-Zhe Han, Hao-Ran Zhu, Tao He, Zuo-Long Yin

Batched in Back: Characterizing and Optimizing Offline LLM Inference in Production with ACDC.

內容為收集當日抓取的摘要原文。