Semantic Scholar

LMTracer: Fine-Grained and Real-Time Performance Profiling for Production LLM Systems

作者:Wei Liu, Yong-Chao He, Bo-Han Zhao, Hong-Yi Wang, Zhen-Hua Li, Jun-Ping Zhao

🔗 https://www.semanticscholar.org/paper/26a363cdb148db8cf3863a72cde40614462c96d0 ↗

LMTracer: Fine-Grained and Real-Time Performance Profiling for Production LLM Systems.

內容為收集當日抓取的摘要原文。