Workloads on Harvard Systems Grouphttps://systems.seas.harvard.edu/tags/workloads/Recent content in Workloads on Harvard Systems GroupHugoenCopyright © 2026 The President and Fellows of Harvard CollegeMon, 12 Oct 2026 00:00:00 -0500A Year in LLM Serving: Workloads, Caching, and Routinghttps://systems.seas.harvard.edu/blog/a-year-in-llm-serving/Mon, 12 Oct 2026 00:00:00 -0500https://systems.seas.harvard.edu/blog/a-year-in-llm-serving/An analysis of 6.12 billion production LLM requests, examining workload evolution, traffic patterns, prefix reuse, cache eviction, and request routing.