https://jackliusr.github.io/tags/scale/ Recent content in scale on My learning and diary Hugo -- gohugo.io en-us Fri, 25 Sep 2026 20:00:00 +0800 https://jackliusr.github.io/posts/2026/09/ai-at-scale-in-another-sense-with-agent--sandbox--self-evolving--ptc/ Fri, 25 Sep 2026 20:00:00 +0800 https://jackliusr.github.io/posts/2026/09/ai-at-scale-in-another-sense-with-agent--sandbox--self-evolving--ptc/ When talking about AI at scale, I have always thought about it from the model-serving infrastructure perspective: How many GPUs do we need? How do we scale inference? How do we reduce latency and cost? How do we serve millions of concurrent requests? How do we efficiently distribute models across GPU clusters? But there is another way to think about AI at scale. Instead of scaling the AI model itself, what if we scale software development across ordinary users?