Below you will find pages that utilize the taxonomy term “scale”
Posts
AI at scale in another sense with agent + sandbox + self-evolving + PTC
When talking about AI at scale, I have always thought about it from the model-serving infrastructure perspective:
How many GPUs do we need? How do we scale inference? How do we reduce latency and cost? How do we serve millions of concurrent requests? How do we efficiently distribute models across GPU clusters? But there is another way to think about AI at scale.
Instead of scaling the AI model itself, what if we scale software development across ordinary users?