|
Cloudflare TV

Behind the scenes: Challenges of running AI models at scale

主講人:Michelle Chen
最初直播時間:10月24日,下午4:00 - 下午4:30 [EDT]
Cloudflare runs at a massive scale — but what does scale mean when it comes to running AI models? We can talk about scale in different dimensions: global scale (routing, autoscaling, and concurrency), model catalog scale (breadth and modalities of models), and even model scale (trillion+ parameter models). Cloudflare does all of the above. Join this session for a behind-the-scenes look at the systems behind Workers AI infrastructure and how we operate them.
English

文字記錄 (測試版)

background