Skip to player
Home
AI in Production
›
LLM Inference Optimization & Serving
›
The Inference Cost Model
Contents
CC
Host
Expert
Murali Chillakuru
Press play to begin the conversation.
0:00
9:47
1×
1.25×
1.5×
0.85×
LLM Inference Optimization & Serving · 1 / 5
The Inference Cost Model
Play
Back to browse
Up next
Continuous Batching & Paged Attention
Play now
Stay (
5
)
'%3E%3Crect x='26' y='6' width='8' height='34' rx='2' fill='%23e9e4d6' stroke='%23cfc7b4'/%3E%3Cpath d='M26 40 L30 52 L34 40 Z' fill='%23f7f4ea'/%3E%3Crect x='26' y='6' width='8' height='7' rx='2' fill='%238fd8c4'/%3E%3C/g%3E%3C/svg%3E)