Our Series E: we raised $300M at a $5B valuation to power a multi-model future. READ

Timur Abishev

Model performance

Faster Mixtral inference with TensorRT-LLM and quantization

Pankaj Gupta
2 others
Faster Mixtral inference

Explore Baseten today

Start deploying
Talk to an engineer