AI Inference, Overtaking on the Curve

For many years, Nvidia has dominated the AI chip field, and despite other companies continuously trying, they have never been able to shake its dominant position.

But now, the situation is changing. "Inference Computing" has become the keyword in this AI technology revolution.

Whether it's tech giants or small startups, they are all targeting the track of developing custom chips for AI, such as Groq, Cerebras Systems, and so on.

Meta is a typical case. Although they used Nvidia chips to train Llama3.1 405B, when it comes to actually providing services to users, they use AMD MI300s chips.