Distillation Can Make AI Models Smaller and Cheaper

The original version of this story appeared in Quanta Magazine.

The Chinese AI company DeepSeek released a chatbot earlier this year called R1, which drew a huge amount of attention. Most of it focused on the fact that a relatively small and unknown company said it had built a chatbot that rivaled the performance of those from the world’s most famous AI companies, but using a fraction of the computer power and cost. As a result, the stocks of many Western tech companies plummeted; Nvidia, which sells the chips that run leading AI models, lost more stock value in a single day than any

Related News

How to Overcome Imposter Syndrome and Launch Your First Product with Confidence

Intel was on the brink of downfall. A twist in the AI race could boost its revival

Incident involving suspect with a knife closes Hwy. 101 in San Jose

Scott Pelley speaks: ‘CBS News is on fire’ and Bari Weiss should be removed

5 vehicles stolen from Alameda County parking garage in Oakland

Video footage shows large groups of people fighting in Oakland