Distillation Can Make AI Models Smaller and Cheaper

The original version of this story appeared in Quanta Magazine.

The Chinese AI company DeepSeek released a chatbot earlier this year called R1, which drew a huge amount of attention. Most of it focused on the fact that a relatively small and unknown company said it had built a chatbot that rivaled the performance of those from the world’s most famous AI companies, but using a fraction of the computer power and cost. As a result, the stocks of many Western tech companies plummeted; Nvidia, which sells the chips that run leading AI models, lost more stock value in a single day than any

→ Continue reading at Wired - Science

More from author

Related posts

Advertisment

Latest posts

This Is a Rare Chance to Save More Than 70% on QuickBooks Desktop Pro Plus 2024

Disclosure: Our goal is to feature products and services that we think you'll find interesting and useful. If you purchase them, Entrepreneur may...

Even Time-Strapped Business Owners Can Share an Engaging Reading Experience with Their Kids

Disclosure: Our goal is to feature products and services that we think you'll find interesting and useful. If you purchase them, Entrepreneur may...