Browse topics Hub · essay · articles · FAQ · glossary

Matching model size to task per agent

A cost-and-quality optimisation. Not every agent needs the most capable model; classification, extraction, and formatting can often run on smaller, cheaper m…

A cost-and-quality optimisation. Not every agent needs the most capable model;
classification, extraction, and formatting can often run on smaller, cheaper models
without reducing overall quality, while reasoning-heavy steps get the strong model.
Students learn to assign models per role.

Sources