Llama 3 / 3.1 405B
8B and 70B models in April; the 405B Llama 3.1 in July.
15Ttraining tokens
Why it matters
The 405B is widely seen as the first open-weight model close to the closed frontier.
Costs and controversy
At that size, almost nobody can run it at home.
Built on
Led to
Source: ai.meta.com ↗