LLMilestonesA milestone timeline of AI and large language models

Act III · The ChatGPT moment

Open modelMeta

LLaMA: the spark of open-source models

A family of 7B to 65B models, released to researchers on application.

13Bversion beat GPT-3 on most benchmarks

Why it matters

The weights leaked within a week and ignited the open-source community: Alpaca, Vicuna, llama.cpp and more followed.

Costs and controversy

Initially restricted to non-commercial research.

Built on

ChinchillaChatGPT

Led to

Llama 2

Source: arxiv.org ↗

See it on the 3D timeline →