Llama (Large Language Model Meta AI) is Meta's family of open-source large language models. Since its release in 2023, Llama has become the foundation of the open-source LLM ecosystem — more fine-tunes, tools, and integrations are built on Llama than any other model family.
Llama 3.3-70B is the current go-to open-source model for most production teams. It scores 86% on MMLU, handles 128K context, and runs on 40GB VRAM (two RTX 4090s or a Mac Studio M2 Ultra).
| Model | Size | VRAM | MMLU | Context |
|---|---|---|---|---|
| Llama 3.2-1B | 1B | 2GB | 49% | 128K |
| Llama 3.2-3B | 3B | 4GB | 63% | 128K |
| Llama 3.2-8B | 8B | 6GB | 73% | 128K |
| Llama 3.3-70B | 70B | 40GB | 86% | 128K |
Ollama is the easiest way to run Llama models locally — see our Ollama models guide for the full setup. For production serving at scale, vLLM is the standard choice.
ollama pull llama3.2 # 3B — runs on any laptop ollama pull llama3.2:8b # 8B — needs 8GB RAM ollama pull llama3.3:70b # 70B — needs 40GB VRAM ollama run llama3.2
You don't have to self-host. Llama is available via API through several providers:
| Llama 3.3-70B | GPT-4o | Claude Sonnet | |
|---|---|---|---|
| MMLU | 86% | 88% | 90% |
| Cost (input/1M) | ~$0.59 (Groq) | $5.00 | $3.00 |
| Self-hostable | Yes | No | No |
| Data privacy | Full (local) | Sent to OpenAI | Sent to Anthropic |
Tokoscope works with any OpenAI-compatible endpoint — Ollama, Groq, Together AI. Free to start.
Get started free →