akemi/noway.moe
1
0
Fork 0
Code Issues 1 Pull requests Projects Releases Packages Wiki Activity

Llama: update history for llama3

Browse source
This commit is contained in:
Akemi Izuko 2024-11-18 20:30:31 -07:00
parent 84b6ba5c80
commit 002791b2e8
Signed by: akemi
GPG key ID: 8DE0764E1809E9FC
1 changed files with 3 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
src/content/llama/a-history-of-llamas.md
View file

@ -1,7 +1,7 @@
--- ---
title: 'A Brief History of Local Llamas' title: 'A Brief History of Local Llamas'
description: 'A Brief History of Local Llamas' description: 'A Brief History of Local Llamas'
updateDate: 'Feb 18 2024' updateDate: 'Nov 17 2024'
heroImage: '/images/llama/tiny-llama-logo.avif' heroImage: '/images/llama/tiny-llama-logo.avif'
--- ---
@ -204,6 +204,8 @@ how much impact they have in a retrospective:
- **2024-07-16**: Mistral releases codestral-mamba 7B, with up to 256k "tested" - **2024-07-16**: Mistral releases codestral-mamba 7B, with up to 256k "tested"
tokens of support. Codestral-mamba 7B is under Apache 2.0, marking the first tokens of support. Codestral-mamba 7B is under Apache 2.0, marking the first
major foundational model provider not using a transformers llama major foundational model provider not using a transformers llama
- **2024-07-23**: LLaMA 3.1 405B, an open weights model by Meta, finally
definitively defeats GPT-4 across all relevant benchmarks!
- **2024-09-12**: OpenAI releases their o1 series. These models use hidden - **2024-09-12**: OpenAI releases their o1 series. These models use hidden
autoregression to "reason" better across tasks. This has been well observed autoregression to "reason" better across tasks. This has been well observed
before, but open llamas don't have access to reasoning-style data (expensive) before, but open llamas don't have access to reasoning-style data (expensive)