akemi/noway.moe
1
0
Fork 0
Code Issues 1 Pull requests Packages Projects Releases Wiki Activity

Llama: update history

Browse source
This commit is contained in:
Akemi Izuko 2024-03-28 19:57:41 -06:00
parent a50bd21781
commit 26f0543d62
Signed by: akemi
GPG key ID: 8DE0764E1809E9FC
1 changed files with 3 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

3
src/content/llama/a-history-of-llamas.md
View file

@ -186,3 +186,6 @@ how much impact they have in a retrospective:
- **2024-02-26**: Mistral releases Mistral-Large and simultaneously removes all - **2024-02-26**: Mistral releases Mistral-Large and simultaneously removes all
the mentions of a commitment to open source from their website. They revert the mentions of a commitment to open source from their website. They revert
this change the following day, after the community backlash. this change the following day, after the community backlash.
- **2024-03-27**: DataBricks open sources DBRX, a 132B parameter MoE with 36B
parameters active per forward pass. It was trained on 12T tokens. According
to user evaluation, it beats Mixtral for all uses.