diff --git a/src/content/llama/a-history-of-llamas.md b/src/content/llama/a-history-of-llamas.md index e4f38f6..1fdcbf9 100644 --- a/src/content/llama/a-history-of-llamas.md +++ b/src/content/llama/a-history-of-llamas.md @@ -186,3 +186,6 @@ how much impact they have in a retrospective: - **2024-02-26**: Mistral releases Mistral-Large and simultaneously removes all the mentions of a commitment to open source from their website. They revert this change the following day, after the community backlash. + - **2024-03-27**: DataBricks open sources DBRX, a 132B parameter MoE with 36B + parameters active per forward pass. It was trained on 12T tokens. According + to user evaluation, it beats Mixtral for all uses.