From 26f0543d629eb8bcc6ee19536cb027c2178ddff6 Mon Sep 17 00:00:00 2001 From: Akemi Izuko Date: Thu, 28 Mar 2024 19:57:41 -0600 Subject: [PATCH] Llama: update history --- src/content/llama/a-history-of-llamas.md | 3 +++ 1 file changed, 3 insertions(+) diff --git a/src/content/llama/a-history-of-llamas.md b/src/content/llama/a-history-of-llamas.md index e4f38f6..1fdcbf9 100644 --- a/src/content/llama/a-history-of-llamas.md +++ b/src/content/llama/a-history-of-llamas.md @@ -186,3 +186,6 @@ how much impact they have in a retrospective: - **2024-02-26**: Mistral releases Mistral-Large and simultaneously removes all the mentions of a commitment to open source from their website. They revert this change the following day, after the community backlash. + - **2024-03-27**: DataBricks open sources DBRX, a 132B parameter MoE with 36B + parameters active per forward pass. It was trained on 12T tokens. According + to user evaluation, it beats Mixtral for all uses.