From 02a135b2addbfc56ae1d304c8610fddc1c025e72 Mon Sep 17 00:00:00 2001 From: kozistr Date: Mon, 23 Sep 2024 22:14:23 +0900 Subject: [PATCH] docs: v3.2.0 changelog --- docs/changelogs/v3.2.0.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/docs/changelogs/v3.2.0.md b/docs/changelogs/v3.2.0.md index 71aa85cd..812dcc41 100644 --- a/docs/changelogs/v3.2.0.md +++ b/docs/changelogs/v3.2.0.md @@ -4,3 +4,5 @@ * Implement `SOAP` optimizer. (#275) * [SOAP: Improving and Stabilizing Shampoo using Adam](https://arxiv.org/abs/2409.11321) +* Support `AdEMAMix` variants. (#276) + * `bnb_ademamix8bit`, `bnb_ademamix32bit`, `bnb_paged_ademamix8bit`, `bnb_paged_ademamix32bit`