From cd61adeb70398075cc32e0ab600d3a3818a154f0 Mon Sep 17 00:00:00 2001 From: hanqing Date: Sun, 8 Dec 2024 17:54:38 -0600 Subject: [PATCH] update video --- docs/index.html | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/docs/index.html b/docs/index.html index 08317c7..7e08b57 100644 --- a/docs/index.html +++ b/docs/index.html @@ -315,9 +315,9 @@

Train an LLaMA-7B with 3× Throughput C
-

Adam Optimizer with micro batch size of 4

+

AdamW Optimizer with micro batch size of 4 at 79GB-80GB memory cost