From eb9abaaf5fe57eb94025d568d63d3c49d9cba746 Mon Sep 17 00:00:00 2001 From: Joshua David Date: Fri, 19 Jul 2024 21:45:11 -0700 Subject: [PATCH] Update README.md to be more detailed --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 65efb12..274638d 100644 --- a/README.md +++ b/README.md @@ -206,7 +206,7 @@ LongRoPE's performance can be sensitive to hyperparameters. Key parameters to tu `population_size`, `num_mutations`, and `num_crossovers` in the lambda factor search Learning rate and scheduler parameters for fine-tuning -gradient_accumulation_steps for training stability +`gradient_accumulation_steps` for training stability ## Results