Skip to content

Commit

Permalink
Update README.md to be more detailed
Browse files Browse the repository at this point in the history
  • Loading branch information
jshuadvd committed Jul 18, 2024
1 parent 0627ce8 commit 644e5c7
Showing 1 changed file with 5 additions and 0 deletions.
5 changes: 5 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -194,6 +194,11 @@ print(output.shape) # Expected shape: (batch_size, target_length, d_model)

My implementation of LongRoPE achieves the following results:

1. Perplexity:
- 4k context: X.XX
- 128k context: X.XX
- 2048k context: X.XX


## Citation

Expand Down

0 comments on commit 644e5c7

Please sign in to comment.