Skip to content

v0.3.1-cpt-dynamic_batch_loading: Llama2 CPT with Dynamic Batch Loading
Compare
Choose a tag to compare
@Spico197 Spico197 released this 17 Nov 09:09
· 51 commits to main since this release
v0.3.1-cpt-dynamic_batch_loading
d6a3780
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
  • Llama2 CPT with 4096 context length training.
  • Dynamic batch loading from ShearedLlama Implementation.
Assets 2
Loading