Add softcapping support to flash attention#2437

Closed

EricLBuehler wants to merge 72 commits intohuggingface:mainfrom EricLBuehler:flash_attn_softcap

+4,961-1,035

Commits on May 15, 2024

Commits on May 16, 2024

Commits on May 18, 2024

Merge remote-tracking branch 'upstream/main'
EricLBuehler
committed

Commits on May 19, 2024

Remove candle-layer-norm (#6 )

EricLBuehler
and
LaurentMazare
authored
Merge
EricLBuehler
committed

Commits on May 27, 2024

Merge
EricLBuehler
committed

Commits on May 28, 2024

Merge remote-tracking branch 'upstream/main'
EricLBuehler
committed

Commits on May 29, 2024

Merge remote-tracking branch 'upstream/main'
EricLBuehler
committed

Commits on May 30, 2024

Merge remote-tracking branch 'upstream/main'
EricLBuehler
committed

Commits on Jun 1, 2024

Merge remote-tracking branch 'upstream/main'
EricLBuehler
committed

Commits on Jun 3, 2024

Commits on Jun 4, 2024

Merge remote-tracking branch 'upstream/main'
EricLBuehler
committed

Commits on Jun 9, 2024

Commits on Jun 11, 2024

Commits on Jun 29, 2024

Add QTensor::quantize_onto (#12 )
EricLBuehler
authored
implement Slice op (huggingface#2260 )

shua
authored and
EricLBuehler
committed
Fix the fast bf16 gemm cublas kernels. (huggingface#2274 )

LaurentMazare
authored and
EricLBuehler
committed
Fix a bug in the metal implemtation of col2im1d. (huggingface#2284 )

LaurentMazare
authored and
EricLBuehler
committed
Depth Anything v2 (huggingface#2279 )

authored and
EricLBuehler
committed
Adding Gemm and ArgMax operators to candle-onnx (huggingface#2231 )

authored and
EricLBuehler
committed
Add DINOv2Reg4 + PlantCLEF2024 (huggingface#2293 )

authored and
EricLBuehler
committed
make up for the missing last token output of phi2 example (huggingface#2299 )

Czxck001
authored and
EricLBuehler
committed

Commits on Jun 30, 2024

Patch metal function
EricLBuehler
committed

Commits on Jul 15, 2024

Complete merge
EricLBuehler
committed

Commits on Jul 26, 2024

Commits on Jul 31, 2024

Merge remote-tracking branch 'upstream/main'
EricLBuehler
committed

Commits on Aug 7, 2024

Simplify things a bit
EricLBuehler
committed

Commits on Aug 9, 2024

Mistral.rs GPTQ dev PR (#14 )
EricLBuehler
authored

Commits on Aug 14, 2024

Fix on metal
EricLBuehler
committed
Add the flux model for image generation. (huggingface#2390 )

LaurentMazare
authored and
EricLBuehler
committed
Simplify handling of flux modulations. (huggingface#2394 )

LaurentMazare
authored and
EricLBuehler
committed
optimize gradient for silu a bit (huggingface#2393 )

MilkFather
authored and
EricLBuehler
committed
Support the flux-dev model too. (huggingface#2395 )

LaurentMazare
authored and
EricLBuehler
committed
Support for mistral-nemo. (huggingface#2396 )

LaurentMazare
authored and
EricLBuehler
committed
add models support and example for THUDM/glm-4 (huggingface#2362 )

authored and
EricLBuehler
committed
Add the MMDiT model of Stable Diffusion 3 (huggingface#2397 )

Czxck001
authored and
EricLBuehler
committed
Add the import script for the T5 tokenizer. (huggingface#2399 )

LaurentMazare
authored and
EricLBuehler
committed
fix: usage of actions/checkout@v2 (huggingface#2403 )

hamirmahal
authored and
EricLBuehler
committed
Fix issues in the encodec example README.md (huggingface#2407 )

jnises
authored and
EricLBuehler
committed
Soft Non-Maximum Suppression (huggingface#2400 )

onichmath
authored and
EricLBuehler
committed
Add documentation examples for Tensor::i and Tensor::narrow methods (huggingface#2308 )

authored and
EricLBuehler
committed
Add Based LLM from Hazy Research. (huggingface#2411 )

janimo
authored and
EricLBuehler
committed
Fix the device for the bert attention mask. (huggingface#2414 )

LaurentMazare
authored and
EricLBuehler
committed
Clippy fixes. (huggingface#2415 )

LaurentMazare
authored and
EricLBuehler
committed
Update flash_fwd_launch_template.h with fix for kernels (#16 )
joshpopelka20
authored
Build fixes
EricLBuehler
committed
Merge branch 'sdpa'
EricLBuehler
committed

Commits on Aug 21, 2024

Add GGUF BF16 support (#17 )
EricLBuehler
authored