Skip to content

Issues: bitsandbytes-foundation/bitsandbytes

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

221 Open 848 Closed
221 Open 848 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Cannot install multi backend (ROCm) Wheel version does not match filename
#1473 opened Jan 9, 2025 by RSWilli
asking for CUDA 124 when only CUDA 126 exists
#1470 opened Jan 7, 2025 by ron0studios
[BUG] AMD GPU compilation from source
#1468 opened Jan 4, 2025 by krenax
4
AttributeError: 'NoneType' object has no attribute 'cquantize_blockwise_fp16_fp4'
#1467 opened Jan 3, 2025 by hessaAlawwad
i am trying to install forge UI but its getting stuck at this
#1466 opened Jan 1, 2025 by MetaYousuf
[Ascend][Bug] Fail to use 4-bit quant model to inference
#1465 opened Dec 28, 2024 by MengqingCao
1
[ROCm] [Stable diffusion LoRA training, sd-scripts] Error invalid device function at line 224 in file /src/csrc/ops.hip
#1464 opened Dec 24, 2024 by devsantiagoweb
Deleting StableEmbedding still occupies GPU RAM
#1462 opened Dec 22, 2024 by KMFODA
[ROCm] Allowing for more flexibility in matching ROCm-specific PyTorch wheels to the installed ROCm version
#1461 opened Dec 19, 2024 by nikhil-tensorwave
bitsandbytes for macos M1,M2,M3 chips
#1460 opened Dec 19, 2024 by 0xD4rky
1
Link to code for reproducing table found in Multi-backend support (non-CUDA backends) documentation?
#1456 opened Dec 17, 2024 by epage480
Could not load bitsandbytes native library: libcusparse.so.11: cannot open shared object file: No such file or directory CUDA Setup waiting for info
#1452 opened Dec 13, 2024 by joshgura
@matthewdouglas
2
LoRA + deepspeed zero3 finetuing using 8bit quantization of base weights results in increased loss bug Something isn't working contributions-welcome We welcome contributions to fix this issue!
#1451 opened Dec 12, 2024 by winglian
CUDA Setup failed despite GPU being available. Core:setup A bug with respect to a specific setup CUDA Setup waiting for info
#1449 opened Dec 12, 2024 by Du-Zhai
3
Lookahead in forward bug Something isn't working
#1447 opened Dec 11, 2024 by Dionysour
@matthewdouglas
3
CUDA Setup failed despite GPU being available. cross-platform CUDA Setup waiting for info
#1446 opened Dec 11, 2024 by SrKium
1
No access to rocminfo in a production environment - ability to manually set GPU arch. AMD integration contributions-welcome We welcome contributions to fix this issue! cross-platform
#1444 opened Dec 11, 2024 by isaranto
1
CUDA setup failed on linux CUDA12.3 with version 0.45.0
#1440 opened Dec 9, 2024 by viki760
RuntimeError: Internal: could not parse ModelProto from /home/smusleh/miniGPT-Med/llama-2-7b-chat-hf/tokenizer.model
#1438 opened Dec 9, 2024 by smusleh
1
aarch64 whl in PyPi build cicd cross-platform enhancement New feature or request
#1437 opened Dec 8, 2024 by drikster80
1
RuntimeError: CUDA Setup failed despite GPU being available.
#1434 opened Dec 2, 2024 by kaijun123
5
8-bit C-Optim optimizers contributions-welcome We welcome contributions to fix this issue! feature-request
#1430 opened Nov 27, 2024 by odusseys
ROCm6.2 Error cublasLt Encountered Error!
#1428 opened Nov 24, 2024 by githust66
'NoneType' object has no attribute 'cget_col_row_stats'
#1427 opened Nov 24, 2024 by githust66
1
Anyway to change the quant_storage after the model is loaded?
#1426 opened Nov 23, 2024 by AaronZLT
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.