Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cannot load GGUF models with newest version(s) #6659

Open
1 task done
Oblivionus opened this issue Jan 12, 2025 · 0 comments
Open
1 task done

Cannot load GGUF models with newest version(s) #6659

Oblivionus opened this issue Jan 12, 2025 · 0 comments
Labels
bug Something isn't working

Comments

@Oblivionus
Copy link

Describe the bug

I cannot load any GGUF models with the newest versions (including Dev versions).
I tried out different models and get the attached error message.
I also tried using the llamacpp_HF loader with the converted models (using the tab llamacpp_HF creator) with the same result.

I have tried a fresh download with and without updating.

Is there an existing issue for this?

  • I have searched the existing issues

Reproduction

see above

Screenshot

grafik

Logs

see screenshot
There is no log file in the logs folder for this

System Info

Windows 10 Pro
AMD Ryzen 5 3600 6-Core
Nvidia RTX 3080 Ti
@Oblivionus Oblivionus added the bug Something isn't working label Jan 12, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant