Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Not able to install LM Runtime after upgrading to version LM Studio 0.3.6 (Build8) under MacOS 15.2 (M4 Apple Silicon) #294

Open
Oliver-Fischer opened this issue Jan 9, 2025 · 19 comments

Comments

@Oliver-Fischer
Copy link

After upgrading to version 0.3.6 (from 0.3.5) it is not possible to install any LM Runtime. I can download Metal llama.cpp v1.7.1 as well as LM Studio MLX v0.1.3, but they are not installed and therefor it is not possible to run any of my downloaded llms.
Bildschirmfoto 2025-01-09 um 21 44 43

@HelpfulScripts
Copy link

HelpfulScripts commented Jan 10, 2025

Exact same issue here.
Is there a link to roll back to 0.3.5?

@yagil
Copy link
Member

yagil commented Jan 10, 2025

Hello, please try the following steps:

We think this happens when you run the app from the .dmg window and not from /Applications the first time you run it.

Here's how to solve it (Mac only):

  1. close LM Studio, make sure it's not running from the tray either
  2. remove it from /Applications on your Mac (i.e. uninstall it)
  3. run one of the following commands in your Terminal

If this is the first time you installed LM Studio

rm -rf ~/.lmstudio/extensions

If you've updated LM Studio

rm -rf ~/.cache/lm-studio/extensions
  1. Reinstall the app from the installer you downloaded by dragging it into the /Applications folder
  2. Open it from the /Applications folder <------ very important

@HelpfulScripts
Copy link

Thank you! Removing the extensions in ~/.cache seems to have solved it (I'm prettty sure I started from Applications before)
Loading runtimes now works again; and model loading as well
👍

@namp
Copy link

namp commented Jan 10, 2025

The solution does not work for me. Removed the extensions folder and reinstalled countless times and still the same issue. Runtimes are downloaded but never installed.

M1 Max 64GB, Sonoma 15.2
runtimes

Hello, please try the following steps:

We think this happens when you run the app from the .dmg window and not from /Applications the first time you run it.

Here's how to solve it (Mac only):

  1. close LM Studio, make sure it's not running from the tray either
  2. remove it from /Applications on your Mac (i.e. uninstall it)
  3. run one of the following commands in your Terminal

If this is the first time you installed LM Studio

rm -rf ~/.lmstudio/extensions

If you've updated LM Studio

rm -rf ~/.cache/lm-studio/extensions
  1. Reinstall the app from the installer you downloaded by dragging it into the /Applications folder
  2. Open it from the /Applications folder <------ very important

@yagil
Copy link
Member

yagil commented Jan 10, 2025

@namp while it's not impossible there's another issue, so far the workaround worked for everyone, so my guess would be you may have missed a step or did not do it exactly. Can you please try again?

@namp
Copy link

namp commented Jan 10, 2025

llama.cpp runtime (1.7.1) again just downloads and does not try to install at all.

However I noticed that mlx 0.1.3 hangs after download with the following error:

Error: Process error: spawn /Users/nikos/.cache/lm-studio/extensions/backends/vendor/_amphibian/app-mlx-generate-mac-arm64@11/bin/python EACCES Command: /Users/nikos/.cache/lm-studio/extensions/backends/vendor/_amphibian/app-mlx-generate-mac-arm64@11/bin/python -I /Users/nikos/.cache/lm-studio/extensions/backends/vendor/_amphibian/app-mlx-generate-mac-arm64@11/postinstall.py Error output:

Nevertheless some files have been created in the extensions dir. The only thing that I can think of as potential source of problem is that my ~/.cache is a symbolic link to an external storage disk

lm1
lm3
lm2

@yagil
Copy link
Member

yagil commented Jan 10, 2025

@namp thanks for the extra info. The workaround procedure should solve this exact thing. As I said there may be an additional issue we’re not aware of yet, but I’m currently guessing it’s due to missing a step or not doing it exactly as written

@namp
Copy link

namp commented Jan 10, 2025

Thank you for your support. However there's no doubt that I follow the exact steps as described. I even remove any previous installations in /Applications with AppCleaner so as to make sure nothing remains.

Unfortunately I'll have to revert back to 3.0.5 and hope for a new build which might solve the issue

@yagil
Copy link
Member

yagil commented Jan 10, 2025

@namp want to hop on the discord and tag me? I’ll debug with you live https://discord.gg/aPQfnNkxGC

@yagil
Copy link
Member

yagil commented Jan 10, 2025

For new folks finding this issue, the fix that works for most people is here: #294 (comment)

@blokhin
Copy link

blokhin commented Jan 10, 2025

I can confirm simple deletion of extensions folder and restarting the app helps.

@namp
Copy link

namp commented Jan 10, 2025

@namp want to hop on the discord and tag me? I’ll debug with you live https://discord.gg/aPQfnNkxGC

@yagil Much appreciated but I seem to have missed the invitation time window. Please let me know if you'll be available again.

@namp
Copy link

namp commented Jan 11, 2025

SOLVED IT. Indeed the problem was that .cache was a symbolic link to an external drive. As soon as lmstudio was installed from scratch to a real $HOMEDIR/.cache directory, the runtimes were installed.

After installation I reverted back the .cache folder to the external drive and everything seems to be working

@Garblesnarff
Copy link

Hello, please try the following steps:

We think this happens when you run the app from the .dmg window and not from /Applications the first time you run it.

Here's how to solve it (Mac only):

  1. close LM Studio, make sure it's not running from the tray either
  2. remove it from /Applications on your Mac (i.e. uninstall it)
  3. run one of the following commands in your Terminal

If this is the first time you installed LM Studio

rm -rf ~/.lmstudio/extensions

If you've updated LM Studio

rm -rf ~/.cache/lm-studio/extensions
  1. Reinstall the app from the installer you downloaded by dragging it into the /Applications folder
  2. Open it from the /Applications folder <------ very important

This fixed my issue, and the builder was nice enough to point me to this fix from X, I just wanted to post a thank you here as well!

@Ksasa78
Copy link

Ksasa78 commented Jan 15, 2025

SOLVED IT. Indeed the problem was that .cache was a symbolic link to an external drive. As soon as lmstudio was installed from scratch to a real $HOMEDIR/.cache directory, the runtimes were installed.

After installation I reverted back the .cache folder to the external drive and everything seems to be working

I had the very same issue as well, with symbolic link messing around with yagil's solution, thanks to you, I have fixed in the very same way.

@miranda
Copy link

miranda commented Jan 16, 2025

This might be the same bug as mine, but not sure.
#305

My entire home directory is on an external drive. I haven't figured out a workaround, if that is actually the cause. I tried the instructions here but it made no difference.

I could try creating another user account that would be on the internal drive... but seems like this is just going to be a problem going forward if it can't install anything to external drives. The files are there, I've given it Full Disk permission just in case. But I can't load any models and downloading runtimes just resets the button back to "download and install" afterwards.

@ink-splatters
Copy link

This might be the same bug as mine, but not sure. #305

My entire home directory is on an external drive. I haven't figured out a workaround, if that is actually the cause. I tried the instructions here but it made no difference.

This issue:

Error: Process error: spawn /Users/nikos/.cache/lm-studio/extensions/backends/vendor/_amphibian/app-mlx-generate-mac-arm64@11/bin/python EACCES Command: /Users/nikos/.cache/lm-studio/extensions/backends/vendor/_amphibian/app-mlx-generate-mac-arm64@11/bin/python -I /Users/nikos/.cache/lm-studio/extensions/backends/vendor/_amphibian/app-mlx-generate-mac-arm64@11/postinstall.py 

is due to python referenced by relative symlink(s) by some reasons does not have executable permissions.

lnk=~/.cache/lm-studio/extensions/backends/vendor/_amphibian/app-mlx-generate-mac-arm64@11/bin/python
chmod +x $(dirname $lnk)/$(readlink $lnk)

fixes it.

In my case, however this doesn't stop lm-studio from keeping on failing for me, e.g. not showing downloaded models.

@miranda
Copy link

miranda commented Jan 16, 2025

The solutions here do not work for me. I don't think my issue should have been closed.

I don't even have an lm-studio folder in my ~/.cache, it never gets created. The only thing that gets created is ~/.lmstudio. I have deleted that folder and reinstalled the app numerous times. It does not solve the issue.

Also, LM Studio has no problem showing all the downloaded models. They just can't be loaded by any of the "load model" buttons. They can be selected, and even configured... but load does nothing.

@marlin9993
Copy link

it works

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

10 participants