We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
You might be interested to look at this:
https://github.com/astramind-ai/Auralis/tree/main
The text was updated successfully, but these errors were encountered:
Agree, the vLLM back end and the optimization offers pretty good speed up and concurrency.
Sorry, something went wrong.
I saw this as well, it's on my radar but haven't looked at it yet. Seems promising!
This would be great for those of us using live answers like in Home-Assistant!
Sorry I haven't updated this in a while, I still haven't found the time to get back to working on it again...
No branches or pull requests
You might be interested to look at this:
https://github.com/astramind-ai/Auralis/tree/main
The text was updated successfully, but these errors were encountered: