Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Saved answers for similar queries #7

Open
selmanays opened this issue Feb 9, 2023 · 2 comments
Open

Saved answers for similar queries #7

selmanays opened this issue Feb 9, 2023 · 2 comments

Comments

@selmanays
Copy link

What if GPT records the responses in a database and pulls the response from the database instead of sending new requests to OpenAI for similar queries?

@mmz-001
Copy link
Owner

mmz-001 commented Feb 14, 2023

All the queries (in the session) are cached with Streamlit so the exact same queries are not run twice. But doing that for similar queries is quite hard because we can't exactly define what "similar queries" mean. Two questions may look quite similar but the answers may be completely different.

@blackwhites
Copy link

you can use gptcache

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants