Max input size. Feature request.

[agiUnderground]

Hi!

For the next release, please consider increasing the API allowed 'max input size' limit. I think it's different from a context window, just max size of the input text. It is very limiting factor. Increasing this limit to at least 1M input tokens would be a significant improvement and help alleviate a major limiting factor.

Additionally, it would be beneficial if we had an option to decrease the context window to 0 and increase the max input size to its maximum possible value. This would provide more flexibility for users who require it.

Thank you!