Arch is an intelligent gateway for agents. Engineered with (fast) LLMs for the secure handling, rich observability, and seamless integration of user prompts with your APIs - outside business logic. Built by the core contributors of Envoy proxy, on Envoy.
proxy routing gateway prompt proxy-server openai envoy envoyproxy llms generative-ai llmops llm-inference ai-gateway llm-gateway llm-routing
-
Updated
Dec 22, 2024 - Rust