Adaline Gateway is a powerful, fully local SDK that allows for seamless integration with over 200 LLMs. It is production-ready, versatile, and does not act as a proxy. Features include batching, retries, caching, OpenTelemetry support, and customizable plugins. Notably, it supports plug-and-play providers for maximum flexibility. The SDK is strongly typed in TypeScript, works isomorphically, maintains privacy, and offers various tools for interacting with different LLMs. By creating Gateway, provider, model, config, and message objects, users can efficiently utilize Adaline Gateway for various chat and completion tasks.
https://github.com/adaline/gateway