Nitro is an embeddable AI server that can enhance applications with local AI capabilities. It is a lightweight 3mb inference server that developers can easily integrate into their apps. Nitro serves as a drop-in replacement for OpenAI’s REST API. It runs on both CPU and GPU architectures, making it suitable for various platforms. Nitro also integrates with other open-source AI libraries. The architecture of Nitro is open source and it is licensed under AGPLv3. Developers can quickly start using Nitro in their apps with easy installation and documentation available. There are also plans to expand Nitro’s capabilities to include vision and speech.
https://nitro.jan.ai/