AgentsJS is a new JavaScript/TypeScript library with OpenAI Realtime API support, enabling ultra-low latency WebRTC communication between GPT-4o and user devices in the Agents framework. This framework allows building AI-driven server programs that process text, audio, images, and video in real-time. It offers high-level abstractions, plugin support for various services like transcription and text-to-speech, and integration with LiveKit’s telephony stack. The framework is compatible with different environments and provides an integrated load balancing system. Users can contribute to its development and explore various example agents. The ecosystem includes SDKs, server APIs, UI components, and more.
https://github.com/livekit/agents