OpenLLMetry-JS is an extension built on OpenTelemetry that provides complete observability for your LLM (Low-Level Machine Learning) application. It can be connected to existing observability solutions like Datadog and Honeycomb. The project, maintained by Traceloop, offers standard OpenTelemetry instrumentations for LLM providers and Vector DBs, as well as a Traceloop SDK for easy integration. The easiest way to get started is by using the SDK provided, which requires installing the @traceloop/node-server-sdk package. OpenLLMetry-JS supports exporting traces to various destinations like Traceloop, Dynatrace, Datadog, and more. It can instrument various components such as DBs, API calls, and frameworks like LangChain and LlamaIndex.
https://github.com/traceloop/openllmetry-js