privateGPT offers the ability to ask document-related questions without an internet connection. This system is built using LangChain, GPT4All, LlamaCpp, Chroma, and SentenceTransformers. To use privateGPT, users must install all required packages, download the LLM model, and reference it appropriately. The software supports various file extensions and allows users to ingest their own datasets. Additionally, privateGPT can be modified using the command-line arguments. The project aims to provide a fully private solution for question answering while acknowledging that the model selection is not optimized for performance but prioritizes privacy.
https://github.com/imartinez/privateGPT