Offline Document Questioning Tool Ensuring Complete Privacy with LLMs

Github repositories

• imartinez/privateGPT

  privateGPT is a tool that allows you to ask questions to your documents offline, ensuring complete privacy as no data leaves your local environment. It utilizes LLMs (Language Model Models) and various technologies such as LangChain, GPT4All, LlamaCpp, Chroma, and SentenceTransformers. To set up the environment, you need to install the required dependencies and download the LLM model. The tool supports different document formats and provides instructions for ingesting your own dataset. Once the documents are ingested, you can ask questions and receive answers locally without an internet connection. The tool also offers a command-line interface and system requirements for Python and C++ compilers. However, please note that this is a test project and not intended for production use.