Desktop Installation Overview ~ AnythingLLM

AnythingLLM Installation

Installation Overview

AnythingLLM Desktop is a " single-player " application you can install on any Mac, Windows, or Linux operating system and get local LLMs, RAG, and Agents with little to zero configuration and full privacy.

Docker vs Desktop Version

AnythingLLM offers two main ways to use AnythingLLM. There are some distinct differences in functionality between each offering. Both are open source.

You want AnythingLLM Desktop if...

  • You want a one-click installable app to use local LLMs, RAG, and Agents locally
  • You do not need multi-user support
  • Everything needs to stay only on your device
  • You do not need to "publish" anything to the public internet. Eg: Chat widget for website

You want AnythingLLM Docker if...

  • You need an easy setup, but server-based service for AnythingLLM to use local LLMs, RAG, and Agents locally
  • You want to run an AnythingLLM instance that many people can use at the same time
  • You want to be able to share information with our users on your instance you invite
  • You need admin and rule-based access for workspaces and documents.
  • You will publish chat widgets to the public internet
  • You want to access AnythingLLM from the browser

The below table is a non-exhaustive list of features supported between platforms.

Feature Available on Desktop Available on Docker
Multi-user support ❌ ✅
Emeddable chat widgets ❌ ✅
One-click install ✅ ❌
Private documents ✅ ✅
Connect to any vector database ✅ ✅
Use any LLM ✅ ✅
Built-in embedding provider ✅ ✅
Built-in LLM provider ✅ ❌
White-labeling ❌ ✅
Chat logs ✅ ✅
Agent support ✅ ✅
Agent skills ✅ ✅
Third-party data connectors ✅ ✅
Password protection ❌ ✅
Invite new users to instance ❌ ✅
Text splitting configuration ✅ ✅
Whisper model support ✅ ✅
Full developer API ✅ ✅
User management ❌ ✅
Workspace access management ❌ ✅
Website scraping ✅ ✅

️💡

Tip: AnythingLLM Desktop is the easiest way to use AnythingLLM.

AnythingLLM System Requirements System Requirements → AnythingLLM MacOS Install MacOS Install → AnythingLLM Windows Install Windows Install → AnythingLLM Linux Install Linux Install → AnythingLLM Local Docker Install Local Docker Install → Midori AI Subsystem Midori AI Subsystem Manager → AnythingLLM Cloud Docker Install Cloud Docker Install → Last updated on FAQ System Requirements

Interactive Graph
Table Of Contents
Desktop Installation Overview ~ AnythingLLM
Installation Overview
Docker vs Desktop Version
You want AnythingLLM Desktop if...
You want AnythingLLM Docker if...
Quick Links