Run AI on your own computer

Updated 10:00 UTC.

The most used open source project in the Run AI on your own computer category is open-webui/open-webui (158,689 stars), followed by ggml-org/llama.cpp and odysseus-dev/odysseus. There is no 30 day star data yet, so growth is not ranked (data as of 2026-11-15).

Most used

  1. open-webui/open-webui158,689 stars
  2. ggml-org/llama.cpp135,134 stars
  3. odysseus-dev/odysseus95,662 stars

Quick comparison

  • open-webui/open-webui

    User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

    License Custom license: Check the licenseMaintenance: Active

  • ggml-org/llama.cpp

    LLM inference in C/C++

    License MIT: YesMaintenance: Active

  • odysseus-dev/odysseus

    Self-hosted AI workspace.

    License AGPL-3.0: Yes, with conditionsMaintenance: Active

  • unslothai/unsloth

    Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.

    License Apache-2.0: YesMaintenance: Active

  • nomic-ai/gpt4all

    GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

    License MIT: YesMaintenance: Slow

  • Not legal advice
Not legal advice
ProjectWhat it isLicenseMaintenance
open-webui/open-webuiUser-friendly AI Interface (Supports Ollama, OpenAI API, ...)Custom license: Check the licenseActive
ggml-org/llama.cppLLM inference in C/C++MIT: YesActive
odysseus-dev/odysseusSelf-hosted AI workspace. AGPL-3.0: Yes, with conditionsActive
unslothai/unslothLocal UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.Apache-2.0: YesActive
nomic-ai/gpt4allGPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.MIT: YesSlow

All tools for this problem

22 projects, by 30 day growth, then stars.

  1. open-webui/open-webui

    User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

    158,689 stars+609 in 7 daysMaintenance: Active

  2. ggml-org/llama.cpp

    LLM inference in C/C++

    135,134 stars+1,436 in 7 daysMaintenance: Active

  3. unslothai/unsloth

    Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.

    79,528 stars+343 in 7 daysMaintenance: Active

  4. nomic-ai/gpt4all

    GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

    77,345 stars+1 in 7 daysMaintenance: Slow

  5. Mintplex-Labs/anything-llm

    Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience

    68,295 stars+240 in 7 daysMaintenance: Active

  6. jellyfin/jellyfin

    The Free Software Media System - Server Backend & API

    59,386 stars+267 in 7 daysMaintenance: Active

  7. JustVugg/colibri

    A hierarchical inference engine for frontier MoE models: hot experts on the GPU (CUDA, Vulkan), warm ones in RAM, cold ones streamed from NVMe. Written in C, runs on the hardware you already own.

    51,214 stars+2,367 in 7 daysMaintenance: Active

  8. exo-explore/exo

    Run frontier AI locally.

    48,427 stars+182 in 7 daysMaintenance: Active

  9. oobabooga/textgen

    Open-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private.

    47,739 stars+5 in 7 daysMaintenance: Active

  10. janhq/jan

    Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.

    45,728 stars+148 in 7 daysMaintenance: Active

  11. danielmiessler/Fabric

    Fabric is an open-source framework for augmenting humans using AI. It provides a modular system for solving specific problems using a crowdsourced set of AI prompts that can be used anywhere.

    44,640 stars+63 in 7 daysMaintenance: Active

Show 10 more tools
  1. Niko1221/Strata

    Run local AI models on your own computer

    44,322 stars+2,608 in 7 daysMaintenance: Active

  2. lyogavin/airllm

    AirLLM 2.8T LLM inference with single 4GB GPU

    42,425 stars+473 in 7 daysMaintenance: Active

  3. linshenkx/prompt-optimizer

    An AI prompt optimizer for writing better prompts and getting better AI results.

    41,591 stars+709 in 7 daysMaintenance: Active

  4. p-e-w/heretic

    Training-free language model modification: Remove censorship, suppress slop, reduce sycophancy, and more

    40,631 stars+677 in 7 daysMaintenance: Active

  5. AlexsJones/llmfit

    Hundreds of models & providers. One command to find what runs on your hardware.

    38,997 stars+243 in 7 daysMaintenance: Active

  6. ItzCrazyKns/Vane

    Vane is an AI-powered answering engine.

    38,213 stars+147 in 7 daysMaintenance: Slow

  7. utmapp/UTM

    Virtual machines for iOS and macOS

    36,901 stars+130 in 7 daysMaintenance: Active

  8. anywhere-labs/dsh-desktop

    为 DeepSeek Harness (DSH) 插件生态打造的现代化桌面端解决方案。万物皆「插件」,桌面本身也是「插件」。

    36,051 stars+711 in 7 daysMaintenance: Active

  9. ashhart/TensorFold

    LLM Inference Engine for Metal, CUDA and Vulkan.

    2,217 starsMaintenance: Active

Which one?

  • Niko1221/Strata: People who want AI running on their own computer without an account