PRACTICAL GUIDE · CHOOSE BY USE CASE
Local AI tools: software, hardware and model limits
Choose the local task first, then the software and model that can support it on your machine. Local chat, image generation and transcription involve different workloads; this selection is a starting point for checking compatibility and access terms.
Questions to settle before choosing
What do you want to run locally?
Use the product descriptions to distinguish the tasks each entry addresses. Then check the official setup and system requirements for your operating system and hardware.
What requires a connection?
Model downloads, external services and optional cloud features can have their own network requirements. Verify the intended setup before relying on it without internet access.
What are the practical costs?
Account for storage, memory, processing time and any optional services. Review both software and model licenses for the work you plan to do.
A selection to explore
An editorial selection, not a measured ranking. Access types and restrictions remain visible, including trials or paid access where relevant.
Ollama
Local & privateLocal model runner and API for downloading, serving, and using open models on your own hardware.
Unlimited local inference on your hardware; optional cloud starter credits and paid usage are separate.
- ↳Developers serving private models on local hardware
Keep in mindLocal speed and model size depend on your hardware; commercial rights depend on each downloaded model's license.
Oct 4, 2026
LM Studio
Local & privateDesktop local-AI workspace with model discovery, chat, document retrieval, agents, and compatible local APIs.
Free local models, Bionic Agent, offline transcription, limited web search, and LM Link for five devices.
- ↳Private local AI with a polished desktop interface
Keep in mindLocal model speed and quality depend on compatible hardware; output rights depend on each model's license.
Oct 4, 2026
Jan.ai
Local & privateOpen-source desktop assistant for downloading local models, building assistants, connecting tools, and serving a local API.
Free local inference after downloading a model; no cloud account or per-prompt usage fee is required.
- ↳Local AI chat with optional cloud providers and tool connections
Keep in mindJan's Apache 2.0 code license is separate from downloaded model licenses. Output-use rights and hardware requirements vary by model; connected online tools require network access.
Oct 4, 2026
GPT4All
Local & privateDesktop app and Python library for running downloaded language models and chatting with local documents.
Free local model inference on your hardware, with no hosted prompt-credit quota.
- ↳Private document chat on a personal computer
Keep in mindThe app's permissive software license does not license every model or its outputs. Check each model's commercial terms and hardware requirements.
Oct 4, 2026
AnythingLLM
Local & privateLocal desktop and self-hosted AI workspace for document chat, retrieval, agents, and connections to local or hosted models.
Free desktop and self-hosted software; local models avoid provider token quotas while using your own compute.
- ↳Building a private assistant over your own documents
Keep in mindMIT-licensed application code does not grant universal rights to connected models or outputs. Desktop is local; hosted multi-user service and external APIs have separate costs.
Oct 4, 2026
Stable Diffusion
Local & privateA family of downloadable image-generation models used through local software such as ComfyUI, with terms that differ by model version.
Run eligible downloadable models locally without a hosted credit quota; hardware costs and each model's license still apply.
- ↳Custom image-generation workflows on your own hardware
Keep in mindCheck the exact model: SD3.5 uses the Community License, while other versions may have different terms. No universal output-rights or watermark claim applies across the family.
Oct 4, 2026
Whisper
Local & privateOpenAI's downloadable speech-recognition models and Python tools for local transcription and speech translation into English.
Free local transcription with downloadable model weights; no hosted minute allowance or account is needed.
- ↳Transcribing audio and creating subtitle files locally
Keep in mindCode and model weights use the MIT license; that does not establish rights to every input recording or resulting transcript. Setup and local compute are required.
Oct 4, 2026
Check the original sources
The plan summaries above come from the current catalog. Each tool has its own source-review date; this guide’s editorial date does not refresh those checks.
Ollama
LM Studio
Jan.ai
GPT4All
AnythingLLM
Stable Diffusion
Whisper
Make a shortlist for your project
Start with the requirement you cannot compromise on, then use the finder to compare matching plans. Read the complete restrictions before relying on a free allowance for repeat work.
Filter and compare the catalog →