AI Tools tagged "Local LLM"

All AI tools tagged with "Local LLM", curated and verified by our team.

30 AI Tools12 Verified

Top Local LLM Tools

Highest-rated tools in this category, curated weekly

Top

AI Models & LLMs

Qwen

Qwen3.6-27B delivers frontier-adjacent coding performance in 16.8 GB, it fits on an RTX 4090 and outperforms its 397B predecessor. Apache 2.0 across the full open-weight family makes it the cleanest-licensed Chinese LLM for commercial use in 2026.

Freemium

Top

AI Models & LLMs

DeepSeek

DeepSeek offers frontier-level reasoning and coding performance at API costs 10–30x cheaper than GPT-4o. The tradeoff is real: political censorship on the hosted product, PRC data residency, and a documented database exposure. Open weights mean local deployment is possible, at a price.

Freemium

AI Models & LLMs

Gemma

Gemma is Google DeepMind's family of open-weight language models, downloadable and self-hostable for free. Gemma 4 (April 2026) delivers frontier-level reasoning and multimodal capabilities under an Apache 2.0 license, from 2B edge models to a 31B dense flagship.

Free

AI Models & LLMs

Jan

Jan is a free, open-source desktop app by Menlo Research that runs large language models entirely on your own hardware. No cloud, no subscriptions, no data leaving your machine. Supports Llama, Qwen, Mistral, Gemma, and dozens more GGUF models on Windows, macOS, and Linux.

Free

Code

Axolotl

Axolotl is a free, open-source LLM fine-tuning framework that lets ML teams run reproducible LoRA, QLoRA, and GRPO training runs on 100+ model architectures using a single YAML config file across multi-GPU setups.

Freemium

AI Models & LLMs

Cherry Studio

Cherry Studio is a free, open-source desktop client that unifies 300+ LLM providers including OpenAI, Claude, Gemini, and local Ollama models in a single interface. It adds built-in RAG knowledge bases, MCP agent support, and side-by-side model comparison on Windows, macOS, and Linux.

Free

Code

BentoML

BentoML is an open-source Python framework for packaging and deploying machine learning models as production APIs. It supports any ML framework, includes OpenLLM for self-hosted LLM serving, and offers BentoCloud for managed inference with autoscaling and BYOC.

Freemium

AI Models & LLMs

MLX

MLX is Apple ML Research's open-source array framework for running and fine-tuning machine learning models on Apple Silicon. Free, MIT-licensed, and designed to extract maximum performance from M1 through M5 chips using unified memory.

Free

Code

Unsloth

Unsloth is an open-source fine-tuning library by Daniel and Michael Han that delivers 2x faster LLM training and up to 70% less VRAM through custom Triton CUDA kernels. Supports 500+ models including Llama, Qwen, and DeepSeek. Free to use, with a paid Pro tier for multi-GPU training.

Freemium

AI Models & LLMs

llama.cpp

llama.cpp is the open-source C++ inference engine that powers Ollama, LM Studio, and most local LLM tooling. Created by Georgi Gerganov in 2023, it runs 50+ model architectures on any hardware, including consumer laptops and Raspberry Pis.

Free