Skip to main content
Watch: Grok Bot Built My AI Video Arena While I Tested 8 Models

LOCAL AI

23 items

18 posts, 5 tools

Blog
Muse Spark Open Weights: 816B Model, Benchmarks, and How to Run It

Meta released Muse Spark Open weights on October 15, 2026: 816B total, 42B active, 1M context. Run recipes, hardware floor, license catch, and where it trails.

Blog
EmbeddingGemma 2 Guide: Local Multimodal Embeddings for Code

EmbeddingGemma 2 is a 740M open model that embeds code, images, video and audio in one space. Specs, Matryoshka storage math, and where it breaks.

Blog
Hermes Agent Guide (2026): What It Is, Local Setup With Ollama, Skills, and Hermes vs OpenClaw

Hermes Agent is Nous Research's open-source, self-improving AI agent. Run it locally with Ollama, see how its skills system works, and compare it with OpenClaw.

Blog
GitHub Copilot for JetBrains Gains Persistent Memory and Ollama BYOK

GitHub Copilot for JetBrains adds memory across chat sessions, Ollama as a BYOK provider, and enterprise settings for MCP access. What each feature does.

Blog
Cactus Needle 2: The 14MB Agentic LLM That Runs on a Raspberry Pi 5

Cactus open-sourced Needle 2, a 45M-parameter agentic LLM in a single 14MB binary that runs a full tool-calling session in 28MB of RAM. 500 tok/s on a Raspberry Pi 5, ESP32-S3 class parts, Apache 2.0. Here is what the benchmarks actually show.

Blog
Muse Glimmer 30B: Meta's Open-Weight Local Agent Model, Benchmarks, and Hardware Reality

Muse Glimmer 30B is Meta's Apache 2.0 open-weight multimodal agent model that runs in 24GB. Benchmarks, hardware reality and what the numbers actually say.

Blog
Running Gemma 4 26B at 5 Tokens/Sec on a 13-Year-Old Xeon With No GPU

Gemma 4 26B on a 2013 Xeon with no GPU: how a sub-$300 box reached about 5 tokens/sec, the silent MoE bug behind the gibberish, and the upstream fix.

Blog
Colibri: Run GLM 5.2 on a 32GB Laptop With Disk Streaming

A solo developer built a 1,300-line C inference engine that runs the 744B GLM 5.2 model on consumer hardware by streaming routed experts from disk.

Blog
Kokoro: Local, CPU-Friendly TTS That Actually Sounds Good

An 82M parameter text-to-speech model that runs on CPU and produces high-quality speech across multiple languages - no cloud APIs or GPU required.

Blog
Program-as-Weights Turns Prompts Into Local Fuzzy Functions

Program-as-Weights compiles prompts into compact local adapters that act as fuzzy functions. What the paper claims and where developers could use it first.

Blog
GLM-5.2 Local Deployment: Running Z.ai's 744B Model on Consumer Hardware

Run GLM-5.2 locally with Unsloth dynamic quantization: hardware math for a 256GB Mac or 24GB GPU, quantization tradeoffs and lessons from the HN thread.

Blog
DiffusionGemma: Google Bets Diffusion Can Make Text Generation 4x Faster

DiffusionGemma is Google's 26B MoE open model that generates 256-token blocks in parallel. What diffusion generation means for latency and local inference.

Blog
What Is Cline? The Open-Source AI Coding Agent for VS Code

Cline is a free, open-source VS Code extension for agentic AI coding. Bring your own model, a cloud API or a local one via Ollama, with no vendor lock-in.

Blog
Client-Side Tool Calling Is the Privacy Pattern AI Apps Need

Client-side tool calling keeps sensitive documents in the browser while the model requests narrow actions. How it works and what still leaves the machine.

Tool
Ollama

The easiest way to run LLMs locally. One command to pull and run any model. OpenAI-compatible API. 52M+ monthly downloads. Supports GGUF, Safetensors, and custom Modelfiles.

Tool
LM Studio

Desktop app for discovering, downloading, and running local LLMs. Clean chat UI, OpenAI-compatible API server, and automatic GPU detection. MLX engine optimized for Apple Silicon.

Tool
Jan

Open-source ChatGPT alternative that runs models fully offline. Desktop app with local models, cloud API connections, custom assistants, and MCP integration. Apache 2.0 licensed.

Tool
GPT4All

Private local AI chatbot by Nomic. MIT licensed with 77K+ GitHub stars. LocalDocs lets you chat with your own files. Runs on Windows, macOS, and Linux; latest release is v3.10.0 from February 2025.

Tool
LocalAI

Open-source OpenAI API replacement. Runs LLMs, vision, voice, image, and video models on any hardware, no GPU required. 60+ backends. Distributed mode for scaling.

Blog
DeepSeek R1 and V3: The Developer's Guide to Open-Source AI

DeepSeek R1 and V3 developer guide: use the MIT-licensed models through the API, run them locally with Ollama and decide when they beat closed-source models.

Page 1 of 2Next
AI Development Stack

Get Smarter About AI Dev

New tutorials, open-source projects, and deep dives on coding agents - delivered weekly.

One email per weekReal code, not theoryFree forever