SELF-HOSTING

Block open-sourced Buzz, a team workspace where agents are cryptographic identities instead of bot tokens. Every message is a signed Nostr event, the relay is yours to run, and the CLI is JSON in, JSON out.

A fair comparison of vLLM, TGI, SGLang, TensorRT-LLM, llama.cpp, and LMDeploy for self-hosted LLM inference - batching, quantization, hardware, and ops.

A detailed breakdown of jamesob's viral local LLM guide covering the $2k and $40k hardware paths, critical BIOS settings, and why most setups fail at PCIe negotiation and IOMMU.

Alex Ellis shares real production experience running local LLMs: $12k hardware investment, 2-3 month ROI, and why treating local models as Opus substitutes misses the point entirely.

Cohere shipped its first developer-facing model on June 9, 2026. North Mini Code is a 30B mixture-of-experts coding model with 3B active parameters, Apache 2.0 weights, and a deployment footprint of a single H100. Here is what it actually offers and where the open questions are.

Open weights are free to download, but inference is not free to run. Here is the honest break-even math on when self-hosting GLM-5.2, DeepSeek V4, or Llama beats paying per-token API prices - GPU rental and ownership costs, real throughput, utilization, the crossover in tokens per month, and the hidden ops bill nobody budgets for.

Choosing a local coding LLM in 2026 means balancing benchmark performance, hardware cost, and the compliance pressure to keep code off third-party servers. Here is what to run and on what hardware.

Run Claude Code through your own gateway, Bedrock, Google Cloud or local GPUs. Five patterns with verified env vars, model IDs and what Anthropic supports.