SELF-HOSTING

Mistral Large 4 weights are on Hugging Face under a modified MIT license. What the license blocks, the vLLM command, and when self-hosting beats the API.

Buzz is Block's open-source, agent-native messaging layer on Nostr: agents get cryptographic identities, every message is a signed event, and you run the relay.

A fair comparison of vLLM, TGI, SGLang, TensorRT-LLM, llama.cpp, and LMDeploy for self-hosted LLM inference - batching, quantization, hardware, and ops.

jamesob's local LLM guide: the $2k and $40k hardware paths, the BIOS and kernel settings that matter, and why multi-GPU setups fail at PCIe and IOMMU.

Local Qwen vs Claude Opus: Alex Ellis on running local LLMs in production, a 2-3 month hardware payback, and why local models are specialists, not substitutes.

Cohere North Mini Code: a 30B open-weight MoE coding model with 3B active parameters and Apache 2.0 weights. What it offers, where it runs and open questions.

Self-hosting open-weights models like GLM-5.2, DeepSeek V4 or Llama: the break-even math against per-token API prices, with GPU costs and the hidden ops bill.

Best local coding LLMs in 2026: which models to run on what hardware, how they benchmark, owned hardware versus cloud API costs, and setups by team size.

Run Claude Code through your own gateway, Bedrock, Google Cloud or local GPUs. Five patterns with verified env vars, model IDs and what Anthropic supports.