SELF-HOSTED

5 items

5 tools

ToolApr 23, 2026

High-throughput inference server for LLMs. PagedAttention memory management. The go-to for serious local or self-hosted serving.

inference server throughput self-hosted gpu pagedattention

ToolApr 9, 2026

Ollama

The easiest way to run LLMs locally. One command to pull and run any model. OpenAI-compatible API. 52M+ monthly downloads. Supports GGUF, Safetensors, and custom Modelfiles.

local-ai llm cli open-source self-hosted privacy

ToolApr 9, 2026

LocalAI

Open-source OpenAI API replacement. Runs LLMs, vision, voice, image, and video models on any hardware - no GPU required. 35+ backends. Distributed mode for scaling.

local-ai llm open-source self-hosted api-compatible multimodal

ToolMar 25, 2026

Llama

Meta's open-source model family. Llama 4 available in Scout (17B active) and Maverick (17B active, 128 experts). Free to use, modify, and deploy commercially.

ai model open-source meta self-hosted fine-tuning

Tool

Coolify

Self-hosted PaaS for deploying apps, databases, and services. Git-based deploys, Docker support, preview environments, and a clean UI.

infrastructure deployment paas docker self-hosted

Get Smarter About AI Dev

New tutorials, open-source projects, and deep dives on coding agents - delivered weekly.

One email per weekReal code, not theoryFree forever

Browse All Tags