SELF-HOSTED
9 items
2 posts, 7 tools
Talorys deploys a personal AI agent to your own Cloudflare account with one npx command. How far 10,000 free daily Neurons go and where "self-hosted" breaks.
OpenCode server on Railway: run opencode serve in a container as a password-protected HTTP API with a persistent volume, reachable from any machine or webhook.
Open-source LLM engineering platform: tracing, evals, prompt management, and datasets. Self-hostable, OpenTelemetry-native, with 50+ framework integrations.
Workflow automation platform for technical teams, with native AI agent building. Visual editor plus JavaScript/Python code nodes, 500+ integrations, self-hostable under a fair-code license.
High-throughput inference server for LLMs. PagedAttention memory management. The go-to for serious local or self-hosted serving.
The easiest way to run LLMs locally. One command to pull and run any model. OpenAI-compatible API. 52M+ monthly downloads. Supports GGUF, Safetensors, and custom Modelfiles.
Open-source OpenAI API replacement. Runs LLMs, vision, voice, image, and video models on any hardware, no GPU required. 60+ backends. Distributed mode for scaling.
Meta's open-weight model family. Llama 4, released April 5, 2025, comes in Scout (109B total, 17B active) and Maverick (400B total, 17B active). Commercial use under the Llama license.
Self-hosted PaaS for deploying apps, databases, and services. Git-based deploys, Docker support, preview environments, and a clean UI.

Get Smarter About AI Dev
New tutorials, open-source projects, and deep dives on coding agents - delivered weekly.