Skip to main content
Watch: Grok Bot Built My AI Video Arena While I Tested 8 Models

SELF-HOSTED

9 items

2 posts, 7 tools

Blog
Talorys: A Free Personal AI Agent on Cloudflare, and What 10,000 Neurons Buys

Talorys deploys a personal AI agent to your own Cloudflare account with one npx command. How far 10,000 free daily Neurons go and where "self-hosted" breaks.

Blog
Run Your Coding Agent as an API: OpenCode Server on Railway

OpenCode server on Railway: run opencode serve in a container as a password-protected HTTP API with a persistent volume, reachable from any machine or webhook.

Tool
Langfuse

Open-source LLM engineering platform: tracing, evals, prompt management, and datasets. Self-hostable, OpenTelemetry-native, with 50+ framework integrations.

Tool
n8n

Workflow automation platform for technical teams, with native AI agent building. Visual editor plus JavaScript/Python code nodes, 500+ integrations, self-hostable under a fair-code license.

Tool
vLLM

High-throughput inference server for LLMs. PagedAttention memory management. The go-to for serious local or self-hosted serving.

Tool
Ollama

The easiest way to run LLMs locally. One command to pull and run any model. OpenAI-compatible API. 52M+ monthly downloads. Supports GGUF, Safetensors, and custom Modelfiles.

Tool
LocalAI

Open-source OpenAI API replacement. Runs LLMs, vision, voice, image, and video models on any hardware, no GPU required. 60+ backends. Distributed mode for scaling.

Tool
Llama

Meta's open-weight model family. Llama 4, released April 5, 2025, comes in Scout (109B total, 17B active) and Maverick (400B total, 17B active). Commercial use under the Llama license.

Tool
Coolify

Self-hosted PaaS for deploying apps, databases, and services. Git-based deploys, Docker support, preview environments, and a clean UI.

AI Development Stack

Get Smarter About AI Dev

New tutorials, open-source projects, and deep dives on coding agents - delivered weekly.

One email per weekReal code, not theoryFree forever