Skip to main content
Watch: Grok Bot Built My AI Video Arena While I Tested 8 Models

LLM

33 items

26 posts, 7 tools

Blog
Agent Memory Architectures Explained: 5 Layers and How Each Framework Builds Them

Agent memory is five layers: history, compaction, semantic recall, working memory and files. How Mastra, LangGraph, OpenAI and Claude implement each.

Blog
ACE vs ALTK-Evolve: How You Deliver Agent Memory Determines the Token Bill

ACE vs ALTK-Evolve for agent memory: both turn trajectories into lessons, but calibrated delivery matches accuracy on AppWorld at a fraction of the tokens.

Blog
DCAS: Why Fine-Tuned Coding Agents Fall Apart When You Switch Scaffolds

Fine-tuned coding agents collapse when you switch scaffolds, from 52.6% to 8.4% on SWE-bench Verified. DCAS shows how to train planning into the model.

Blog
OpenJDK Bans AI-Generated Code: What the New Policy Means for Java Contributors

OpenJDK's interim AI policy bans code generated in full or in part by LLMs. What it still allows, how it is enforced, and what it means for Java contributors.

Blog
SkillSV: A Shapley Framework That Values the Lines Inside an Agent Skill

SkillSV is a Shapley framework that values the rules, examples and scripts inside an agent skill, cutting skills to 69% of tokens without significant loss.

Blog
SIGIL Compiles Agent Skills into Harnesses: Prose Runs Skip 44% of Mandated Steps

SIGIL compiles prose SKILL.md files into typed agent harnesses. Prose runs execute 56% of mandated steps; compiled harnesses reach 86% with 0.58x the tokens.

Blog
The Underground Relay Market for AI API Tokens: How Resellers Get 97% Off

AI API token relays resell OpenAI, Anthropic, and Google access at up to 97.8% off. How the gray market works and what it means for developers on AI APIs.

Blog
Debian Debates LLM Usage: Four Proposals, One Fork in the Road

Debian LLM policy debate: four proposals on AI-generated contributions, from an outright ban to full acceptance, and the fault lines in the HN discussion.

Blog
Running Gemma 4 26B at 5 Tokens/Sec on a 13-Year-Old Xeon With No GPU

Gemma 4 26B on a 2013 Xeon with no GPU: how a sub-$300 box reached about 5 tokens/sec, the silent MoE bug behind the gibberish, and the upstream fix.

Blog
Mesh LLM: Run 235B Models Across Your Home Lab with iroh

Mesh LLM pools GPUs across home lab machines behind one OpenAI-compatible API, splitting 235B models over iroh and QUIC with no RDMA or NVLink required.

Blog
Self-Hosted vs Managed AI Gateways: A Decision Guide

Self-host LiteLLM or Kong, or use a managed gateway like Portkey, OpenRouter, or Cloudflare AI Gateway? A factual breakdown of cost, control, and ops tradeoffs.

Blog
Program-as-Weights Turns Prompts Into Local Fuzzy Functions

Program-as-Weights compiles prompts into compact local adapters that act as fuzzy functions. What the paper claims and where developers could use it first.

Tool
Langfuse

Open-source LLM engineering platform: tracing, evals, prompt management, and datasets. Self-hostable, OpenTelemetry-native, with 50+ framework integrations.

Blog
The One-Cent Attack: Prompt Injection Through Bank Transfer Memos

Prompt injection through a bank transfer memo: how a €0.02 transfer compromised a banking AI assistant, and the five defense layers agent builders need.

Blog
Mastra: Review and Setup Guide for TypeScript Agent Apps (2026)

Mastra review and setup for TypeScript AI agents - verified create commands, Mastra Studio, workflows and memory, plus pricing and who should skip it.

Blog
OpenRouter in 2026: Review, Setup, and When Model Routing Pays

OpenRouter review and setup - one API key for 300+ models with fallbacks and provider routing, what it costs, and when to go direct to a provider instead.

Blog
LLM Routers Compared: LiteLLM vs Portkey vs OpenRouter in 2026

LiteLLM vs Portkey vs OpenRouter compared for production AI apps: cost tracking, fallbacks, caching, and load balancing, plus when to use each router.

Blog
KV Caching: A Practical Guide to Optimizing Transformer Inference

How KV caching speeds up LLM inference - the math, the code, the memory tradeoffs, and when it stops helping. Every dev running local models hits this wall.

Blog
Mercury 2 Developer Guide: Building With a Diffusion LLM in Production

Mercury 2 developer guide: the OpenAI-compatible API, tool use, structured outputs, reasoning levels, and when a diffusion LLM beats an autoregressive one.

Blog
Promptlock: Deterministic Prompt Versioning for LLM Apps

Promptlock gives every prompt a 12-char content-addressable id and a diff-able artifact, turning silent prompt drift into a reviewable change.

Page 1 of 2Next
AI Development Stack

Get Smarter About AI Dev

New tutorials, open-source projects, and deep dives on coding agents - delivered weekly.

One email per weekReal code, not theoryFree forever