AI INFRASTRUCTURE

19 articles

All TopicsAI InfrastructureNews Cloudflare Agents Hacker News LLM Developer Tools

LATEST

Ray CVE-2025-62593: Botnet Beat the Patch, CISA Gives Feds 3 Days

The RondoDox botnet started exploiting Ray CVE-2025-62593 two days before the CVE was public, and CISA gave federal agencies just three days to remediate. Here is how to check whether your Ray cluster or dev machine is exposed and what to harden first.

August 23, 2026•7 min read

Read Article

9 min read

The Quiet Tax on Your Cheap Agent Tier

Compression is the default answer to the agent bill, and a new three-model, eleven-method audit says the bill is the wrong place to look: quantized and pruned agents lose their head knowledge first, stay confidently wrong about what they lost, and hide subgroup preference flips behind flat bias scores. The same week, the serving side produced cost cuts that touch none of that. Our bet: cheapness comes from the cache before it comes from the weights.

Research Analysis AI Agents

6 min read

Cloudflare Billable Usage API: Programmatic Cost Visibility for Agent-Run Accounts

Cloudflare launched a single endpoint that returns account usage and cost per product in a FOCUS-aligned shape. For teams whose agents provision infrastructure, the dashboard is no longer the only way to see what a month costs.

News Cloudflare Billing

7 min read

@cloudflare/computer: an Agent Runtime That Treats a Container as a Tool, Not a Home

Cloudflare's Agents Week opens with @cloudflare/computer, an open-source agent runtime where an SQLite-backed workspace gives every agent a shared filesystem and lets the model pick between fast isolates and full Linux containers per task. The bet: containers for under 10% of agent work.

News Cloudflare Agents

7 min read

Cloudflare Runs Kimi and GLM at Scale: FP8 KV Caches, INT4 Weights, and a Cache Safety Net

Cloudflare published the serving playbook behind Workers AI running Moonshot Kimi K2.6 and Zhipu GLM 5.2: FP8 KV caches double Kimi's resident context to 1.37M tokens, INT4 weights shrink GLM 5.2's checkpoint 40%, and a page-tagging integrity check protects the shared cache at under 1% overhead. The numbers show what actually matters when open frontier models run on GPU fleets.

News Cloudflare Workers AI

6 min read

Workers Can Now Accept Inbound TCP and Serve gRPC: Cloudflare Closes the HTTP-Only Gap

Cloudflare announced inbound TCP connections and gRPC support for Workers and Containers as part of Agents Week: a connect() handler on Spectrum, full-duplex gRPC from Containers, and automatic gRPC to gRPC-web translation so Workers can serve gRPC APIs without a container. Private beta today.

News Cloudflare Workers

9 min read

The Underground Relay Market for AI API Tokens: How Resellers Get 97% Off

An inside look at the gray-market relay economy that resells OpenAI, Anthropic, and Google API access at up to 97.8% off -- and what it means for developers building on AI APIs.

News Hacker News AI Security

8 min read

Open-Weight AI's Kubernetes Moment: Why the Ecosystem Will Win

Tobi Knaup, co-founder of Mesosphere, argues that open-weight AI has reached the same inflection point as Kubernetes in 2014. We break down the argument, the HN reaction, and what it means for developers building on open models.

News Hacker News Open Weight AI

8 min read

Qualcomm Modular Acquisition: What It Means for AI Developers

Qualcomm is acquiring Modular for $3.9 billion. Here is what developers need to know about MAX, Mojo, CUDA alternatives, and the hardware-agnostic AI inference stack.

AI Infrastructure Modular Mojo

11 min read

Self-Hosted vs Managed AI Gateways: A Decision Guide

Self-host LiteLLM or Kong, or use a managed gateway like Portkey, OpenRouter, or Cloudflare AI Gateway? A factual breakdown of cost, control, and ops tradeoffs.

AI Infrastructure LLM Developer Tools

9 min read

Jamesob's Guide to Running SOTA LLMs Locally: The Hardware and Config That Actually Works

A detailed breakdown of jamesob's viral local LLM guide covering the $2k and $40k hardware paths, critical BIOS settings, and why most setups fail at PCIe negotiation and IOMMU.

News Hacker News Local LLM

7 min read

Cerebras Stock Is a Public Test of AI Inference Demand

Google Trends put CBRS stock on the board after Cerebras' first public-company earnings. The developer takeaway is not a trade. It is that AI inference demand is now being priced, questioned, and audited in public.

AI Infrastructure Cerebras Markets

9 min read

Sakana Fugu and the Case for Not Betting Everything on One Proprietary Model

Sakana Fugu makes a timely argument for model routing: frontier performance should come from swappable systems, not a hard dependency on one proprietary API.

model-routing ai-infrastructure ai-models

Showing 12 of 18 articles

Keep exploring AI Infrastructure

- AI Infrastructure Topic Hub - tools and guides for AI Infrastructure from the Developers Digest directory
- Tools Directory - dive deeper across the Developers Digest knowledge base
- Developers Digest on YouTube - video tutorials covering AI Infrastructure and more

Explore 921 topics

Browse All Topics

The Quiet Tax on Your Cheap Agent Tier

@cloudflare/computer: an Agent Runtime That Treats a Container as a Tool, Not a Home

Cloudflare Runs Kimi and GLM at Scale: FP8 KV Caches, INT4 Weights, and a Cache Safety Net

Workers Can Now Accept Inbound TCP and Serve gRPC: Cloudflare Closes the HTTP-Only Gap

AI INFRASTRUCTURE

Ray CVE-2025-62593: Botnet Beat the Patch, CISA Gives Feds 3 Days

Keep exploring AI Infrastructure

Get Smarter About AI Dev

AI INFRASTRUCTURE

Ray CVE-2025-62593: Botnet Beat the Patch, CISA Gives Feds 3 Days

Keep exploring AI Infrastructure

Get Smarter About AI Dev