Older Posts — Page 11 of 18
Agent context: short-term vs long-term memory
Compare Redis-style short-term agent context with Postgres event logs: latency, durability, auditability, cost, and how to measure each.
15 min read · 9 July 2026
Observability for LLM Features: Metrics That Drive Decisions
Log one structured event per LLM interaction instead of tracing every token, then alert only on user-facing outcomes that justify keeping a feature.
14 min read · 8 July 2026
7 ways to measure prompt platform ROI in 2026
How to attribute token cost, latency and developer time to prompt and agent platforms, with instrumentation recipes, failure modes and a decision checklist.
14 min read · 8 July 2026
AI in local currency: costs that surprise…
How to choose where to run AI inference: decouple variable compute cost from fixed per-region compliance cost, and measure the trade-off.
15 min read · 7 July 2026
AI feature drift: why your model died at midnight
Diagnose nightly AI model drift and FeatureStoreKeyNotFound errors: tokenizer drift, memory fragmentation, and cold-start timeouts, with fixes.
14 min read · 7 July 2026
Audit logs: ship them fast, keep them forever
Design an audit log pipeline that separates durability from searchability, with tiered retention, integrity hashing, and a cost model you can verify.
14 min read · 6 July 2026
Build agent workflows that survive restarts
How to build agent task pipelines that resume after crashes, schema drift and model changes, using Redis streams, idempotent steps and replay.
12 min read · 6 July 2026
LLMOps 2026: evaluation stack that replaced RAG dashboards
Why RAG dashboards miss real failures, and how to build an evaluation stack around task resolution, dataset rotation, prompt versioning, and drift checks.
13 min read · 5 July 2026
7 skills senior engineers need now agents are live
Long-running agents break assumptions built for short-lived processes. Seven skills, how to measure each one, and failure modes to watch for.
15 min read · 5 July 2026
AI in slow networks: why models flop where data costs rise
How to cut payload size, round-trips and cost for AI features on 2G/3G networks, with a worked ASR example, failure modes and a measurement checklist.
14 min read · 5 July 2026
Always-On vs On-Demand Agents: Real Cost Trade-offs
Always-on containers bill for idle time; on-demand functions bill per invocation. Compare latency, retries, cold starts, and the failure modes that decide which fits.
12 min read · 5 July 2026
LLM drift: the silent quality drop metrics miss
Latency and error rate stay flat while LLM output quality quietly degrades. Here is how to log prompts, measure embedding drift, and catch it early.
11 min read · 4 July 2026
Audit trails: ImmutableDB vs DynamoDB Streams
Compare append-only hash-chained logs with DynamoDB Streams for audit trails: replay, tamper evidence, cost model, and a decision checklist.
15 min read · 4 July 2026
Detect lazy agents without false alarms
Success/fail gates miss agents that keep running while producing harmful output. Measure outcomes instead, with a worked predictor design and decision rules.
14 min read · 4 July 2026
AI model poisoning: 3 real attacks on datasets
How data, model, and dependency poisoning enter AI pipelines, plus concrete controls for provenance, review, sandboxing, and rollback.
15 min read · 4 July 2026
AI made self-service platforms trivial in 2026
AI can draft Terraform and Kubernetes manifests, but correctness still needs policy checks, schema validation, and runtime verification before merge.
10 min read · 3 July 2026
Agent Governance: OPA vs Kyverno in Kubernetes
Compare OPA and Kyverno for agent governance in Kubernetes: policy language, latency, audit trails, and a decision checklist.
11 min read · 3 July 2026
Evaluate agents with Spark vs custom harness
A practical comparison of Spark-based and custom Python agent evaluation harnesses, with failure modes, cost arithmetic, and a decision checklist.
12 min read · 3 July 2026
AI agents: circuit breakers are not optional
AI agents fail by hanging and returning plausible garbage, not by crashing. Here is how to add a circuit breaker that catches semantic failures.
13 min read · 3 July 2026
AI Code Generation: Failure Modes and Guardrails
AI code assistants change interfaces, concurrency and state in ways that pass review. Here are the failure modes and the checks that catch them.
11 min read · 3 July 2026
CI/CD for Django in 20ms Africa networks
Design a Django CI/CD pipeline for 1-2 vCPU runners, slow links and metered egress: caching, image size, migrations and health checks.
13 min read · 3 July 2026
High-Volume Log Pipelines: Shipping 50k Events Per Second
Compare a columnar-SQL log pipeline against a search-cluster pipeline at 50k EPS: architecture, failure modes, cost drivers, and how to measure both.
11 min read · 3 July 2026
Big model API vs fine-tune: the 2026 math
A practical framework for deciding between prompting a large model API and fine-tuning a small model, with instrumentation, failure modes and cost math.
15 min read · 3 July 2026
JSON mode's hidden costs revealed
LLM JSON mode guarantees syntax, not usable data. A two-stage extraction-plus-correction pipeline makes parsing reliable and cheap without fine-tuning.
12 min read · 3 July 2026