TLDR Data 2026-07-06
Better Models, Worse Tools β οΈ, Aerospike at Scale π‘οΈ, Zero-Shot Forecasting Matures π
Meta's AI Storage Blueprint at Scale (8 minute read)
Meta shares its AI Storage Blueprint, the internal architecture and lessons learned from running massive-scale AI storage infrastructure. Key designs include a multi-tier storage hierarchy, intelligent data placement and replication strategies, sophisticated caching layers, erasure coding for efficiency and durability, and high-performance networking optimizations.
Migrating Counter Service storage: Design choices and learnings (11 minute read)
Grab migrated its high-QPS fraud Counter Service from a wide-column database to Aerospike NoSQL database with zero downtime using storage facades, shadow reads/writes, deterministic traffic splitting, and config-driven rollback. The team replaced row-per-bucket storage with per-counter ordered maps, cutting record cardinality and disk usage. Both production p99 read latency and per-node costs improved by ~50%.
Time-Series LLMs, Explained with t0-alpha (13 minute read)
t0-alpha is a 102M-parameter, open-weights probabilistic time-series forecaster that patches 32-step windows, uses a causal transformer, and predicts quantiles. It beats every classical baseline and lost to Seasonal Naive on only 1 of 97 task configurations. Strong zero-shot forecasting is here, but production value likely comes from calibrated probabilistic outputs, stricter leakage controls, stronger tuned baselines, and routing/ensembling rather than more transformer tweaks.
Better Models: Worse Tools (12 minute read)
Newer Anthropic models may solve the task correctly but fail stricter tool schemas by adding invalid fields, likely because they're overfit to Claude Code's forgiving tool format. Agent harnesses need stricter schema validation or constrained tool calls.
Vercel Took a 10-Person SDR Team Down to 1. The Whole Thing Costs $5,000 a Year (8 minute read)
Vercel automated lead qualification from a 10-person SDR function to roughly 1.25 people, claiming 32x ROI. Its GTM engineering model pairs an engineer, data scientist, and domain expert to document best-practice workflows, run shadow-mode QA, and gradually remove humans from deterministic tasks. Success depends on composable APIs/MCP/webhooks, a clean semantic layer, and infrastructure that can handle 100xβ1,000x production-scale agent workloads without cost blowups.
The context engineering playbook (8 minute read)
Context engineering is the next analytics engineering: structuring company knowledge so agents can answer natural-language questions reliably. The biggest reliability gains come from clean data models and documentation, taking one agent from 40% to 90% accuracy, while query logs and profiling add limited value. Start with 10β20 high-value tables, test in CI/CD, manage context like a Git repo/markdown-backed source of truth, and add governance for permissions, evals, and token budgets.
Comparing the Best Open Source Vector databases (9 minute read)
Redis compared leading open-source vector databases (Redis, Weaviate, Qdrant, Milvus, Chroma, and LanceDB) based on real benchmarks and production characteristics, with Redis standing out for ultra-low latency and high QPS on hybrid search and filtering workloads, Qdrant and Weaviate excelling in rich metadata filtering and developer experience, and Milvus leading in massive scale.
StreamFusion (GitHub Repo)
StreamFusion is an OSS Flink SQL accelerator that transparently swaps supported streaming operators for native Rust/Apache Arrow/DataFusion execution over JNI while leaving Flink responsible for planning, coordination, and fallback. It targets full columnar βislandsβ across projection, filters, windowed aggregates, joins, changelog operations, Kafka/file connectors, and scalar UDFs called back into the JVM, with byte-identical parity as the default.
Claude Science, an AI Workbench for Scientists, Is Now Available (7 minute read)
Claude Science AI Workbench is a new tool designed to help scientists and researchers accelerate discovery. The workbench supports literature review, hypothesis generation, data analysis, experiment design, and code writing, aiming to make AI a true collaborative partner in the scientific process rather than just a general assistant.
How an AI Token Travels Through a Data Center (19 minute read)
Inference has become the dominant AI cost center: it now consumes roughly two-thirds of AI compute and 80β90% of lifetime model cost. The economics hinge on cost per token at target latency, with prefill being compute-bound and decode memory-bandwidth-bound, making KV cache management, batching, quantization, and speculative decoding the main levers. Durable advantage sits in physical bottlenecks: HBM bandwidth, NVLink/scale-up fabric, optics, and power.
Variance Reduction Below the Randomization Grain (8 minute read)
Instacart explores advanced variance reduction techniques for A/B testing and causal inference that operate below the randomization grain (at the individual user or session level rather than aggregate), leveraging methods such as CUPED, stratification, and other statistical techniques to significantly reduce experiment variance, enabling more precise measurements and the ability to detect smaller effects.
Bridging the Gap: Blending Structured Data Auditing with Unstructured Policy Intelligence (4 minute read)
You can automate compliance and risk audits by combining unstructured policy documents with structured warehouse or database data in a single agentic workflow. The system ingests OWL/FIBO ontology mappings, parses regulatory PDFs into Markdown, and uses LLM-Wiki plus Text2SQL to plan, query, analyze, and self-correct until confidence reaches at least 80/100.
GitBiased (Tool)
GitBiased gives engineering teams a customizable dashboard for GitHub activity, bringing PRs, CI checks, issues, DORA metrics, deployments, and weekly summaries into one shared view.
Norwegian public-data MCP servers (Tool)
Allemannsdata provides 23 no-key MCP servers wrapping Norway's open public data, covering transport, weather, energy, law, statistics, registries, health, nature, and more.
Curated deep dives, tools and trends in big data, data science and data engineering π
Join 570,000 readers for
one daily email