Stripe launches Stripe evals for coding agents

stripe.dev13 min read

Stripe has built Stripe evals to measure how coding agents perform on realistic payment, subscription, and marketplace integration scenarios. The evaluation framework tested 14 model and harness pairs across 69 scenarios, finding that coding agents frequently bias toward older APIs and struggle with the last mile of complex integrations. Testing showed that providing a Stripe agent plugin significantly improved agent scores and reduced reliance on web searches. Open article →