Skip to main content

Posts

OX Alpha: Nobody Knew Who Made It, and Teams Still Put It in Production

A model called OX Alpha showed up on OpenRouter on August 20. No lab name. No announcement. No documentation beyond a spec sheet: 1,048,576-token context, text and image and video input, function calling, free to use until August 27. Within 24 hours, people were routing production traffic through it. The benchmark claim driving that adoption: 80% on DeepSWE Pass@1. For context, the numbers being passed around put Claude Fable at 65% and GPT-5.6 Sol at 52%. Those numbers came from a ten-task community test, not an audited leaderboard, but that didn't slow anyone down. I'm not here to litigate whether OX Alpha is actually better at coding. I'm more interested in what happened to people's due diligence. What "Stealth" Actually Means on OpenRouter OpenRouter runs a program where labs can preview models anonymously. The provider shows up as "Stealth," and the model name is whatever the lab chooses. The idea is straightforward: labs get real-world ev...
Recent posts

OSWorld 2.0 and the Finish-Line Problem in Long-Horizon Agent Evals

Agent demos are seductive. You prompt an agent to research a competitor, draft a brief, update a spreadsheet, and it does something plausible enough that everyone in the room nods. Then you ship it, and your users slowly stop trusting it, because it keeps getting 80% of the way through tasks and failing at the end in ways that are genuinely hard to diagnose. OSWorld 2.0, released in late June 2026 by the XLANG Research lab, is the benchmark that finally makes that failure mode measurable. The numbers are sobering: Claude Opus 4.8, the current leader, finishes just 20.6% of tasks end-to-end. GPT-5.5 plateaus at 13% regardless of whether you give it 150, 300, or 500 steps. What Makes OSWorld 2.0 Different The original OSWorld measured desktop computer-use on relatively short tasks. 2.0 extends it to 108 long-horizon workflows across seven professional domains: research, creative production, engineering, personal services, business and finance, administration and compliance, and healt...

Claude Now Watermarks Everything It Writes. Here's What That Means for Builders

On August 11, 2026, Anthropic quietly became the first frontier lab to watermark AI-generated text at production scale, worldwide, across every product. The EU AI Act's Article 50 became enforceable on August 2. Anthropic shipped nine days later. If you build with Claude, this already affects your outputs. Here's what actually changed and what you should do about it. Why This Happened Now Article 50 of the EU AI Act requires providers of generative AI to mark their outputs in machine-readable formats so that downstream users, regulators, and platforms can detect AI-generated content. It became law on August 2, 2026. The penalty for non-compliance isn't trivial. Anthropic didn't watermark just for EU users. The rollout is global: every API call, every Claude.ai session, Claude Code, and hosted instances on AWS, Google Cloud, and Microsoft Foundry. If your models were released after August 2, watermarking is on by default with no opt-out. Older Claude models get the s...

Muse Glimmer: Apache 2.0, 30B, and Why the EU AI Act Just Made Your Model License a First-Class Decision

Meta shipped Muse Glimmer on August 10, and the thing that matters most isn't the benchmark scores. It's the license. After more than a year of closed models, Meta put a 30B parameter agentic model on Hugging Face under Apache 2.0 with no strings attached. That decision landed two weeks after the EU AI Office gained actual enforcement teeth over general-purpose AI model providers. The timing isn't coincidental. What You're Actually Getting Muse Glimmer is a 30B model distilled from Muse Spark. The distillation kept the agentic capabilities, the multi-step reasoning, and the function-calling quality while cutting the parameter count to something you can deploy locally without a data center. At full precision, 30B needs north of 55 GB of memory. In 4-bit K-Quant, the footprint drops to 17-20 GB. A single RTX 4090 or RTX 3090 (both 24 GB) handles it with room left for the KV cache. On a Mac with an M4 Max or M5 Max you have even more headroom. Meta built DFlash specul...

SWE-Bench Pro Is 30% Broken. Here's What That Means for Your Team.

For most of this year, if you asked me how to compare coding agents, I'd have pointed you at SWE-bench. The safer answer now is: don't. SWE-bench Verified died in February. OpenAI audited it and found frontier models could reproduce the original human-written patches verbatim, which meant scores reflected training contamination, not capability. They pulled their own numbers from Verified and recommended SWE-bench Pro instead. Then in July, OpenAI audited Pro and found roughly 30% of the 731 tasks are broken. Not "hard." Not "noisy." Broken. Their automated pipeline flagged 200 tasks (27.4%). Human reviewers tagged 249 (34.1%). OpenAI retracted their Pro recommendation and called on the broader evaluation community to start over. So the fallback for the fallback is gone. And models are still shipping press releases citing SWE-bench scores. How We Got Here SWE-bench Verified made sense when it launched. Real GitHub issues, real test suites, tasks that...

MiniMax H3 Collapses the Video Pipeline. One Pass, Audio Included.

MiniMax shipped H3 (also branded Hailuo 3.0) on July 31, 2026, and the open weights landed on August 5. It's an omni-modal video model: one transformer that takes text, images, existing video, and audio as inputs and returns a synchronized 2K video clip with native stereo audio, all in a single generation pass. That last part is what's actually interesting. What Omni-Modal Means in Practice Most video generation pipelines I've seen people build have at least two stages. You generate the video clip. Then you add audio separately, either with a different model, a music library, or a post-processing step. That's workable for silent B-roll or concept visualization. But once you want something closer to a finished video segment, audio-video sync becomes a problem you have to solve explicitly. H3 sidesteps this by treating audio as a first-class output, not an afterthought. You can pass in a reference audio clip, a voice note, ambient sound, or nothing at all. The model g...

Per-Token Costs Dropped 1,000x. Your AI Bill Didn't.

Per-token costs for running frontier-class AI dropped roughly 1,000x in three years. GPT-4 class inference was around $30 per million tokens in early 2023. You can run equivalent-quality models for under $0.07 per million today. NVIDIA's Blackwell B200 cuts it further, to as low as $0.02 per million on large models with a properly optimized stack. The trajectory is obvious. So why are enterprise AI bills climbing? This is the Jevons Paradox applied to inference. In 1865, William Stanley Jevons observed that more efficient steam engines didn't reduce total coal consumption, they increased it, because efficiency made coal-burning economical for applications that were previously too expensive to run. Efficiency didn't shrink demand. It expanded it faster than the efficiency gain shrank per-unit cost. The same dynamic is playing out in AI right now. What Actually Happened When Tokens Got Cheap When a chatbot turn cost $0.30, you kept interactions short. When that same turn...