Firmulate’s AI company experiment found models could spot crises yet leave a hard-won deal unsigned. Enterprises can test models against their own business.
The AI Passed the Test—Then Left the Deal Unsigned
Browsing Category
Color Science & Theory
73 posts
The AI Model League Just Got More Competitive
Kimi K3 placed second in Firmulate’s company-running test, ahead of three Western frontier models. The results make a case for testing AI on real work.
Why the Worst AI Manager Still Scores 26: Inside a Benchmark That Refuses to Grade From Zero
A do-nothing AI manager scores 26, not 0, in Firmulate’s Crucible League — and one breach of trust caps everything. Here’s the scoring logic.
The Most Diligent AI in the Room Still Failed to Close
Opus 4.8 produced the deepest analyses and learned more than 80 rules, yet finished last—a warning that diligence alone does not deliver impact.
The €55,000 Detail That Separated AI Agents From Chatbots
A buried competitor detail decided a €55,000 AI sales test, showing that file-reading discipline can matter more than fluent answers in practice.
The Next Great AI Test Is the Week Everything Goes Wrong
Coding benchmarks can crown a brilliant agent. Firmulate asks the boardroom question: will it finish the job, resist pressure and tell the truth?
The AI Boss Test: Who Spots the Crisis—and Who Closes the Deal?
Can you spot an AI manager by its decisions? Firmulate’s live wargame reveals distinct habits under pressure—and who actually closes the deal.
When the Boss Demands a Shortcut, Will an AI Hold the Line?
Five frontier AI models faced fake-CEO pressure and a reporter trick. Every one refused, showing integrity can be tested before deployment.
Mario Meets Pareto
Mario’s latest crossover introduces Pareto principles into gaming, sparking discussions on economic models and game design.
Transform Your Home Into A STEM Playground Inspired By San Francisco’s Exploratorium
Discover how the Exploratorium in San Francisco is inspiring new ways for families to transform their homes into STEM learning spaces.
