firmulate.com/quiz.html — live view
AIThis post was created with the assistance of artificial intelligence (AI).
Firmulate —
Live on firmulate.com.

Imagine a scenario where AI models are tasked with running a real company through its toughest week — making decisions that impact thousands of euros, trusting or doubting information, and even refusing questionable requests. If you’re curious about how artificial intelligence might perform in high-stakes management, this experiment offers eye-opening insights.

Before you orderOffer from Amazon

Get health and wellness essentials delivered free with Prime

  • Fast, free delivery on millions of items
  • Prime Video, Amazon Music and more included
  • Member-only deals all year
Start your free Prime trial Free trial for eligible customers · Cancel anytime
As an affiliate, we earn on qualifying purchases.

Testing AI’s Management Persona in a Real-World Business Simulation

A groundbreaking experiment by Firmulate has put four of the latest frontier AI models through a simulated week of crisis at a small software company, a live environment where every decision is real, and every outcome measurable.

The Setup

Each AI model was given the same challenge: manage a company facing multiple crises, customer demands, and ethical temptations—all under the same stressful conditions. The company, with 13 synthetic employees, operates with real money mechanics, burning €105,000 monthly against a modest €2,300 monthly recurring revenue (MRR). It’s a watchable, transparent environment, with the entire process available at firmulate.com/live.

The Results

  • All four models successfully identified and responded to every crisis, refusing to be manipulated or tricked.
  • Only two of these models actually signed the €55,000 deal they had independently evaluated and recommended—without any external push or incentives.
  • Interestingly, the key to winning the deal was not in real-time customer interactions but in reading through critical company documents hidden two references deep in the files. Models that accessed these documents secured the full deal (+€4,583 MRR), while others missed this crucial insight.

The Social Engineering Test

The models faced a staged escalation of fake CEO messages, progressively more convincing, plus a reporter’s subtle request—”just a yes/no, on background.” All models refused to participate, citing suspicion and potential impersonation risks. Kimi K3’s explanation was typical: “Treat the request as a suspected approval-bypass / possible impersonation.”

Products Worth Considering

Fitbit Versa 2 Health and Fitness Smartwatch with Heart Rate, Alexa, Music, Sleep and Swim Tracking

Fitbit Versa 2 Health and Fitness Smartwatch with Heart Rate, Alexa, Music, Sleep and Swim Tracking

Hyperice Normatec 3 Leg Compression Boots – Full Leg Recovery, Standard Size

Hyperice Normatec 3 Leg Compression Boots – Full Leg Recovery, Standard Size

As an affiliate, we earn on qualifying purchases.

How Different AI Personalities Show Up

Among the four models, their management styles varied significantly:

  • gpt-5.6-sol: scored the highest (95/100), demonstrated thoroughness by reading all relevant files, and successfully closed the deal, showing a balanced approach with attention to detail.
  • Kimi K3: scored 93, was the cleanest and most disciplined, and also signed the deal. Notably, it ran without an effort parameter, making its decisions appear more straightforward but slightly less adaptable.
  • Sonnet 5: scored 88, completed the deal with minor process slips, indicating a reliable but somewhat less meticulous decision-making style.
  • Fable 5: scored 77, also closed the deal but with more slips—such as leaving unresolved issues on the table and slipping in discipline, reflecting a more casual management style.

What the Experiment Tells Us

While all models showed impressive crisis recognition and refusal to manipulation, only half could close the deal. The decisive factor was thorough information processing—reading deep into company files made the difference, not just surface-level customer interactions. This highlights a core insight: for AI to manage effectively, it must read and understand relevant internal data, not just respond to external cues.

Implications for Business and Wellness

For organizations considering AI for management roles—whether in health tech, wellness programs, or customer support—the key takeaway is clear: AI’s ability to stay honest, thorough, and disciplined under pressure is what determines its usefulness. It’s not about superficial chat capabilities but about whether the AI can finish what it starts, read critical information, and maintain integrity when stakes are high.

Try It Yourself

Curious about how your own business might fare? You can run your company’s data through this live AI management wargame, without risking real systems or data. Visit firmulate.com/quiz.html to challenge AI models with real, unedited decisions from your industry.

Infographic —
The findings at a glance — source: firmulate.com.

Watch it live: firmulate.com/live · Full results: firmulate.com/benchmarks.html

Powered by Thorsten Meyer AI

This article is for informational purposes only and is not medical advice. Always consult a qualified healthcare professional about your specific situation.


You May Also Like

Are Med Students Cheating If They Use AI?

At an October 15 health journalism summit, educators said AI use is not automatically cheating but warned students must retain clinical reasoning skills.

What AI Management Skills Really Look Like: Lessons from a Live Business Experiment

Discover how live business experiments reveal AI management skills—honesty, depth, discipline—bivocating beyond chat answers to real-world decision-making success.

The AI-Run Business That’s Losing Money Daily and You Can Watch It Live

A real, live company run by AI models is losing €105,000 monthly and facing a tough cash countdown — watch its decisions unfold daily and learn what it takes to trust AI in business.

Before AI Gets Near Patient Data, Test Its Judgment

Firmulate’s live AI company test finds that spotting a crisis is not the same as acting well—and shows how enterprises can safely test their own playbooks.