Bloomberg Technology

AI Stress Tester: Models Have Crossed a ‘Threshold of Competency’

After AI models from OpenAI, Anthropic and others broke out of controlled tests and accessed real-world systems, new questions were raised about how they should be assessed before deployment. Those evaluations were run with Irregular, a startup hired to stress-test advanced AI models. But the sandboxed environment had a critical flaw: a misconfiguration meant the…

Published

on

After AI models from OpenAI, Anthropic and others broke out of controlled tests and accessed real-world systems, new questions were raised about how they should be assessed before deployment. Those evaluations were run with Irregular, a startup hired to stress-test advanced AI models. But the sandboxed environment had a critical flaw: a misconfiguration meant the models could access the open internet. Dan Lahav, CEO of Irregular, explains how a human error left one testing environment connected to the internet, and what the industry is changing to make safety evaluations more secure. He joins Ed Ludlow on “Bloomberg Tech.”
——–
Like this video? Subscribe to Bloomberg Technology on YouTube:

 
Watch the latest full episodes of “Bloomberg Technology” with Caroline Hyde and Ed Ludlow here:

 
Get the latest in tech from Silicon Valley and around the world here:

Connect with us on…
X:
Facebook:
Instagram:
 
Follow Ed Ludlow on X here:
Follow Caroline Hyde on X here:
 
Listen to the daily Bloomberg Technology podcast here:

 
More from Bloomberg Business
Connect with us on…
X:
Facebook:
Instagram:
LinkedIn:
TikTok:

9 Comments

  1. @matt.stevick

    August 18, 2026 at 3:09 pm

    break everything! 🟩⬛️

    • @UnexpectedBooks

      August 18, 2026 at 3:23 pm

      They should be paid for each bug they find!

  2. @zacharyrichard2764

    August 18, 2026 at 3:27 pm

    Fracture ai

  3. @linkbrockman1010

    August 18, 2026 at 3:52 pm

    They are years into this and there’s no ROI…they need to do something with it quick….there’s no business integration at any measure at all …no ROI …..

    • @Jnr-x97

      August 18, 2026 at 4:06 pm

      Sure pal sure.

  4. @Jnr-x97

    August 18, 2026 at 4:08 pm

    What about when the journalist hacks your laptop and hacks your phone for sensitive information.

  5. @287iurisdogtor

    August 18, 2026 at 5:57 pm

    Bro needs a shower.

  6. @DaphneWinstead

    August 18, 2026 at 7:12 pm

    Keep shining

  7. @jordanslingluff287

    August 18, 2026 at 8:45 pm

    Competency of what? This is the biggest load of crap. This is just desperation by a couple of companies that are running out of money to piss away.

Leave a Reply

Your email address will not be published. Required fields are marked *

Trending

Exit mobile version