Connect with us

Science & Technology

The leaderboard ‘you can’t game,’ funded by the companies it ranks | Equity Podcast

Artificial intelligence models are multiplying fast, and competition is stiff. With so many players crowding the space, which one will be the best — and who decides that? Arena, formerly LM Arena, has emerged as the de facto public leaderboard for frontier LLMs, influencing funding, launches, and PR cycles. In just seven months, the startup went from a UC Berkeley PhD research…

Published

on

Artificial intelligence models are multiplying fast, and competition is stiff. With so many players crowding the space, which one will be the best — and who decides that? Arena, formerly LM Arena, has emerged as the de facto public leaderboard for frontier LLMs, influencing funding, launches, and PR cycles. In just seven months, the startup went from a UC Berkeley PhD research project to being valued at $1.7 billion. 

Watch as Equity host Rebecca Bellan catches up with Arena co-founders Anastasios Angelopoulos and Wei-Lin Chiang about how their platform became the go-to leaderboard for frontier AI models, and how they’re trying to build a neutral benchmark even as companies like OpenAI, Google, and Anthropic back the project.

Subscribe to Equity on YouTube, Apple Podcasts, Overcast, Spotify and all the casts. You also can follow Equity on X and Threads, at @EquityPod.

Chapters:

00:00 Intro

03:00 How Arena’s leaderboard works, and why it’s different from static benchmarks

07:00 Reproducibility concerns and how to scale

08:45 Can Arena stay independent while taking money from the labs it ranks?

11:15 Diversity, fraud prevention, and abuse mitigation

18:15 Arena’s “data moat”

19:20 Agent benchmarking and expert leaderboards

21:40 Open sourcing data

22:45 How do Arena’s rankings shape AI development?

24:15 Outro

Continue Reading
Advertisement
Click to comment

Leave a Reply

Your email address will not be published. Required fields are marked *

CNET

Getting Bridget’s REAL age?!

Bridget brings us along to test Apple’s updated Health app tools in iOS 27.2, which includes a series of tests to measure your health against your actual age. Watch the full ep on our channel. #onemorething #applehealth #applewatch #healthtech #smartwatch Host: Bridget Carey Editor: Carly Marsh

Published

on

Bridget brings us along to test Apple’s updated Health app tools in iOS 27.2, which includes a series of tests to measure your health against your actual age. Watch the full ep on our channel. #onemorething #applehealth #applewatch #healthtech #smartwatch

Host: Bridget Carey
Editor: Carly Marsh

Continue Reading

CNET

I Rode in a Self-Driving Semi. Is Kodiak the Future of Trucking?

Kodiak is gearing up to deploy its fully driverless semi trucks on highways later this year, starting with Ikea. I took a ride to see the autonomous tech in action. Read more about Kodiak on CNET.com Ready for Driverless Trucks? I Took a Ride in Kodiak’s Autonomous Semi Timecode Chapters: 0:00 Intro 0:33 Kodiak AI…

Published

on

Kodiak is gearing up to deploy its fully driverless semi trucks on highways later this year, starting with Ikea. I took a ride to see the autonomous tech in action.

Read more about Kodiak on CNET.com
Ready for Driverless Trucks? I Took a Ride in Kodiak’s Autonomous Semi

Timecode Chapters:
0:00 Intro
0:33 Kodiak AI
1:22 Ride along
3:00 Interview Kodiak COO
3:30 Sensor pod
3:45 GigaFusionNet
5:18 Conclusion

Video Credits:
Host: Abrar Al-Heeti
Scripted by: Abrar Al-Heeti
Producer: Celso Bulgatti
Camera: Celso Bulgatti
Video Editor: Celso Bulgatti
Thumbnail Designer: Zooey Liao

Add CNET as a trusted news source
Never miss a deal again! See CNET’s browser extension 👉
Check out CNET’s Amazon Storefront:
Subscribe to CNET on YouTube:
Follow us on TikTok:
Follow us on Instagram:
Follow us on Bluesky:
Like us on Facebook:
CNET’s AI Atlas:
Follow us on X:
Visit CNET.com:

#selfdriving #kodiak #semi #semitruck #autonomousdriving #autonomousvehicles

Continue Reading

CNET

Humanoid Robots Are Performing Surgery Now

We visited UCSD’s Center for the Future of Surgery to learn about the first ever live surgery using humanoid robots. Read more about robotic surgery on CNET.com Hands-On With First Humanoid Robot Surgeon Timecode Chapters: 0:00 Introduction: Humanoid Robots in Surgery 0:35 The Need for Remote & Robotic Surgery 0:59 Challenges of Adapting Humanoid Robots…

Published

on

We visited UCSD’s Center for the Future of Surgery to learn about the first ever live surgery using humanoid robots.

Read more about robotic surgery on CNET.com
Hands-On With First Humanoid Robot Surgeon

Timecode Chapters:
0:00 Introduction: Humanoid Robots in Surgery
0:35 The Need for Remote & Robotic Surgery
0:59 Challenges of Adapting Humanoid Robots
1:21 Testing the Teleoperation Setup
2:18 Why Live Animal Surgeries Are Necessary
3:00 Performance & Thermal Management Issues
3:32 Potential for AI Autonomy in Surgery
3:59 Key Challenges & Future Outlook

Video Credits:
Host: Jesse Orrall
Scripted by: Jesse Orrall
Producer: Jesse Orrall, Jon Gomez, Owen Poole
Camera: Owen Poole
Video Editor: Jon Gomez, Owen Poole
Thumbnail Designer: Zooey Liao

Add CNET as a trusted news source
Never miss a deal again! See CNET’s browser extension 👉
Check out CNET’s Amazon Storefront:
Subscribe to CNET on YouTube:
Follow us on TikTok:
Follow us on Instagram:
Follow us on Bluesky:
Like us on Facebook:
CNET’s AI Atlas:
Follow us on X:
Visit CNET.com:

#robot #robotics #medical #medicine #surgery #doctor #doctors

Continue Reading

Trending