Connect with us

Science & Technology

The leaderboard ‘you can’t game,’ funded by the companies it ranks | Equity Podcast

Artificial intelligence models are multiplying fast, and competition is stiff. With so many players crowding the space, which one will be the best — and who decides that? Arena, formerly LM Arena, has emerged as the de facto public leaderboard for frontier LLMs, influencing funding, launches, and PR cycles. In just seven months, the startup went from a UC Berkeley PhD research…

Published

on

Artificial intelligence models are multiplying fast, and competition is stiff. With so many players crowding the space, which one will be the best — and who decides that? Arena, formerly LM Arena, has emerged as the de facto public leaderboard for frontier LLMs, influencing funding, launches, and PR cycles. In just seven months, the startup went from a UC Berkeley PhD research project to being valued at $1.7 billion. 

Watch as Equity host Rebecca Bellan catches up with Arena co-founders Anastasios Angelopoulos and Wei-Lin Chiang about how their platform became the go-to leaderboard for frontier AI models, and how they’re trying to build a neutral benchmark even as companies like OpenAI, Google, and Anthropic back the project.

Subscribe to Equity on YouTube, Apple Podcasts, Overcast, Spotify and all the casts. You also can follow Equity on X and Threads, at @EquityPod.

Chapters:

00:00 Intro

03:00 How Arena’s leaderboard works, and why it’s different from static benchmarks

07:00 Reproducibility concerns and how to scale

08:45 Can Arena stay independent while taking money from the labs it ranks?

11:15 Diversity, fraud prevention, and abuse mitigation

18:15 Arena’s “data moat”

19:20 Agent benchmarking and expert leaderboards

21:40 Open sourcing data

22:45 How do Arena’s rankings shape AI development?

24:15 Outro

Continue Reading
Advertisement
Click to comment

Leave a Reply

Your email address will not be published. Required fields are marked *

CNET

Apple Brings M6 Updates to MacBook Pro and iMac Lines

Mostly same same, but a little bit different. 💻🖥️ On the heels of Apple’s new iPad Mini, Apple has turned its attention to its Mac lineup. Unlike the iPad Mini that received an OLED display and a water-resistant design, today’s Mac updates are mere spec bumps. But Apple’s Pro and Tell week isn’t over. It…

Published

on

Mostly same same, but a little bit different. 💻🖥️

On the heels of Apple’s new iPad Mini, Apple has turned its attention to its Mac lineup. Unlike the iPad Mini that received an OLED display and a water-resistant design, today’s Mac updates are mere spec bumps.

But Apple’s Pro and Tell week isn’t over. It will culminate with tomorrow’s special event in Los Angeles, where Apple is expected to reveal the long-awaited touchscreen MacBook Pro.

CNET Senior Editor Matt Elliott is here to run through what you need to know about this M6 Mac update. #apple #m6imac #firstlook #proandtell #m6macbookpro

Continue Reading

CNET

iPhone Duo Livestream: How Many Folds Can Apple’s Phone Take? Day 2

Apple’s iPhone Duo is out and we want to see how durable it is. So we built a robot to fold it 20,000+ times a day to test its limits. How long do you think it will last? 100,000 folds? 200,000 folds? 500,000 folds? Tune in and watch the testing live. We’ll have CNET’s editors…

Published

on

Apple’s iPhone Duo is out and we want to see how durable it is. So we built a robot to fold it 20,000+ times a day to test its limits. How long do you think it will last? 100,000 folds? 200,000 folds? 500,000 folds? Tune in and watch the testing live. We’ll have CNET’s editors online to answer any of your questions.

Read more about the iPhone Duo Folding Test on CNET.com
The iPhone Duo Is Now in Our Custom-Made Foldable Phone Test Machine. Will It Beat the Galaxy Fold 8?

iPhone Duo Review: Late to the Foldable Party, but It Steals the Show

Video Credits:
Host: Matthew Murray
Producer: Stephen Beacham
Thumbnail Designer: Zooey Liao

Add CNET as a trusted news source
Never miss a deal again! See CNET’s browser extension 👉
Check out CNET’s Amazon Storefront:
Subscribe to CNET on YouTube:
Follow us on TikTok:
Follow us on Instagram:
Follow us on Bluesky:
Like us on Facebook:
CNET’s AI Atlas:
Follow us on X:
Visit CNET.com:

#apple #iphone #iphonefold #iphoneduo #applefoldable #foldablephone #foldable #folding

Continue Reading

CNET

Fold-A-Phone Day 2: We Hit 75K Folds!

Join us live Monday through Friday at 1pm ET through 5pm ET to get your questions answered, as well as more phone folding ASMR. #foldaphone #allthingsmobile #iphoneduo #stresstest #apple

Published

on

Join us live Monday through Friday at 1pm ET through 5pm ET to get your questions answered, as well as more phone folding ASMR. #foldaphone #allthingsmobile #iphoneduo #stresstest #apple

Continue Reading

Trending