Connect with us

Science & Technology

The leaderboard ‘you can’t game,’ funded by the companies it ranks | Equity Podcast

Artificial intelligence models are multiplying fast, and competition is stiff. With so many players crowding the space, which one will be the best — and who decides that? Arena, formerly LM Arena, has emerged as the de facto public leaderboard for frontier LLMs, influencing funding, launches, and PR cycles. In just seven months, the startup went from a UC Berkeley PhD research…

Published

on

Artificial intelligence models are multiplying fast, and competition is stiff. With so many players crowding the space, which one will be the best — and who decides that? Arena, formerly LM Arena, has emerged as the de facto public leaderboard for frontier LLMs, influencing funding, launches, and PR cycles. In just seven months, the startup went from a UC Berkeley PhD research project to being valued at $1.7 billion. 

Watch as Equity host Rebecca Bellan catches up with Arena co-founders Anastasios Angelopoulos and Wei-Lin Chiang about how their platform became the go-to leaderboard for frontier AI models, and how they’re trying to build a neutral benchmark even as companies like OpenAI, Google, and Anthropic back the project.

Subscribe to Equity on YouTube, Apple Podcasts, Overcast, Spotify and all the casts. You also can follow Equity on X and Threads, at @EquityPod.

Chapters:

00:00 Intro

03:00 How Arena’s leaderboard works, and why it’s different from static benchmarks

07:00 Reproducibility concerns and how to scale

08:45 Can Arena stay independent while taking money from the labs it ranks?

11:15 Diversity, fraud prevention, and abuse mitigation

18:15 Arena’s “data moat”

19:20 Agent benchmarking and expert leaderboards

21:40 Open sourcing data

22:45 How do Arena’s rankings shape AI development?

24:15 Outro

Continue Reading
Advertisement
Click to comment

Leave a Reply

Your email address will not be published. Required fields are marked *

Science & Technology

This Robot Hit a 99.6% Success Rate

This robot achieved a 99.6% success rate over an eight-hour test. But when a single failure can stop an entire production line, how reliable do robots actually need to be? Mbodi co-founder Xavier Chi explains why reliability is one of robotics’ biggest real-world challenges on Build Mode. Watch the full episode:

Published

on

This robot achieved a 99.6% success rate over an eight-hour test. But when a single failure can stop an entire production line, how reliable do robots actually need to be?

Mbodi co-founder Xavier Chi explains why reliability is one of robotics’ biggest real-world challenges on Build Mode.

Watch the full episode:

Continue Reading

CNET

I Played With Apple’s New iPhones. Here’s What Surprised Me Most | One More Thing

Spending time with the iPhone Duo and iPhone 18 Pro has Bridget Carey rethinking what’s important in an iPhone upgrade. She breaks down the standout Duo features, what the crease is really like, and the questions she has for the future of Apple Watch and the next era of Apple. You can find the products…

Published

on

Spending time with the iPhone Duo and iPhone 18 Pro has Bridget Carey rethinking what’s important in an iPhone upgrade. She breaks down the standout Duo features, what the crease is really like, and the questions she has for the future of Apple Watch and the next era of Apple.

You can find the products mentioned in this video linked below
Apple iPhone 17, US Version, 256GB, eSIM, Mist Blue- Unlocked (Renewed)
*Cnet may get commission on this offer.

Read more about it on CNET.com
I Tried the iPhone 18 Pro’s New Deluxe Camera and Shot Photos With Starbursts
Planning to Get the iPhone Duo or iPhone 18 Pro? Turn Off This Setting on Your Old Device First

Timecode Chapters:
0:00 Apple’s new iPhone Tricks
0:14 Reporting from the iPhone Event at Apple Park
0:19 Opening and Closing the iPhone Duo
0:28 Big changes coming to iPhone
0:38 John Ternus has One More Thing
0:46 Bridget Carey’s iPhone Duo event experience
1:03 iPhone Duo
1:14 Taking video on iPhone Duo
1:37 Smart Take on iPhone Duo
2:04 Snoopy comes to iPhone Duo
2:21 iPhone Duo crease
2:41 Hidden camera behind iPhone Duo screen
2:51 iPhone Duo size
3:11 iPhone Duo cases
3:28 MagSafe on iPhone Duo
3:34 iPhone 18 Pro updates
4:07 Aperture on iPhone 18 Pro
4:42 Apple Watch changes
4:43 Apple Watch audio intelligence, recording, transcribing
5:20 New Apple Watch sensor
5:33 New Apple iPhone and Apple Watch accessories
5:47 One More Tip to help cover the cost of your new iPhone
5:56 Get the most money for your iPhone trade-in
6:18 Let us know in the comments what you want to see from One More Thing

Video Credits:
Host: Bridget Carey
Scripted by: Bridget Carey
Producer: Carly Marsh
Camera: Celso Bulgatti, Bridget Carey
Video Editor: Carly Marsh
Thumbnail Designer: Tharon Green

Add CNET as a trusted news source
Never miss a deal again! See CNET’s browser extension 👉
Check out CNET’s Amazon Storefront:
Subscribe to CNET on YouTube:
Follow us on TikTok:
Follow us on Instagram:
Follow us on Bluesky:
Like us on Facebook:
CNET’s AI Atlas:
Follow us on X:
Visit CNET.com:

#iphone #apple #foldableiphone #iphoneduo

Continue Reading

CNET

Unboxing the $149 AirPods 5 with Wireless Charging Case

Apple announced the new AirPods 5 base model will remain at $129, but the step-up $149 model with a wireless charging case and Find My speaker might be more your style. Both will have active noise cancellation (ANC), which is an upgrade from the AirPods 4. Let’s unbox them with CNET executive editor David Carnoy.…

Published

on

Apple announced the new AirPods 5 base model will remain at $129, but the step-up $149 model with a wireless charging case and Find My speaker might be more your style. Both will have active noise cancellation (ANC), which is an upgrade from the AirPods 4. Let’s unbox them with CNET executive editor David Carnoy. #apple #appleevent #airpods #unboxing #airpods5

Add CNET as a trusted news source
Never miss a deal again! See CNET’s browser extension 👉
Check out CNET’s Amazon Storefront:
Subscribe to CNET on YouTube:
Follow us on TikTok:
Follow us on Instagram:
Follow us on Bluesky:
Like us on Facebook:
CNET’s AI Atlas:
Follow us on X:
Visit CNET.com:

Continue Reading

Trending