Connect with us

Reddit’s is taking a stand against AI crawlers | TechCrunch Minute

Reddit has announced that it’s changing its Robots Exclusion Protocol, also known as its robots.txt file. This might seem like a boring update but in the battle between AI companies who need content for their Large Language Models and the companies who actually own that content., this is another line in the sand. By changing…

Published

on

Reddit has announced that it’s changing its Robots Exclusion Protocol, also known as its robots.txt file. This might seem like a boring update but in the battle between AI companies who need content for their Large Language Models and the companies who actually own that content., this is another line in the sand. By changing its robots.txt file, and also by continuing to rate limit and block unknown bots and crawlers, Reddit seems to be working to AI companies from using their content without proper credit or compensation.

Subscribe for more on YouTube:

Follow TechCrunch on Instagram:
TikTok:
X:
Facebook:

Read more:

Continue Reading
Advertisement
2 Comments

2 Comments

  1. @Get_YT_Views_374

    June 27, 2024 at 10:44 pm

    i freaking love you like literally you make my day wayyyyyyyy much better❤️❤️❤️❤️

  2. @luminousdragon

    June 30, 2024 at 6:49 pm

    Reddit is not some hero here. they want that data to sale, and market to their users, etc. They arent doing this to protect their users. Im not stating this wildly, there is a long history of abusive actions by reddit towards its users.

    Take for instance the clip of the old ceo talking about how much private data reddit users share people they are SEMI anonymous on the platform. Meaning to a random person using reddit, if a reddit user posts, they dont have much of a way to tell who they are. reddit has more tools available to them to determine the identity of a user, so a person may make an anonymous account and talk about how they got revenge on a boss, or cheated or are addicted to gambling, whatever, and maybe they are signing in on the same computer as their main account, and maybe on their main account they’ve used their credit card or whatever.

    Thats just a random example.

    Point being, Reddit has a huge backlog of convos, and thats money, unless its devalued because anyone has access to it so there is no reason to pay reddit for it.

Leave a Reply

Your email address will not be published. Required fields are marked *

CNET

Watch Made by Google on Aug. 12 on CNET

We’ve got some theories on what Trevor Noah will help the brand announce this Wednesday at the Made By Google event (namely, the Pixel 11.) CNET Senior Mobile Editor Mike Sorrentino unfolds his thoughts. Watch live with us on August 12 right here on YouTube. Video Credits: Host: Mike Sorrentino Scripted by: Mike Sorrentino Videographer:…

Published

on

We’ve got some theories on what Trevor Noah will help the brand announce this Wednesday at the Made By Google event (namely, the Pixel 11.) CNET Senior Mobile Editor Mike Sorrentino unfolds his thoughts. Watch live with us on August 12 right here on YouTube.

Video Credits:
Host: Mike Sorrentino
Scripted by: Mike Sorrentino
Videographer: Carly Marsh
Video Editor: Dillon Payne

Add CNET as a trusted news source
Never miss a deal again! See CNET’s browser extension 👉
Check out CNET’s Amazon Storefront:
Subscribe to CNET on YouTube:
Follow us on TikTok:
Follow us on Instagram:
Follow us on Bluesky:
Like us on Facebook:
CNET’s AI Atlas:
Follow us on X:
Visit CNET.com:

#allthingsmobile #madebygoogle #google #pixel11 #android #mobile

Continue Reading

People & Blogs

Spider-Man shoots webs + flies through NYC, but it’s his human traits that make him memorable #TED

As the creator of a large chunk of the Marvel Universe, Stan Lee knows a thing or two about conjuring new superheroes from thin air.

Published

on

As the creator of a large chunk of the Marvel Universe, Stan Lee knows a thing or two about conjuring new superheroes from thin air.

Continue Reading

Music

“To My Bones” / “As the River Flows” / “In Dictum” | Wallis Bird | TED

Musician Wallis Bird performs three genre-bending songs with carefully crafted lyrics that weave themes of grief and societal struggle. The result is raw, roaring and deeply moving. (With singer Tracey Kelleher and followed by a note from TED guest curator Jacob Collier) (Recorded at TED2026 on April 15, 2026) Join us in person at a…

Published

on

Musician Wallis Bird performs three genre-bending songs with carefully crafted lyrics that weave themes of grief and societal struggle. The result is raw, roaring and deeply moving. (With singer Tracey Kelleher and followed by a note from TED guest curator Jacob Collier) (Recorded at TED2026 on April 15, 2026)

Join us in person at a TED conference:
Become a TED Member to support our mission:
Subscribe to a TED newsletter:

Follow TED!
Instagram:
LinkedIn:
TikTok:
Facebook:
X:

The TED Talks channel features the best talks and performances from the TED Conference, where the world’s leading thinkers and doers give the talk of their lives in 18 minutes (or less) — plus originals, podcasts and exclusive content. Look for videos on Technology, Entertainment and Design as well as science, business, global issues, the arts and more. Visit for our entire library, transcripts, translations and personalized recommendations.

Watch more:

TED videos may be used for non-commercial purposes under a Creative Commons License, Attribution–Non Commercial–No Derivatives (or the CC BY – NC – ND 4.0 International) and in accordance with the TED Talks Usage Policy: . For more information on using TED for commercial purposes (e.g. employee learning, in a film or online course), submit a request at

#TED #TEDTalks #Performance #Music

Continue Reading

Trending