Connect with us

Reddit’s is taking a stand against AI crawlers | TechCrunch Minute

Reddit has announced that it’s changing its Robots Exclusion Protocol, also known as its robots.txt file. This might seem like a boring update but in the battle between AI companies who need content for their Large Language Models and the companies who actually own that content., this is another line in the sand. By changing…

Published

on

Reddit has announced that it’s changing its Robots Exclusion Protocol, also known as its robots.txt file. This might seem like a boring update but in the battle between AI companies who need content for their Large Language Models and the companies who actually own that content., this is another line in the sand. By changing its robots.txt file, and also by continuing to rate limit and block unknown bots and crawlers, Reddit seems to be working to AI companies from using their content without proper credit or compensation.

Subscribe for more on YouTube:

Follow TechCrunch on Instagram:
TikTok:
X:
Facebook:

Read more:

Continue Reading
Advertisement
2 Comments

2 Comments

  1. @Get_YT_Views_374

    June 27, 2024 at 10:44 pm

    i freaking love you like literally you make my day wayyyyyyyy much better❤️❤️❤️❤️

  2. @luminousdragon

    June 30, 2024 at 6:49 pm

    Reddit is not some hero here. they want that data to sale, and market to their users, etc. They arent doing this to protect their users. Im not stating this wildly, there is a long history of abusive actions by reddit towards its users.

    Take for instance the clip of the old ceo talking about how much private data reddit users share people they are SEMI anonymous on the platform. Meaning to a random person using reddit, if a reddit user posts, they dont have much of a way to tell who they are. reddit has more tools available to them to determine the identity of a user, so a person may make an anonymous account and talk about how they got revenge on a boss, or cheated or are addicted to gambling, whatever, and maybe they are signing in on the same computer as their main account, and maybe on their main account they’ve used their credit card or whatever.

    Thats just a random example.

    Point being, Reddit has a huge backlog of convos, and thats money, unless its devalued because anyone has access to it so there is no reason to pay reddit for it.

Leave a Reply

Your email address will not be published. Required fields are marked *

Science & Technology

Can Enterprises Trust Autonomous AI? Security Experts on Governance and Architecture | Disrupt 2026

AI is making autonomous decisions inside sensitive enterprise systems. Security leaders from Luta Security and AWS, with cybersecurity veteran Wendy Nather, discuss what it takes to deploy it safely. #TechCrunchDisrupt2026 Follow us across… Read more:

Published

on

AI is making autonomous decisions inside sensitive enterprise systems. Security leaders from Luta Security and AWS, with cybersecurity veteran Wendy Nather, discuss what it takes to deploy it safely.

#TechCrunchDisrupt2026

Follow us across…

Read more:

Continue Reading

Science & Technology

Databricks on Why Enterprise AI Deals Die After the Pilot (And How to Fix It) | Disrupt 2026

The gap between enterprise AI promise and adoption is rarely a technology problem. Databricks’ Arsalan Tavakoli explains what founders get wrong about how enterprises buy and deploy AI. #TechCrunchDisrupt2026 Follow us across… Read more:

Published

on

The gap between enterprise AI promise and adoption is rarely a technology problem. Databricks’ Arsalan Tavakoli explains what founders get wrong about how enterprises buy and deploy AI.

#TechCrunchDisrupt2026

Follow us across…

Read more:

Continue Reading

Bloomberg Technology

The Hot WatchesTurning Heads atGeneva Watch Days

Step inside Geneva Watch Days, where independent and contemporary watchmakers take centerstage. Allegra Catelli has the highlights. ——– Like this video? Subscribe to Bloomberg Technology on YouTube:   Watch the latest full episodes of “Bloomberg Technology” with Caroline Hyde and Ed Ludlow here:   Get the latest in tech from Silicon Valley and around the…

Published

on

Step inside Geneva Watch Days, where independent and contemporary watchmakers take centerstage. Allegra Catelli has the highlights.
——–
Like this video? Subscribe to Bloomberg Technology on YouTube:

 
Watch the latest full episodes of “Bloomberg Technology” with Caroline Hyde and Ed Ludlow here:

 
Get the latest in tech from Silicon Valley and around the world here:

Connect with us on…
X:
Facebook:
Instagram:
 
Follow Ed Ludlow on X here:
Follow Caroline Hyde on X here:
 
Listen to the daily Bloomberg Technology podcast here:

 
More from Bloomberg Business
Connect with us on…
X:
Facebook:
Instagram:
LinkedIn:
TikTok:

Continue Reading

Trending