Science & Technology

Reddit’s is taking a stand against AI crawlers | TechCrunch Minute

Reddit has announced that it’s changing its Robots Exclusion Protocol, also known as its robots.txt file. This might seem like a boring update but in the battle between AI companies who need content for their Large Language Models and the companies who actually own that content., this is another line in the sand. By changing…

Published

on

Reddit has announced that it’s changing its Robots Exclusion Protocol, also known as its robots.txt file. This might seem like a boring update but in the battle between AI companies who need content for their Large Language Models and the companies who actually own that content., this is another line in the sand. By changing its robots.txt file, and also by continuing to rate limit and block unknown bots and crawlers, Reddit seems to be working to AI companies from using their content without proper credit or compensation.

Subscribe for more on YouTube:

Follow TechCrunch on Instagram:
TikTok:
X:
Facebook:

Read more:

2 Comments

  1. @Get_YT_Views_374

    June 27, 2024 at 10:44 pm

    i freaking love you like literally you make my day wayyyyyyyy much better❤️❤️❤️❤️

  2. @luminousdragon

    June 30, 2024 at 6:49 pm

    Reddit is not some hero here. they want that data to sale, and market to their users, etc. They arent doing this to protect their users. Im not stating this wildly, there is a long history of abusive actions by reddit towards its users.

    Take for instance the clip of the old ceo talking about how much private data reddit users share people they are SEMI anonymous on the platform. Meaning to a random person using reddit, if a reddit user posts, they dont have much of a way to tell who they are. reddit has more tools available to them to determine the identity of a user, so a person may make an anonymous account and talk about how they got revenge on a boss, or cheated or are addicted to gambling, whatever, and maybe they are signing in on the same computer as their main account, and maybe on their main account they’ve used their credit card or whatever.

    Thats just a random example.

    Point being, Reddit has a huge backlog of convos, and thats money, unless its devalued because anyone has access to it so there is no reason to pay reddit for it.

Leave a Reply

Your email address will not be published. Required fields are marked *

Trending

Exit mobile version