jlai.lu
  • Communities
  • Create Post
  • Create Community
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
alex [they, il] to Technology@midwest.socialEnglish · 1 year ago

The rise and fall of robots.txt

www.theverge.com

external-link
message-square
0
link
fedilink
  • cross-posted to:
  • technology@beehaw.org
  • technology@lemmy.zip
  • technology@lemmy.world
1
external-link

The rise and fall of robots.txt

www.theverge.com

alex [they, il] to Technology@midwest.socialEnglish · 1 year ago
message-square
0
link
fedilink
  • cross-posted to:
  • technology@beehaw.org
  • technology@lemmy.zip
  • technology@lemmy.world
As unscrupulous AI companies crawl for more and more data, the basic social contract of the web is falling apart.
alert-triangle
You must log in or register to comment.

Technology@midwest.social

technology@midwest.social

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !technology@midwest.social

Post articles or questions about technology

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 6 users / day
  • 47 users / week
  • 146 users / month
  • 891 users / 6 months
  • 2 local subscribers
  • 2.24K subscribers
  • 143 Posts
  • 130 Comments
  • Modlog
  • mods:
  • seahorse [Ohio]@midwest.social
  • BE: 0.19.11
  • Modlog
  • Legal
  • Instances
  • Docs
  • Code
  • join-lemmy.org