lemmy.onlylans.io
  • Communities
  • Create Post
  • Create Community
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
sabreW4K3@lazysoci.al to Technology@beehaw.orgEnglish · 2 个月前

The Open-Source Software Saving the Internet From AI Bot Scrapers

www.404media.co

external-link
message-square
24
fedilink
  • cross-posted to:
  • [email protected]
145
external-link

The Open-Source Software Saving the Internet From AI Bot Scrapers

www.404media.co

sabreW4K3@lazysoci.al to Technology@beehaw.orgEnglish · 2 个月前
message-square
24
fedilink
  • cross-posted to:
  • [email protected]
Anubis, which block AI scrapers from scraping websites to death, has been downloaded almost 200,000 times.
  • FundMECFS@lemmy.blahaj.zone
    link
    fedilink
    arrow-up
    13
    ·
    2 个月前

    This thing Anubis always flags me for some reason. I use mullvad and safari (ios) with some add and tracker blocking extensions.

    • Photuris@lemmy.ml
      link
      fedilink
      arrow-up
      6
      ·
      2 个月前

      More sites in general are blocking mullvad traffic lately (in my experience), and I’m not sure what, if anything, can be done about it.

      • FundMECFS@lemmy.blahaj.zone
        link
        fedilink
        arrow-up
        6
        ·
        2 个月前

        I expect better from a popular FOSS tool being used by privacy aware people though.

        • Lime Buzz (fae/she)@beehaw.org
          link
          fedilink
          English
          arrow-up
          2
          ·
          2 个月前

          Can you open an issue, or see if one is open already for this?

      • Powderhorn@beehaw.org
        link
        fedilink
        English
        arrow-up
        3
        ·
        2 个月前

        Agreed. Luckily, they don’t seem to have the full list of Mullvad IPs, so if I really want to read something, I just try another tunnel.

    • simple@piefed.social
      link
      fedilink
      English
      arrow-up
      6
      ·
      2 个月前

      Do you have javascript or cookies disabled? That might stop you from getting past.

      • FundMECFS@lemmy.blahaj.zone
        link
        fedilink
        arrow-up
        3
        ·
        2 个月前

        nope

    • Appoxo@lemmy.dbzer0.com
      link
      fedilink
      arrow-up
      4
      ·
      2 个月前

      I wonder why traffic from known VPN companies are under more scrutiny than traffic from domestic households…

Technology@beehaw.org

technology@beehaw.org

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: [email protected]

A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.

Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.

Subcommunities on Beehaw:

  • Free and Open Source Software
  • Programming
  • Operating Systems

This community’s icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 555 users / day
  • 1.07K users / week
  • 2.63K users / month
  • 7.5K users / 6 months
  • 5 local subscribers
  • 40.2K subscribers
  • 4.51K Posts
  • 87.9K Comments
  • Modlog
  • mods:
  • alyaza [they/she]@beehaw.org
  • TheRtRevKaiser@beehaw.org
  • gyrfalcon@beehaw.org
  • rs5th@beehaw.org
  • coldredlight@beehaw.org
  • Leigh@beehaw.org
  • TheRtRevKaiser@kbin.social
  • Chris Remington@beehaw.org
  • BE: 0.19.8
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org