UngodlyAudrey🏳️⚧️@beehaw.org to Technology@beehaw.org · 3年前Sites scramble to block ChatGPT web crawler after instructions emergearstechnica.comexternal-linkmessage-square35fedilinkarrow-up1179arrow-down10
arrow-up1179arrow-down1external-linkSites scramble to block ChatGPT web crawler after instructions emergearstechnica.comUngodlyAudrey🏳️⚧️@beehaw.org to Technology@beehaw.org · 3年前message-square35fedilink
minus-squareThe Doctor@beehaw.orglinkfedilinkEnglisharrow-up2·3年前If you look in the server logs, you can see what their spiders are grabbing.
If you look in the server logs, you can see what their spiders are grabbing.