Ask HN: How do you protect self-hosted websites from LLM scrapers?

  • Posted 3 hours ago by atmosx
  • 1 points
Hello HN,

I'm considering self-hosting a couple of static low-volume traffic on a VM. I'm curious to know what techniques you using to protect personal and professional websites from abusive LLM (and other) scraping. Assume no CDN is involved.

I'm aware of:

    (1) anubis AI firewall
    (2) LLM poisoning projects like iocaine
    (3) bate links hidden in the HTML source code that block IPs when accessed
    (4) ppl blocking CIDRs of all major Cloud Providers (GCP, AWS, Azure, Alibaba, etc).
Are there any other interesting techniques that can be used?

Ty!

1 comments

    Loading..