Login
You're viewing the assemblag.es public feed.
  • Jan 21, 2026, 10:22 PM

    Good News!

    A significant portion of the (likely AI) crawlers that were hitting my site seem to have decided that my maze of generated shit isn't to their taste.

    They've only themselves to blame: the maze is listed as a Disallow in robots.txt and every generated page has noindex, nofollow in its metadata.

    (It's a big enough drop that I've checked nothing's broken)

    Screenshot of a grafana cell showing entries into the tarpit log (i.e. number of loglines).

On 18th Jan the rate more or less doubled, but that's the result of me improving the performance of the script behind the tarpit.

What really matters is this afternoon the rate dropped by about 75% and seems to still be on its way down
    💬 0🔄 1⭐ 0