@fallbackerik @dillo primarily automated crawlers using naive scraping policies and residential proxies (thanks IoT). Potentially believing they can get a "competitive advantage" by avoiding robots.txt and scraping any data not realizing robots.txt and git endpoints were developed for a reason.

https://people.kernel.org/monsieuricon/creepy-crawlies
https://weirdgloop.org/blog/clankers