Sep 28, 2023, 2:26 PMA new major feature for the crawler library is on it's way: you'll be able to use (rotating) proxy servers for loading!
https://github.com/crwlrsoft/crawler/issues/99#issuecomment-1739339750
As it is hacktoberfest right now, I'll wait a few weeks before tagging a new release, but you can have a look at it, try it, give feedback. 🙂