Adam ♿voltagex@aus.social
Oct 23, 2026, 2:07 AMRE: https://chaos.social/@FunkyBob/117487557972028329
And now everyone is blocking crawlers, it's impossible to ever make a new search engine again.
Hooray!
RE: https://chaos.social/@FunkyBob/117487557972028329
And now everyone is blocking crawlers, it's impossible to ever make a new search engine again.
Hooray!
@voltagex yes!!!!!! yes!!!!!! this was always the endgame!!!!!! the house always wins!!!!!!!
@voltagex i think it can be fixed
Maybe this'll mark the return of the aged and venerable SiteMap.
@voltagex Hey, wasn't there a way before search engines? What if we invested in curated pages and created systens where users can anounce... wait anouncements get gamed. Not unescapable if we use some sort of endorcement system. Perhaps a WebRing like system but the ring is a file at site root like robots.txt?