The actual meat of the paper is "we got some very slow distributed inferencing working under laboratory conditions with access to homogenous equipment that was bought specifically for this purpose and was already under our control". We've had self-replicating worms since the 1980s at least. This is all very basic stuff. There's absolutely no reason for deploying a distributed LLM as part of this setup.