Behind the purposefully provocative formulation, I have a real point: even in such an interesting project, I think there are unworded assumptions that are worth questioning. What is "the Internet"? What does holding it up mean?
Are "four billion phones" part of "The Internet"? What would happen if Android stopped working? What amount of work would be necessary to get back to a similar level of service, maybe with fewer bells and whistles, but also with much less corporate involvement and layering of bullshit?
There are few really essential pieces, that would require tremendous work to replace. I am even questioning OpenSSL because even though it is a building block used by a lot of software, it's not irreplaceable at all. Replacing it would be work, but, maybe not that much.
And it is a good thing. There are alternatives. Bricks can be changed for other bricks. That is, in a large part, what FOSS is about. That is what holds up the Internet: when something doesn't work, we can fix it or we can replace it.
The lowest level piece of software in the list that I cannot argue against is bash. Too many things depend on it, it is vital to keep it working. And I am actually lamenting that, because bash is not even a good piece of software, and it is a tragedy that so much depends on it. We would be in a better position if software depended on a shell rather than this specific implementation of a shell.
Call me a radical. I might very well be. But I think these things are worth saying.