He's talking about speaking to a neighbor in this neighborhood who has several other equally palatial summer homes in other countries.

He's talking about this like "this guy has lost touch with how nice summer is in Seattle" as if that guy is his peer and not a founder at Microsoft.