White shoe has many progenitors. But the most likely is Yale or Princeton where the the upper crust elite sat together at football games. From a distance all you could make out was a long row of white bucks (shoes made popular by singer Pat Boone). They became known as ‘white shoe boys’ and this followed them to their clubs and in investment banks, i.e. white shoe firms.