Piggybacking on Saz's post, a lot of pension funds and similar retirement accounts invest in the market through one mechanism or another (increasingly PE, which is interesting from an ERISA fiduciary standpoint but that's an unnecessary aside).
It's not just rich people losing money here folks.