For America's two lowest quintiles, income averages have ticked down in recent years — and barely budged since 1984.