Historically, having a large and growing poor population is a recipie for revolution. Which is not to say the poor will revolt just that as you concentrate weath society becomes less stable and the poor are often used by those with some power who want more power.