Someone will always have it worse than you. Yet there are examples of people being successful from every background.
The market does not care about your excuses. Wherever you are coming from there will be opportunities that others will not have.
Started homeless? Rags to riches tale, free PR
Started as a minority? Automatic niche, word of mouth
Started rich? Access to capital
Everyone has their own shit to deal with.
Is your life filled with excuses or things that spur you on? The only difference is your mind-set.