The federal government publishes an annual "Yearbook of Immigration Statistics" which includes the following table of the admissions category for new permanent residents in each of the past three years. The data cover only legal permanent residents (i.e. green card holders). They exclude illegal immigration and temporary nonimmigrant visas, though they do include status adjusters as well as newcomers, so those who first arrive as students, H1-B's, refugees, etc., and then decide to stay and get a green card are included in the year they adjust to permanent.
So those who get a visa for employment/skill reasons total only 14%. Hopefully they are more skilled than the average H-1B holder. That visa mainly exists to drive down wages for Americans.
You can only get a H-1B visa if you are sponsored by a company. Usually for employment reasons because not a lot of companies run charity services to bring people into this country. That 14% are the H-1B visa holders. Processing that costs time and money and companies only do that for for people that they absolutely need. I am sorry that you have failed at life, but I would recommend not directing that anger towards H-1B visa holders. Thanks!