Why does the IRS penalize you for being single?

It's not the IRS. It's your elected officials in Washington, DC. It's your Congressman and Senator. Write, call, talk to them about not penalizing single people. Filing as "married, filing separately" is probably the most expensive way to file a tax return.