You need to get the current tax software, the 2013 filing software is out already, even though it needs to update itself before filing, as the final forms aren't ready yet.
Then you will look carefully at Schedule E to understand what gets written off. I see you are looking at the $2200 rent vs your own rent of $2100, but of course, the tax form doesn't care about your rent. You offset the expenses of that house against the income.
The expenses are the usual suspects, mortgage interest, property tax, repairs, etc. But there's one big thing new landlords are prone to forgetting. Depreciation. It's not optional. Say the house cost you $400K. This is your basis. You need to separate the value of land which is not depreciated. For a condo with no land it can be as little as 10%, when we bought our house, for insurance purposes, the land was nearly 40% of the full value. Say you do the research and decide 30% (for land), then 70% = $280K. Depreciation is taken each year over a 27.5 year period, or just over $10,000 per year. (Note, the forms will help you get your year 1 number, as you didn't have a full year.)
This depreciation helps with your cash flow during the year (as you should do the math, and if you keep the house, adjust your W4 withholdings for 2014, that lump sum you'll get in April won't pay the bills each month) but is 'recaptured' on sale.
At some point in the future, you may save enough to buy a house where you wish to live, but need to sell the rental. Consider a 1031 Exchange. It's a way to sell a rental and buy a new one without triggering a taxable event. What I don't know is how long the new house must be a rental before the IRS would then allow you to move in. The same way you turned your home into a rental, a rental can be turned back to a primary residence. I just doubt you can do it right after the purchase. As fellow member @littleadv would advise, "get professional advice." And he's right. I've just offered what you might consider. The first year tax return with that Schedule E is the toughest as it's brand new. The next year is simple in comparison.
The question of selling immediately is tough. Only you can decide whether the risk of keeping it is too great. You're saying you don't have the money to cover two month's vacancy. That scares me. I'd focus on beefing up the emergency account. And securing a credit line. You mentioned the tax savings. My opinion is that for any investment,the tax tail should never wag the investing dog. Buy or sell a stock based on the stock, not the potential tax bill for the sale. In your situation, the rent and expenses will cancel each other, and the depreciation is a short term loan, from a tax perspective.
If you sold today, what do you net? If you analyzed the numbers now, what is your true income from the property each year? Is that return worth it? A good property will provide cash flow, principal reduction each year, and normal increase in value. This takes a bit of careful looking at the numbers. You might feel you're just breaking even, but if the principal is $12K less after a year, that's something you shouldn't ignore. On the other hand, an exact 'break-even' with little equity at stake offered you a leveraged property where any gains are a magnified percentage of what you have at risk.
Last - welcome to Money.SE - consider adding some more details to your profile.