I am wondering weather it is worth it (how taxation works in this
scenario ect.) or not and legally possible to do so ?
Whether it is worth it or not is up to you. There's nothing illegal in this, unless of course there's a legal issue in the foreign country. The US doesn't care.
Re taxes - it is a bit trickier.
If your lender does not provide you with form 1098, you'll have to report the lender's name, address and SSN/ITIN on your tax return in order to claim a deduction.
The IRS will then expect the lender to report that interest as income. This is US-sourced income and is taxed in the US despite the fact that the lender is non-resident. See here for more info. If the lender doesn't report the income and doesn't pay the taxes - your deduction may be denied as well for double-dipping.
It is easier if this is an investment. Then the deduction is not going to Schedule A, but rather as an expense to Schedule E. The IRS may still require matching, but you won't need to report the SSN/ITIN - just have the expense properly documented.
Obviously, the best when it comes to legal issues, is to talk to an attorney licensed in the State in question. Similarly with tax questions - you should talk to a EA/CPA licensed in that State. I'm neither.