I understand that if I close a short position on the ex-dividend date that you owe the lender the dividend. It is taken from my account. 

Where does the money the company pays for the dividend on those shares go?