Unfortunately for you credit referencing agencies don't just record whether you take credit or not but also whether a "hard pull" has been performed on your credit details. A hard pull means that the details were pulled from the agency as part of an application for credit. Because lenders don't (have to) inform credit agencies whether they have accepted you for credit or not a hard pull that is not connected to a loan agreement could be because of a denial of credit or because you refused the offer; it is impossible to tell. A large number of hard pulls on your credit rating in a short period can look like you were desperate for credit and being turned down by a lot of lenders so looking further afield. The good news is that the effect of a hard pull on your credit rating is pretty much zero after six months, to quote Experian (paywalled site):
Having no recent searches (applications for credit) shows that you are not credit hungry and that your existing credit may be sufficient for your needs. The more searches that you have in a 6 month period, the more likely a lender will consider you to be higher risk.
note that it mentions "searches" and does not limit it to actually taking the loan.
Edit:
(from comments for clarity)
Remember that the ratings agencies know all of your loans and the respective dates and issuers so they can just match the hard pull to the loan. Your credit rating is a mixture of the number of hard pulls, your outstanding credit and a few other factors.