I currently have in my possession physical debit card. Don't have my personal bank account number (both USA). I know it can be found online, on physical cheques, welcome material, statements but I just don't have them at this time. Is there any way I could get my bank account number from my actual debit card?
Just by looking at the card, generally not.
You could look on the back for the customer service phone number, call it, identify yourself to their satisfaction, explain your situation and see if they'll tell you your account number.