What you’ve got is a Bitcoin address (like a bank account number) and the key to that address (another number, which works like the PIN to the first number).2 The Bitcoin address is mentioned in transactions on the blockchain; the key is the unique thing you have that makes your bitcoins yours.
