Can a cashier refuse to give back your credit card?

They ARE allowed, genius. He/She was INSTRUCTED to keep the card. Nothing suspicious here. You need to dial back the over entitlement. The card belongs to the bank, not you.