Does removing a card from my phone affect the card on my smartwatch when they are paired together?

No, removing a card from your phone does not remove the card from your smartwatch when the device is paired together.

You need to remove your card from both devices separately.