When playing Nintendo games, do you swap ABXY to match the deck?

Meaning, swap A&B to be opposites so that when the game tells you to press A, you’re actually pressing the A button, and same with X&Y? I’m wondering cuz I’ve tried it and sometimes it feels like the gameplay is designed for you to be pressing the rightmost button, I.e. the B button on the Steamdeck but the A button on a switch controller. How do you feel?

EDIT: emu on a Steamdeck, not playing on a switch