Why does my vision seem distorted when wearing glasses? I’m primarily a contact wearer

Additional info, I wear contacts daily, and most days when I take them out I go straight to bed without ever wearing glasses. So I pretty much only wear glasses if my eyes need a major reset

Every time I wear my glasses my vision seems fisheyes for at least a day. Is this normal? I never experience distortion with contacts

I thought it was caused by my old glasses not being properly fit as they were ordered online. But I just got new glasses that were fit at an optometrist.

Is this to be expected? Or should I go back to the optometrist and have them make adjustments or refit me?