Why does everyone seem to hate fishing?

I've known about Stardew Valley for years and always kind of scoffed at playing it. I've even had a copy for years and never spent more than 5 minutes playing. Then one night I was having a few drinks with a friend who was playing and having trouble fishing so I gave it a go and became addicted.

I'm genuinely confused why so many people seem to hate fishing, and find it so difficult. What's the deal? I'm not going to say it's easy, but it was a lot of fun, and it's probably the hands down best money maker in early game, easiest skill to level in early game, and gets easier as you go.