In short, yes, it is a show worth watching. Take it season by season, stop when it's not worth it anymore.

As a show you can binge I expect it will be better than the ratings reflect. The weaker episodes will just be forgotten.

Luckily that's a problem for later on as the show starts strong. Maybe by season 4/5 are where things start to fall off, but you'll have plenty within the first three seasons that are great. Even 4/5 have their moments, it's just that the show has shifted dramatically by then.