I mean yeah I think the main problem is just Google having all that data about you and potentially selling it to others whether that be for advertising, robocalling, or other things. So it really just comes down to how comfortable you are allowing Google to be able to use your emails and communications from corporations to see what things you like. Only time it really matters more is if you are using email for more personal or secure communications which yeah I would always prefer using better encrypted more messaging focused apps like signal for or just talking in person when possible.