Sounds like you're at the right stage in the process to investigate! Only reason I brought it up is that I'm working on a bullet heaven as well and got some pretty big gains going the server route.

Whether or not it's needed is dependent on your final vision, but even just handling collision has some appreciable gains.

Good luck!