Yeah, forgejo will give you many of the features of GitHub. Not the proprietary ones like the Actions Marketplace of course, but a lot of equivalent features. It's lightweight enough though that even if you never use it for anything beyond git, creating pull requests, and some basic CI, it's not going to require much power to run it.

Do you need the public to have access to it? That would be the only reason for federation that I could think of. That's not available quite yet.