A list of communities isn't "a lot more content." Just run it once daily and the problem is solved. Instances don't need to store posts, just community names available on that instance.

If the issue is finding new instances, I think it's fine for it to take some time the first time someone tries to find a community on that instance. But after that, it should immediately have a list of communities from that instance.