I just ran into this too and you have to add an extra config that initializes the plugin like in the nix neovim docs.

I ended up switching to helix out of spite.