Unfortunately, Kavita follows a rigid file structure on purpose. Joe has said he wants it to work this way. However, you can use the "Save to Disk" feature in Calibre to specify a custom file structure for Kavita so you don't have to do it manually.
Here is the Kavita wiki article on how to do this: https://wiki.kavitareader.com/guides/external-tools/calibre/