Yes, because at the time we didn't understand germ theory. The livestock the spanish brought over introduced these diseases to other people via other animals.

If you supermegavirus X to your pet rat which lives in your house and who then gives it to a bird who then gives it to a different bird and eventually kills me are you responsible for my death? No you are not and that is how many/most died. They had zero contact with Europeans.