Something that gets missed when this comes up is that in the heavily populated parts of the Americas, much of the vulnerability to disease also came from the severe societal disruption experienced. Many of the very damaging plagues were from (probably) endemic diseases
you know how native americans were utterly anhiliated by european diseases they have no immune response to? how come the europeans didnt catch native american diseases in the same way