The fructose caveat you've given is huge, though. Almost all added sugar is in the form of sucrose (half fructose) or high fructose corn syrup (also half fructose).

Plus, quantity itself does matter, too. If the effect of adding a bunch of sugar is that the person ends up consuming more sugar overall, then that can affect health as well.