Some of it is also styles. If you came of age in the 1970s, then 50 years on, you probably dress and have your hair done like it's the 1970s. We associate those styles with old people and then see the same styles in old photos, which makes the people in them look old.

That's only a partial explanation, though. A lot of that stuff did age you faster.