When using adaptive cruise control you can set the speed limit to let's say 60. If you drive behind someone and they have slowed down to 30 to take a steep turn they might disappear from your cars sensors. In that case the car might see no obstacle and rapidly accelerate trying to get back to 80. That is scary, because suddenly the car is accelerating towards a sharp turn. This is not theoretical, my friends Volvo has done this multiple times.

If your argument is safety it is moot. Autopilot has less accidents than humans.

Autopilot is just a more advanced version of this. It is brilliant as long as you know it's quirks. For highway driving with few cars around you can probably relax as as much or more as you would just cruising. For city driving you should be alert to take over at any time, but you might not have to navigate that complex intersection and can pay more attention to your surroundings.

Unless they get to a point where you can fold in the steering wheel and just be a passenger the burden falls on the driver.