I mean, not really. You can go with a car only where infrastructure (roads) has been built, same as transit. There's more places reachable by that infrastructure, but that is only because things have been built around it. You absolutely do have to worry about delays; there are after all things like traffic jams and road closures. You have to worry about the route you take, not in the form of what connections to take but in the form of navigating the right route. People absolutely have to worry about things like theft and altercation when driving, else people wouldn't lock their cars, and road rage wouldn't exist.

Personally, after having moved somewhere I can manage to at least live my life, without owning a car, I find it feels a lot more freeing to just be able to walk places I want to be, or get on a train that someone else is driving, than having to own some expensive machine that needs periodic and also costly maintenance, and then having to operate it constantly to get anywhere, with the risk of accidently killing someone if I make a mistake.