Quote Originally Posted by awj223 View Post
With semi autonomous cars, I can see the same issues arising that happened with this https://en.wikipedia.org/wiki/%C3%9C...-air_collision mid-air collision over Germany. If the autopilot is giving the driver instructions to do something and the driver does otherwise thinking that he knows better based on what he can see, and another driver does what his autopilot says to do, there will still be a collision (in the collision mentioned, one pilot obeyed TCAS while the other obeyed ATC, and both collided in an accident in which there were no survivors).

Today, pilots are given instructions to obey TCAS at all times, regardless of what ATC says. The same type of training would be required for human car drivers.

Yeah there's a lot of dilemmas that these semi-autonomous cars can cause. Off the top of my head:

(1) Driver falsely lured into thinking the car is fully autonomous, and ends up paying less attention because his past experience leads him to believe the car is infallible.
(2) The car gives an alarm but it catches the driver off guard, and the driver cannot understand enough context to take over. Human -> AP / AP -> Human transitions can be incredibly dangerous especially if it's due to an imminent collision. There was a near miss in aviation where a napping pilot woke up and mistook the planet Venus for the lights of an oncoming plane and commanded a nosedive. A lot can change on the road if you look away for a short period of time. If you look up and suddenly see the side of a semi truck, how long would it take to make sense of the situation?
(3) Driver mistakes the driver assistance system as a more skilled driver than him. There's been a few plane crashes where after the plane gave a stall warning the pilots tried to use AutoThrottle/AutoPilot to apply corrective inputs.


Driver assistance systems are going to be a cat and mouse game between the tech improving and human behavior regressing. But it seems like one can give benefit of the doubt in this situation that it was an out-of-the-ordinary traffic situation that can easily catch human drivers off-guard as well.


Oh yeah, as an aside: Currently Tesla OS 7.1 doesn't recognize oncoming cars or perpendicular cross traffic reliably. Right now, it mostly understand your pack of traffic you're traveling with, as to help with lane and distance regulation. However, just today, rumors came out about Tesla OS 8.0, which does add recognition of those types of traffic…. I think Tesla deserves some credit here for constantly improving their semiautonomous capabilities for existing owners instead of just adding new features to next-model-year cars and keeping older car owners less safe when it's just a software change.