AI Case Study

"One video shows a Model S driving through the same segment of the highway where the crash occurred with Autopilot activated. As the road approaches the barrier, a new lane marking indicates that drivers need to veer right if they want to stay on the road.

But the new lane marking is more faded than the prior left-hand lane marker, which becomes the right-hand lane marker for a ramp that allows drivers to exit to a new road. In the video, the Model S, which has Autopilot engaged, does not recognize the new lane marker and continues to use the old lane marker, which would lead it into the barrier." (electrek)

"Another video, taken on a highway in Chicago, shows a Model S making the same mistake and nearly causing a similar accident.

While certainly not an official investigation, the two videos seem to show the potential limitations of Autopilot. While the software's automatic-steering feature can keep a vehicle in its lane on the highway, it does so by reading the lane markings. If a lane marking has faded, it's more difficult for the vehicle to recognize it, and if the faded lane marking is close to one that is more prominent, the vehicle may assume the more prominent marking is the one to follow." (businessinsider)