Moving further, together with ethical AI

Reset
Proportionality and do no harm
Previous
Next
Smart car’s system malfunction put passengers at risk
i

A new smart electronic car has been developed with a brain exclusively powered by Google. The goal is to have a safer and greener car but also be able to experience all the advantages of an assistance system while driving.

t

Its operating system controls everything in the car from the radio to the navigation. The car is ordered by voice commanded and can drive itself. 

i

During a drive, the car suddenly takes control of the driving and doesn’t obey the driver anymore. The central touchscreen stops working and the main system starts rebooting itself. Eventually, it goes in the wrong direction and collides into another car. The drivers are luckily safe but traumatized. 

r

The car is analyzed by specialist that find that the system hadn’t undergone the latest connectivity software.

c

AI is still a domain that has to be secured and many problems can still appear when used. It is important when putting an AI product on the market to ensure its safety to the users. Furthermore, it is important to remember that AI should always be under human control and giving them the possibility to always take the upper hand on the technology. 

Recommendations

How could this situation have been avoided in the first place? 

 

Here are our recommendations per stakeholder:   

  • The technical community should go over the system and set up a backup in case the car starts does not work. The connectivity of the car is made less important in its functioning so that it doesn’t cause more problems in the future. 

  • Governments and international / regional organizations should implement policies monitoring the use of AI as to ensure its safety to the public.   

  • Civil society should, before buy an AI, know the risk and dangers that could come out of this.  

 

Basic Principles

Privacy & Responsibility and accountability & Safety and security & Privacy 

Resources

Know more about this case: 

 

 

Related work: