you're reading...

What if I had to put my safety in the hands of a robot? [Science and Technology Podcast]

Written by Lieve Van Woensel with Sarah McCormack,

Will intelligent robots bring us benefits in relation to security and safety, or will the vulnerabilities within these systems mean that they cause more problems than they solve?

Cyber-physical systems (CPS) are currently found in a wide range of services and applications, and their numbers are rapidly increasing. CPS are intelligent robotic systems linked to the Internet of Things. They make decisions based on the ability to sense their environment. Their actions have a physical impact on either the environment or themselves. This is what sets CPS apart: they are not solely smart systems, but rather, they have physical aspects to them. These robots are likely to infiltrate our everyday lives in the coming years. Due to this, we must look at what impact they will have on citizens’ safety and security. The question remains, how safe are these technologies?

Potential impacts and developments

What if I had to put my safety in the hands of a robot?

© Shutterstock / Willyam

Such systems often work as part of a network in which information is exchanged, normally using wireless connectivity, which can be vulnerable to hackers and criminals. These networks may be seen as the coupling of information technology (IT) and operational technology (OT) systems, known as IT-OT integration. Issues arise due to the diminished level of security of the OT compared to that of the IT system. Should someone infiltrate these systems they could potentially access the data gathered by the CPS and corrupt the system itself. Although this is a sobering thought, we are seeing the development of technologies which promise to better protect these systems and hence individuals’ information, such as through the creation of quantum cryptography, which will (at least in theory) be impossible for a hacker to defeat.

Listen to podcast: What if I had to put my safety in the hands of a robot?

Robots can have positive impacts on our safety. For example, they can aid disaster relief workers. Automated vehicles with the ability to make autonomous decisions can access dangerous sites to help save victims, and keep workers themselves safe and out of harm’s way. Driverless cars are another example of autonomous robots that are becoming more commonplace and are expected to be safer for citizens. This is based on the fact that the systems will not tire or suffer from road rage, and that they are better at calculating manoeuvres. The taxi company Uber is in fact already planning on replacing 160 000 drivers with driverless cabs. However, the recent Tesla case, where a driver was killed as the car in autopilot mode did not recognise another car against a bright sky, shows that more work needs to be done to increase their safety. Robots can have medical applications too. CPS can effectively monitor the body and provide the correct medication when needed, ensuring the safety of the patient. However, possible safety concerns can arise should the system malfunction or, as is the case with other technologies, they could be hacked to deliver a fatally high dose to patients.

Another type of robot increasingly being used are drones. They have been used by governments for security, for example in civil surveillance tasks such as border patrols to minimise numbers of illegal immigrants entering countries. Concerning refugees, the ability to closely monitor flowz of people will mean that better relief and aid can be provided, assisting in their safety. Citizens are also increasingly using drones as they are becoming cheaper to purchase and their range is increasing. These drones, in the hands of civilians, while often used for leisure, can also be used for nefarious and criminal purposes, such as the delivery of munitions. They can also be fitted with guns or used to fly explosives or dangerous materials into areas, as was seen when a drone carrying radioactive sand was flown onto the roof of the Japanese prime minister’s office. Drones are also a threat to conventional aircraft. Thus, we may need to look at counter-drone technologies, as have been seen in Tokyo, where the police catch rogue drones in nets.

Another possible safety concern is the misinterpretation of the signs from CPS by humans, leading to negative consequences. Most fatal accidents in factories with CPS happen when the robot is undergoing maintenance and moves in a way that the human worker did not expect. The ability to predict the systems’ movement and behaviour is vital to ensure control over them and the safety of humans who come into contact with them.

A large amount of data on individuals will be stored on databases through the increased use of CPS. The information gathered will range from that regarding individuals’ identity to that regarding their purchases, habits and journeys. However, it is not yet known whether this information will end up being linked together and analysed by either unofficial or official bodies. Regardless of the motivation behind the monitoring we may see that it results in altering individuals’ behaviour. With the continuous monitoring of individuals by CPS controlled by both government and non-state bodies, could this lead to an Orwellian scenario, where people change their behaviour out of fear of being watched? This idea poses a threat to CPS, as it can turn public opinion against them.

The ability to control CPS needs to be studied. Robot ethics is difficult to harmonise, as judgments of what is and what is not ethical involve knowledge of the context in question. The robots’ way of deciding which action is ethically correct in given circumstances will be similar to how a human would make this decision. The ability to make this decision will depend on how it is programmed, and we must therefore ask ourselves who should be responsible for programming these ethical guidelines.

Anticipatory law-making

In a world increasingly being shared with robots we will face legal questions regarding data ownership, privacy, safety and liability. Changes in and perhaps even the introduction of legislation to accommodate for the risks that robots pose will be required to ensure that citizens remain safe and secure.

CPS can improve the management of power and materials leading to a more secure environment. Systems’ abilities to shut down when not in use will help to reduce energy waste. Governments will in most cases need to introduce legislation to ensure that this is implemented.

The main legal question, which will arise alongside the development of autonomous robots, will be that of liability. Should an accident occur with a driverless car, who will be held responsible? Will it be the driver, the car or the manufacturer? Currently, some car manufacturers are taking responsibility for accidents that occur with their driverless cars. In Germany, Sweden and the UK, legislation has already been reviewed to allow for the testing of driverless cars on public highways. As it is expected that driverless cars will become commonplace in the future, countries will need to put in place appropriate legislation to protect their citizens.

With the large amount of information collected by CPS, improved and broader data protection laws should be sought. We will also need to examine who owns the data and within what framework it can be shared. Who amongst the individual, the organisation collecting the data and political institutions should be responsible for ensuring that the data is kept safe must also be agreed. We will need to examine existing and emerging data practices, and assess the risk of increased surveillance. The concept of privacy may need to be re-worked, and the concept of vulnerability in the context of CPS will need to be specified in this context.

Robots can increase our safety as seen through driverless cars, drones used for monitoring, embedded medical devices and robots used for disaster relief. Yet safety and liability concerns remain. Overall, the world should not become more unsafe due to the increased use of robots, but adequate legislation will be needed to ensure that the possible negative effects do not outweigh the positive ones.

A study on the ‘Ethics of Cyber Physical Systems’ has recently been published by the Science and Technology Options Assessment (STOA) Panel. A chapter of that study, written by Professor M. Henshaw (Loughborough University, UK) and J. van Barneveld, MSc (Technopolis Group, The Netherlands), has provided inspiration for this publication.

Read this Plenary At a Glance note on ‘What if I had to put my safety in the hands of a robot?‘ in PDF.

Subscribe to the Science and Technology Podcasts via:

About Scientific Foresight (STOA)

The Scientific Foresight Unit (STOA) carries out interdisciplinary research and provides strategic advice in the field of science and technology options assessment and scientific foresight. It undertakes in-depth studies and organises workshops on developments in these fields, and it hosts the European Science-Media Hub (ESMH), a platform to promote networking, training and knowledge sharing between the EP, the scientific community and the media. All this work is carried out under the guidance of the Panel for the Future of Science and Technology (STOA), composed of 25 MEPs nominated by nine EP Committees. The STOA Panel forms an integral part of the structure of the EP.

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Download the EPRS App

EPRS App on Google Play
EPRS App on App Store
What Europe Does For You
EU Legislation in Progress
Topical Digests
EPRS Podcasts

Enter your email address to follow this blog and receive notifications of new posts by email.

Join 3,047 other followers

RSS Link to Scientific Foresight (STOA)

Disclaimer and Copyright statement

The content of all documents (and articles) contained in this blog is the sole responsibility of the author and any opinions expressed therein do not necessarily represent the official position of the European Parliament. It is addressed to the Members and staff of the EP for their parliamentary work. Reproduction and translation for non-commercial purposes are authorised, provided the source is acknowledged and the European Parliament is given prior notice and sent a copy.

For a comprehensive description of our cookie and data protection policies, please visit Terms and Conditions page.

Copyright © European Union, 2014-2019. All rights reserved.

%d bloggers like this: