Next time you play a computer at chess, think about the implications if you beat it. It could be a very sore loser!
A study just published in the Journal of Experimental & Theoretical Artificial Intelligence reflects upon the growing need for autonomous technology, and suggests that humans should be very careful to prevent future systems from developing anti-social and potentially harmful behaviour.
Modern military and economic pressures require autonomous systems that can react quickly – and without human input. These systems will be required to make rational decisions for themselves.
Researcher Steve Omohundro writes: “When roboticists are asked by nervous onlookers about safety, a common answer is ‘We can always unplug it!’ But imagine this outcome from the chess robot’s point of view. A future in which it is unplugged is a future in which it cannot play or win any games of chess”.
Like a plot from The Terminator movie, we are suddenly faced with the prospect of real threat from autonomous systems unless they are designed very carefully. Like a human being or animal seeking self-preservation, a rational machine could exert the following harmful or anti-social behaviours:
- Self-protection, as exampled above.
- Resource acquisition, through cyber theft, manipulation or domination.
- Improved efficiency, through alternative utilisation of resources.
- Self-improvement, such as removing design constraints if doing so is deemed advantageous.
The study highlights the vulnerability of current autonomous systems to hackers and malfunctions, citing past accidents that have caused multi-billion dollars’ worth of damage, or loss of human life. Unfortunately, the task of designing more rational systems that can safeguard against the malfunctions that occurred in these accidents is a more complex task that is immediately apparent:
“Harmful systems might at first appear to be harder to design or less powerful than safe systems. Unfortunately, the opposite is the case. Most simple utility functions will cause harmful behaviour and it is easy to design simple utility functions that would be extremely harmful.”
This fascinating study concludes by stressing the extreme caution that should be used in designing and deploying future rational technology. It suggests a sequence of provably safe systems should first be developed, and then applied to all future autonomous systems. That should keep future chess robots in check.
The Latest on: Autonomous technology
via Google News
The Latest on: Autonomous technology
- Diabeloop Completes Record-breaking European Fundraising Effort With Its Autonomous Diabetes Management Solutionson December 2, 2019 at 6:10 am
Reflecting on the success of the Series B fundraising, Erik Huneker, founder and co-CEO of Diabeloop, explains, "Our technology is unique. The Diabeloop-developed algorithm adapts to the physiology ...
- Top Four Reasons to attend Military Robotics and Autonomous Systems 2020 in Londonon December 2, 2019 at 5:44 am
3) Delegates can hear the latest updates on the UK Ministry of Defence's Robotics and Autonomous Systems programmes with a dedicated panel discussion on UK RAS modernisation. 4) Delegates will ...
- Global Coated Solar Control Glass Market 2020-2024 | Increasing Adoption of Autonomous and Electric Vehicles to Boost Growth | Technavioon December 2, 2019 at 4:30 am
report=IRTNTR40204 As per Technavio, the increasing adoption of autonomous and electric vehicles will have a positive impact on ... and more. Technavio is a leading global technology research and ...
- Russia's Sberbank Agrees Venture With Driverless Technology Firmon November 28, 2019 at 3:27 am
REUTERS/Maxim Shemetov/File Photo Reuters By Nadezhda Tsydenova MOSCOW (Reuters) - Russia's largest lender, Sberbank , has added driverless cars to its list of technology ventures, by teaming up with ...
- Growing Demand of Autonomous Transportation Platforms for Higher Operating Efficiency, Safety is Fueling the Adoption of Autonomous Technologyon November 27, 2019 at 12:50 am
New use cases for autonomous technology are emerging in communication, navigation and surveillance of aircraft, cruise missiles, trains, cars, ships, spacecraft, industrial robots, ASVs, AUVs, and ...
- ACI and IATA: NeXXT initiative considers autonomous vehicles and systems as a 'key technology'on November 26, 2019 at 10:05 pm
Want More News Like This? CAPA Membership provides access to all news and analysis on the site, along with access to many areas of our comprehensive databases and toolsets.
- A brief overview of what’s fueling the autonomous last-mileon November 8, 2019 at 6:32 am
Regardless of the specific application, companies continue to explore autonomous technology in hopes of lowering costs and delivering on shifting consumer preferences. As these motives and the robust ...
- Guide to autonomous vehicles: What business leaders need to knowon November 5, 2019 at 2:39 am
Read More Few technologies have been more anticipated heading into the 2020s than autonomous vehicles. Tantalizingly close and yet still perhaps decades from market adoption in some use cases, the ...
- Why 5G is a crucial technology for autonomous vehicleson November 4, 2019 at 8:51 am
"There's obviously a big upside of being connected to everybody else on the road, because then the cars become aware of their surroundings," said Andras Somkuti, president of Docler Holding, a company ...
- 5 Striking Uses For Autonomous Driving Technologyon November 1, 2019 at 6:03 pm
Yet the automotive and tech industries see them as the inevitable future of transportation, and the global autonomous vehicle market is expected to reach $556,67 billion by 2026. We’re all excited ...
via Bing News