16.422 Human Supervisory Control Social implications Massachusetts Institute of Technology
Social Implications 16.422 Human Supervisory Control
Advantages of automation 16.422 · Improve efficiency productivity Task performance reliability Human safety both operators public Remote operations Reduction of human labor Technological advancements Improved quality of lif He ealth care Leisure But there are some problems Massachusetts Institute of Technology
• Improve: – Efficiency & productivity – Task performance & reliability • Human safety, both operators & public – Remote operations • Reduction of human labor • Technological advancements • Improved quality of life – Health care – Leisure • But there are some problems…. 16.422 Advantages of Automation
Automation issues for the individual 16.422 Employment Centralization of management Identity resocialization Work dissatisfaction Supervising as opposed to interactive control Technological (il)literacy Deskilling Responsibility accountability Trust and biases It will always be far easier to make a robot of a man rather that to make a robot like a man (Engelberger 1981) Massachusetts Institute of Technology
Automation Issues for the Individual • Employment – Centralization of management – Identity & desocialization • Work dissatisfaction – Supervising as opposed to interactive control • Technological (il)literacy • Deskilling • Responsibility & accountability – Trust and biases • “It will always be far easier to make a robot of a man rather that to make a robot like a man.” (Engelberger 1981) 16.422
Problems with automation for society 16.422 “ Technological imperative” Technological determinism as opposed to social construction Productivity VS. meaningfulness °Iele- governance Feed forward versus feedback Privacy Cell phones, automobiles, employee monitoring Reduced social contact Massachusetts Institute of Technology
Problems with Automation for Society • “Technological imperative” – Technological determinism as opposed to social construction • Productivity vs. meaningfulness • Tele-governance – Feed forward versus feedback – Privacy • Cell phones, automobiles, employee monitoring • Reduced social contact 16.422
More problems with automation 16.422 System complexity cost Affects both the individual and groups Group diffusion of accountability Impact on natural resources Tele-robotic spIt les Over-trusting technology Smart weapons Massachusetts Institute of Technology
More Problems with Automation… • System complexity & cost – Affects both the individual and groups • Group diffusion of accountability • Impact on natural resources • Tele-robotic spies • Over-trusting technology • Smart weapons 16.422
A Comparison of Nuclear vs Command control domains 16.422 Factor山 Domain Nuclear power plant Command control Start-up Only when conditions are normal a response to an unexpected problem Shutdown Automatic on abnormality Hard to stop once started Experience Hundreds of plant years Very little personne Semi-permanent High turnover Error records Public Simulation Accidents can be simulated Difficult to do in realistic settings Goal state Control nature Control intelligent opponent Scientific analysis Open Secret
A Comparison of Nuclear vs. Command & Control Domains Factor\Domain Nuclear Power Plant Command & Control Start-up Only when conditions are normal A response to an unexpected problem Shutdown Automatic on abnormality Hard to stop once started Experience Hundreds of plant years Very little Personnel Semi-permanent High turnover Error records Public Secret Simulation Accidents can be simulated Difficult to do in realistic settings Goal state Control nature Control intelligent opponent Scientific analysis Open Secret 16.422
Automation weapons in the Future
Automation & Weapons in the Future
Proposed Tactical Tomahawk Missions Default Mission Flex mission PHp Emergent Mission Time-critical P (emergent) Target DT
Proposed Tactical Tomahawk Missions L P H Emergent Mission p Default Mission P T Flex Mission G W A T B P D T L Time-critical (emergent) Target
Controlling Multiple autonomous Vehicles/Weapons In-Flight rk erH franta Cre DIslceasefud Denot NOtar Iwiltfectar 34且26 2442 315:231 tal Requeed w:M Aaa weisses V whitee Ness回mm lAst FaF bf lager A用围知畔B a Drte Mowm voay NSD) Re12-w. lowet p. tm rate C回 Shea Mas Carvel Retargeting Display Monitor Map Massachusetts Institute of Technology
Controlling Multiple Autonomous Vehicles/Weapons In-Flight Retargeting Display Monitor Map
Resistance to Killing as a Function of Distance HIGHA SEXUAL RANGE HAND- TO-HAND-COMBAT RANGE KNIFE RANGE BAYONET RANGE CLOSE RANGE (PISTOL/RIFLE) HANDGRENADE RANGE MID-RANGE (RIFLE) LONG RANGE (SNIPER, ANTI-ARMOR MISSILES, ETC. MAX RANGE ( BOMBER CLOSE PHYSICAL DISTANCE FROM TARGET FAR Massachusetts Institute of Technology
Resistance to Killing as a Function of Distance