About
Welcome to the 1st Meeting on the Assessment of Robotic Capabilities (ARC), co-located with the 40th International Conference on Robotics and Automation (ICRA 2023).
In the same way policy makers make use of economic indicators – such as GDP, unemployment or inflation rates – to get a sense of countries’ economic and social health and design appropriate interventions, high-level indicators describing what AI can or cannot do yet are missing. In order to respond to the challenges posed by the development of AI and robotics over time, arise the urge to develop a set of valid measures describing AI and robotics capabilities.
This meeting will present and refine a set of proposed measures of robotics capabilities developed for policy makers. Its ultimate goal will be to present policy makers a comprehensive picture of AI capabilities in robotics and offer a reflection on the ways it might affect work and education.
“Although AI and robotics evaluations for policymakers will not be designed for the computer science community, they need to be designed in large part by the computer science community.” Hence, speakers from the robotics community will offer a novel view on robotics state of the art by proposing a set of performance levels from key areas of robotics capability – navigation/mobility, manipulation/dexterity, perception, communication/language, learning/adaption – and connect those levels to relevant robotics benchmarks. By gathering together robotics researchers from diverse areas and policy makers, the workshop will encourage participants to engage in rich conversations and exchange of ideas in order to build a valid and coherent system of measure for robotics capabilities.
The outcome of the meeting will have a long-term impact on the AI and Future of Skills project. Outcomes from discussions and exchange of ideas will be incorporated in OECD future reports and work to develop a set of measures of AI and robotics capabilities for policy makers. Moreover, this workshop will be the occasion for the project to enlarge its multi-disciplinary expert community to robotics experts willing to contribute to this work.
Call for Participation
The goal of this session is to develop assessments of AI and robotics capabilities, in order to help policy makers understand their strengths/limitations and to prepare for future international education; the format of the meeting will be a series of panel discussions and breakout conversations.
We invite wide participation from students, scientists, researchers, policymakers, corporate and public management, engineers, as well as general practitioners in the fields of robotics.
If you are interested in contributing to this meeting, please fill out this form (https://bit.ly/arc-icra2023).
This meeting is free-of-charge for ICRA 2023 attendees and will be an in-person event.
Event
Date: 31 May 2023
Venue: ExCel London Center; London, UK
Location: Room 24, South Gallery Rooms
Directions: Directions to Room 24 in South Gallery: In the first floor, go to S9, “Competition Hall / Access to South Gallery Rooms”. Go cross the competition room all the way to the back; take a lift to the second floor. Room 24 is in the hallway.
Schedule
The event will take place on Wednesday, 31 May, 2023. All times are in UK Time (GMT+1); current time is .
Welcome / Presentaton
Stuart Elliot (OECD)
Breakout session
Jean Oh (CMU)
Full group discussion
Jean Oh (CMU)
Panel Discussion
Holly Yanco, Frank Chongwoo Park, Britta Rüschoff, Patrick C. Kyllonen, Alessandra Sciutti, Tetsunari Inamura, Ding Zhao, Sebastian Scherer, Martial Hebert
Conclusion
Stuart Elliot (OECD)
Panelists
Martial Hebert
Carnegie Mellon University
Holly Yanco
UMass Lowell
Patrick C. Kyllonen
Educational Testing Service
Britta Rüschoff
FOM University
Alessandra Sciutti
Italian Institute of Technology
Tetsunari Inamura
Tamagawa University
Frank Chongwoo Park
Seoul National University
Ding Zhao
Carnegie Mellon University
Sebastian Scherer
Carnegie Mellon University
Organisers
Jean Oh
Associate Research Professor in the Robotics Institute at Carnegie Mellon University (CMU); Director of the Bot Intelligence Group at CMU
Stuart Elliott
Senior Analyst at the Organisation for Economic Cooperation and Development (OECD); Project Lead, AI and the Future of Skills project
Jonathan Francis
Senior Research Scientist at the Bosch Center for Artificial Intelligence; affiliated researcher, Robotics Institute, CMU
Cherie Ho
Ph.D. student in the Robotics Institute at CMU, studying field robotics, computer vision, and machine learning
Peter Schaldenbrand
Ph.D. student in the Robotics Institute at CMU, studying Creative Artificial Intelligence
Vihaan Misra
Ph.D. student in the Robotics Institute at CMU, studying image synthesis techniques for Creative AI
Abel Baret
Research Assistant in the AI and Future of Skills project at OECD.
Margarita Kalamova
Lead Analyst in the AI and the Future of Skills project at OECD; Project Lead, Higher Education Policy team
Uksang Yoo
Ph.D. student in the Robotics Institute at CMU, studying soft robotics manipulators
Beverley-Claire Okogwu
M.S. student in the Robotics Institute at CMU