Special Meeting on Assessment of Robotics Capabilities

Co-Located at ICRA 2023


About

Welcome to the 1st Meeting on the Assessment of Robotic Capabilities (ARC), co-located with the 40th International Conference on Robotics and Automation (ICRA 2023).

In the same way policy makers make use of economic indicators – such as GDP, unemployment or inflation rates – to get a sense of countries’ economic and social health and design appropriate interventions, high-level indicators describing what AI can or cannot do yet are missing. In order to respond to the challenges posed by the development of AI and robotics over time, arise the urge to develop a set of valid measures describing AI and robotics capabilities.

This meeting will present and refine a set of proposed measures of robotics capabilities developed for policy makers. Its ultimate goal will be to present policy makers a comprehensive picture of AI capabilities in robotics and offer a reflection on the ways it might affect work and education.

“Although AI and robotics evaluations for policymakers will not be designed for the computer science community, they need to be designed in large part by the computer science community.” Hence, speakers from the robotics community will offer a novel view on robotics state of the art by proposing a set of performance levels from key areas of robotics capability – navigation/mobility, manipulation/dexterity, perception, communication/language, learning/adaption – and connect those levels to relevant robotics benchmarks. By gathering together robotics researchers from diverse areas and policy makers, the workshop will encourage participants to engage in rich conversations and exchange of ideas in order to build a valid and coherent system of measure for robotics capabilities.

The outcome of the meeting will have a long-term impact on the AI and Future of Skills project. Outcomes from discussions and exchange of ideas will be incorporated in OECD future reports and work to develop a set of measures of AI and robotics capabilities for policy makers. Moreover, this workshop will be the occasion for the project to enlarge its multi-disciplinary expert community to robotics experts willing to contribute to this work.

Call for Participation

The goal of this session is to develop assessments of AI and robotics capabilities, in order to help policy makers understand their strengths/limitations and to prepare for future international education; the format of the meeting will be a series of panel discussions and breakout conversations.

We invite wide participation from students, scientists, researchers, policymakers, corporate and public management, engineers, as well as general practitioners in the fields of robotics.

If you are interested in contributing to this meeting, please fill out this form (https://bit.ly/arc-icra2023).

This meeting is free-of-charge for ICRA 2023 attendees and will be an in-person event.

Event

Date: 31 May 2023
Venue: ExCel London Center; London, UK
Location: Room 24, South Gallery Rooms
Directions: Directions to Room 24 in South Gallery: In the first floor, go to S9, “Competition Hall / Access to South Gallery Rooms”. Go cross the competition room all the way to the back; take a lift to the second floor. Room 24 is in the hallway.

Schedule

The event will take place on Wednesday, 31 May, 2023. All times are in UK Time (GMT+1); current time is .

Time
Event
Content
09:00

Welcome / Presentaton

Stuart Elliot (OECD)

Objectives for creating a set of measures of AI capabilities related to robotics
09:30

Breakout session

Jean Oh (CMU)

 
10:20

Full group discussion

Jean Oh (CMU)

 
11:00

Panel Discussion

Holly Yanco, Frank Chongwoo Park, Britta Rüschoff, Patrick C. Kyllonen, Alessandra Sciutti, Tetsunari Inamura, Ding Zhao, Sebastian Scherer, Martial Hebert

How to Assess Robotics Capabilities In the Wild?
12:30

Conclusion

Stuart Elliot (OECD)

What did we learn and how can we improve it?

Panelists

Organisers

Jean Oh

Jean Oh

Associate Research Professor in the Robotics Institute at Carnegie Mellon University (CMU); Director of the Bot Intelligence Group at CMU

Stuart Elliott

Stuart Elliott

Senior Analyst at the Organisation for Economic Cooperation and Development (OECD); Project Lead, AI and the Future of Skills project

Jonathan Francis

Jonathan Francis

Senior Research Scientist at the Bosch Center for Artificial Intelligence; affiliated researcher, Robotics Institute, CMU

Cherie Ho

Cherie Ho

Ph.D. student in the Robotics Institute at CMU, studying field robotics, computer vision, and machine learning

Peter Schaldenbrand

Peter Schaldenbrand

Ph.D. student in the Robotics Institute at CMU, studying Creative Artificial Intelligence

Vihaan Misra

Vihaan Misra

Ph.D. student in the Robotics Institute at CMU, studying image synthesis techniques for Creative AI

Abel Baret

Abel Baret

Research Assistant in the AI and Future of Skills project at OECD.

Margarita Kalamova

Margarita Kalamova

Lead Analyst in the AI and the Future of Skills project at OECD; Project Lead, Higher Education Policy team

Uksang Yoo

Uksang Yoo

Ph.D. student in the Robotics Institute at CMU, studying soft robotics manipulators

Beverley-Claire Okogwu

Beverley-Claire Okogwu

M.S. student in the Robotics Institute at CMU

Sponsors