The European Robotics Forum has become the most influential meeting of the robotics community in Europe since it was firstly celebrated in 2010 in San Sebastian. This year’s edition will take place in the city of Tampere, Finland 13-15 March 2018, where it is expected the assistance of 1,000 European robotics experts.
It is a perfect framework to discuss about current societal and technical themes related to the field of robotics such as human-robot-collaboration or how robotics can improve industrial productivity and service sector operations. It is also an important opportunity to show the most important advances produced in the robotics field. In this sense, the EUROBENCH project will have its own Workshop “A unified scientific framework for robotics benchmarking: not a dream” where we will create a unique opportunity to identify strategic priorities and get in contact with interested Third Parties and stakeholders.
What is the purpose of EUROBENCH?
Since human-centred robots such as exoskeletons, humanoids, prostheses, are becoming increasingly relevant worldwide and many prototypes are moving out of the lab into everyday applications, in a wide range of market domains, the Robotic Research Agenda has emphasized benchmarking as an important instrument to assess the Technology Readiness Level (TRL) and to quantify how robotic solutions match user needs.
However, a consolidated benchmarking methodology for Robotics has not been reached yet. Current benchmarking approaches are focused on generic, goal-level performance indicators, which can hardly describe performance in sufficient detail to allow recognizing and quantifying the technical causes of performance. To fill these gaps, the EUROBENCH project will create the first European framework for the application of benchmarking methodology on robotic systems. The framework, specifically focused on bipedal robotic technologies, will include methods and tools to measure robotics performance on a rigorous, quantitative and replicable way. The successful achievement of this goal will put Europe at the forefront of the evaluation of robotic systems, facilitating the process of bringing innovative robotic technologies forward to market.
The EUROBENCH project will offer funding opportunities to external entities, a.k.a. Third Parties, to participate in the development and validation of the different components (both Hardware and Software) of this unified framework. In this regard, the aim of this workshop is to involve the Robotic Community in the process of building up the new benchmarking framework, bolstered over the development of two facilities and one software.
The EUROBENCH Workshop at ERF 2018
The workshop “A unified scientific framework for robotics benchmarking: not a dream” will be organized in groups that will report the entire audience with the main conclusions, which will be then collected by the organizers and taken as a starting point towards a European roadmap for benchmarking. And the outcomes from group discussions will be collected by the organizers and taken as a starting point towards a European roadmap for benchmarking. All this information will be made available publicly on the “benchmarking bipedal locomotion” website and on the EUROBENCH website.
The groups of discussions will be on the following aspects:
- Users’ needs: what do we really expect (want) from benchmarking?
- The System Abilities: are we talking the same language? (how to make System Ability Levels really quantifiable)
- A unified framework: similarities and differences across domains
- To compete or not to compete? That is the question… (the role of competition as benchmarking tool)
10:45 – 11:15 Introduction and presentation from EUROBENCH Coordinator (Diego Torricelli) and PO (Anne Bajart)
11:15 – 11:45 Discussion in sub-groups (brainstorming & synthesis)
11:45 – 12:10 Reporting by group moderators and general discussion with the audience
12:10 – 12:15 Wrap up