The Australian Centre for Robotic Vision Team ACRV won the 2017 Amazon Robotics Challenge last night at RoboCup in Nagoya Japan. For winning the finals, the Centre, headquartered at Queensland University of Technology (QUT), will receive $80,000USD.
The skills challenge attracted sixteen teams of researchers from ten countries to compete. Two teams represented Australia, with teams tasked to build their own hardware and software to successfully pick and stow items in a warehouse.
While Amazon is able to quickly package and ship millions of items to customers from their network of fulfillment centers, the commercial technologies to solve automated picking in unstructured environments are yet to be developed.
Eight teams made it through to the finals, with the Australian Centre for Robotic Vision placing fifth after the picking and stowing rounds.
“It was a tense few hours,” according to the Centre’s COO Dr Sue Keay, “our team top scored early with 272 points on the final combined stowing and picking task but we then had to wait on the results for five other teams, many of whom had outperformed us in the rounds, before it became clear that we had won.”
“Not bad for a robot that was only unpacked and reassembled out of suitcases a few days before the event, and after the setback of a broken robot arm in the rounds.”
The Australian Centre for Robotic Vision developed their own Cartesian robot “Cartman” for the challenge, “we were the only team with a Cartesian robot at the event. Cartman was definitely a large reason for our success”, said team leader Dr Juxi Leitner from QUT.
Cartman, can move along three axes at right angles to each other, like a gantry crane, and featured a rotating gripper that allowed the robot to pick up items using either suction or a simple two-finger grip.
Some people heralded the team’s win to the use of a custom-made robot. Team leader Juxi describes the advantages of the design, “with six degrees of articulation and both a claw and suction gripper, Cartman gives us more flexibility to complete the tasks than most robots can offer. Cartman is robust and tackles the task in an innovative way and is also cost effective. We learnt from our experience last year when we used an off-the-shelf robot. I think we had the lowest cost robot at the event!”
Fifteen members of the Centre’s 27-strong team of researchers, sourced from QUT, The University of Adelaide and the Australian National University, were in Japan for the event.
“We feel brilliant, we say thank you very much for all the support we’ve received. The competition was a lot of work but really rewarding and a lot of fun,” says Adam Tow, a PhD researcher with the Centre, based at QUT. The team invested more than 15,000 hours into the project.
The time and effort paid off according to Dr Chris Lehnert, a roboticist at QUT, “Everything from the robot design, vision systems and grasping system worked flawlessly in the finals. The competition was tough, so many of the improbable scenarios that we thought would never occur did occur.”
The Challenge combined object recognition, pose recognition, grasp planning, compliant manipulation, motion planning, task planning, task execution, and error detection and recovery. The robots were scored by how many items they successfully picked and stowed in a fixed amount of time.
“We are world leaders in robotic vision and we’re pushing the boundaries of computer vision and machine learning to complete these tasks in an unstructured environment,” says Juxi.
Cartman’s vision system was the result of hours of training data and training time, according to Dr Anton Milan, from The University of Adelaide. “We had to create a robust vision system to cope with objects that we only got to see during the competition.”
“Our vision system had the perfect trade-off of training data, training time and accuracy. One feature of our system was that it worked off a very small amount of hand annotated training data. We only needed just seven images of each unseen item for us to be able to detect them.”
University of Adelaide team member Dr Trung Pham agrees, “one of the most important factors contributing to the team’s success was the seamless integration of world-leading robotics and vision. Our robot uses deep learning to see robustly and acts reliably due to smart design. The competition was a fantastic chance for us to truly test our state-of-the-art algorithms as well as opening up new real-world challenges that go beyond academic research.”
“It feels amazing to have accomplished this” says Anton. “Excellent team effort. Looking at the overall performance across all teams, we see huge advances in robotics and AI. We definitely have very exciting times ahead of us.”
For more information, please visit www.roboticvision.org
Centre Team Members (alphabetically)
About the Australian Centre for Robotic Vision
The Australian Centre for Robotic Vision is an ARC Centre of Excellence (www.arc.gov.au) that leads the world in the new discipline of robotic vision, applying computer vision to robotics. The Centre is an unincorporated collaborative venture between interdisciplinary researchers from leading Australian and international research organisations; QUT, The University of Adelaide, The Australian National University (ANU), and Monash University, CSIRO (Data61), the French Institute for Research in Computer Science and Automation (INRIA) Rennes, Georgia Institute of Technology, Imperial College London, the Swiss Federal Institute of Technology (ETH) Zürich, and the University of Oxford.
Media Contact: Tim Macuga 0478 571 226 firstname.lastname@example.org
Australian Centre for Robotic Vision
2 George Street Brisbane, 4001
+61 7 3138 7549