A vegetable-picking robot that uses machine learning to identify and harvest a commonplace, but challenging, agricultural crop has been developed by engineers.
The ‘Vegebot’, developed by a team at the University of Cambridge, was initially trained to recognise and harvest iceberg lettuce in a lab setting. It has now been successfully tested in a variety of field conditions in cooperation with G’s Growers, a local fruit and vegetable co-operative.
Although the prototype is nowhere near as fast or efficient as a human worker, it demonstrates how the use of robotics in agriculture might be expanded, even for crops like iceberg lettuce which are particularly challenging to harvest mechanically. The results are published in The Journal of Field Robotics.
Crops such as potatoes and wheat have been harvested mechanically at scale for decades, but many other crops have to date resisted automation. Iceberg lettuce is one such crop. Although it is the most common type of lettuce grown in the UK, iceberg is easily damaged and grows relatively flat to the ground, presenting a challenge for robotic harvesters.
“Every field is different, every lettuce is different,” said co-author Simon Birrell from Cambridge’s Department of Engineering. “But if we can make a robotic harvester work with iceberg lettuce, we could also make it work with many other crops.”
“At the moment, harvesting is the only part of the lettuce life cycle that is done manually, and it’s very physically demanding,” said co-author Julia Cai, who worked on the computer vision components of the Vegebot while she was an undergraduate student in the lab of Dr Fumiya Iida.
The Vegebot first identifies the ‘target’ crop within its field of vision, then determines whether a particular lettuce is healthy and ready to be harvested, and finally cuts the lettuce from the rest of the plant without crushing it so that it is ‘supermarket ready’. “For a human, the entire process takes a couple of seconds, but it’s a really challenging problem for a robot,” said co-author Josie Hughes.
The Vegebot has two main components: a computer vision system and a cutting system. The overhead camera on the Vegebot takes an image of the lettuce field and first identifies all the lettuces in the image, and then for each lettuce, classifies whether it should be harvested or not. A lettuce might be rejected because it’s not yet mature, or it might have a disease that could spread to other lettuces in the harvest.
The researchers developed and trained a machine learning algorithm on example images of lettuces. Once the Vegebot could recognise healthy lettuces in the lab, it was then trained in the field, in a variety of weather conditions, on thousands of real lettuces.
A second camera on the Vegebot is positioned near the cutting blade and helps ensure a smooth cut. The researchers were also able to adjust the pressure in the robot’s gripping arm so that it held the lettuce firmly enough not to drop it, but not so firm as to crush it. The force of the grip can be adjusted for other crops.
“We wanted to develop approaches that weren’t necessarily specific to iceberg lettuce so that they can be used for other types of above-ground crops,” said Iida, who leads the team behind the research.
In future, robotic harvesters could help address problems with labour shortages in agriculture, and could also help reduce food waste. At the moment, each field is typically harvested once, and any unripe vegetables or fruits are discarded. However, a robotic harvester could be trained to pick only ripe vegetables, and since it could harvest around the clock, it could perform multiple passes on the same field, returning at a later date to harvest the vegetables that were unripe during previous passes.
“We’re also collecting lots of data about lettuce, which could be used to improve efficiency, such as which fields have the highest yields,” said Hughes. “We’ve still got to speed our Vegebot up to the point where it could compete with a human, but we think robots have lots of potential in agri-tech.”
Iida’s group at Cambridge is also part of the world’s first Centre for Doctoral Training (CDT) in agri-food robotics. In collaboration with researchers at the University of Lincoln and the University of East Anglia, the Cambridge researchers will train the next generation of specialists in robotics and autonomous systems for application in the agri-tech sector. The Engineering and Physical Sciences Research Council (EPSRC) has awarded £6.6m for the new CDT, which will support at least 50 PhD students.
Learn more: Robot uses machine learning to harvest lettuce
The Latest on: Robotic harvesting
via Google News
The Latest on: Robotic harvesting
- Stevie the 'social' robot that was recently featured on the cover of Time Magazine holds BINGO lessons for OAPs in a care homeon November 27, 2019 at 9:20 am
Stevie the robot is so advanced he was recently named one of the best inventions of 2019 ... Launched in June the satellite is flying while using only light as fuel by harvesting the force photos ...
- Leading robotics VCs talk about where they’re investingon November 26, 2019 at 9:56 am
It’s the perfect recipe for robotic opportunity. I’m intrigued by agricultural robots. I’ve seen dozens of companies attacking every part of the farming equation – from field clearing and preparation, ...
- Husky UGV turns over a new leafon November 26, 2019 at 4:22 am
A team of researchers from Clemson University’s Edisto Research and Education Center — Christina Chiu, Dennis Daly II and Joe Mari Maja, is looking to adopt mobile robot platforms specifically for ...
- Tribune editorial: Robots help surgeons reduce recovery time, minimize opioid useon November 24, 2019 at 10:00 pm
The robot, which costs between $1.5 million and $2.1 million ... s been made worse by unfair retaliatory tariffs on U.S. agriculture as well as two consecutive years of adverse planting, growing and ...
- Robot dog begins work on San Francisco airport projecton November 22, 2019 at 4:56 am
Boston Dynamics, the US company best known for creating Spot, the robot dog, has formed a partnership with three other tech companies ... you would have to sacrifice time out of a busy day to harvest ...
- As military robots gain traction, ethical-use guidelines emergeon November 20, 2019 at 12:53 pm
Then, in the back, in trace of your patrol, you can have another robot carrying your extra water, ammo, or batteries.” Military robots on the ground will require a lot of batteries or some form of ...
- Welding robot set to 'revolutionise' pipeline repairon November 20, 2019 at 2:13 am
The FSWBot is a friction stir welding robotic crawler for internal repair and refurbishment of pipelines ... An onboard turbine in a duct within the FSWBot will harvest energy from the oil flow within ...
- Exeger and ABB to build ‘light harvesting material’ fab in Swedenon November 19, 2019 at 8:19 pm
as well as robotics. Fili said the facility will be ten times bigger than the company’s existing plant and said he hopes it will open around 2023. Exeger’s ‘light-harvesting material’ – the ...
- Google’s Totally Creepy, Totally Legal Health-Data Harvestingon November 14, 2019 at 2:00 pm
Read: The robot will see you now Creating tailored medical treatments for countless patients at scale requires an enormous amount of data that need to be standardized, tested for accuracy and bias, ...
- Venus Concept Completes Merger With Restoration Robotics and Combined Company Raises $28 Million in Private Placementon November 7, 2019 at 7:42 am
Venus Concept's hair restoration division includes NeoGraft, an automated hair restoration system that facilitates the harvesting of follicles during a FUE process and the ARTAS® and ARTAS iX™ Robotic ...
via Bing News