University of Canterbury team reports 3D crop scans that model fruit hidden by foliage
University of Canterbury's UC Vision team has developed AI and computer-vision systems that digitally remove foliage from camera images to build 3D models of individual orchard and vineyard plants. The models can identify hidden apples, cherries and grapes, link them to branches or canes, measure them and track growth across repeat scans. The team reports fruit counts within about 2% to 3% of the correct figure in testing and is working toward reliable commercial tools through HoloCrop.
The story
University of Canterbury computer science professor Richard Green and the UC Vision team have developed a camera-and-AI system intended to identify and model fruit that is hidden behind dense foliage in vineyards and orchards. Rather than treating leaves as an unavoidable blind spot, the system uses cameras, lighting and a pipeline of AI systems to digitally remove foliage and reconstruct a 3D representation of each plant. According to the report, it can identify individual apples, cherries or grapes; show the branch or cane to which fruit is attached; and calculate size, volume and surface area. Repeat scans can follow the growth of an individual fruit. The group has built mobile camera rigs that travel along crop rows. Its vineyard system uses two rows of cameras to image through vine canopies, and its orchard system can scan trees around 3.5 meters high. In testing, the team says its fruit counts were within about 2% to 3% of the correct figure. It has collected 3D-modeling data from 20 commercial farms and is now focusing on reliability ahead of potential commercialization through HoloCrop. The source describes robotic pruning, thinning, spraying, harvesting and size-based cherry picking as possible later applications, not as tasks already performed by the system.
Why it matters
Crop estimates influence operational choices made before harvest, including how many workers to schedule and how much packaging and storage capacity to arrange. UC Vision says manual sampling, counting and measuring can produce inaccuracies of up to 23%; a more accurate count could therefore reduce mismatches between expected and actual crop volumes. Plant-by-plant measurements may also help growers sort planning around fruit size, which the source notes can affect cherry value. These are prospective operational benefits, however, and not evidence yet of savings or waste reductions achieved in commercial use.
Evidence and context
The work addresses a persistent constraint in horticulture automation: fruit and plant structures are often obscured by dense leaves, while individual trees and vines vary rather than conforming to a fixed factory layout. UC Vision combines cameras, lighting and multiple AI systems to remove foliage digitally and reconstruct plant models. Its mobile systems scan along orchard and vineyard rows; the orchard configuration can scan trees about 3.5 meters tall, while the vineyard setup uses two rows of cameras. The project builds on about 15 years of University of Canterbury research backed by more than $32 million in government investment in computer vision, AI and agricultural robotics.
Limits and unknowns
The reported accuracy is limited to fruit-count testing: the source says counts were within about 2% to 3% of the correct figure, but does not provide the number of scans, crop-specific results, comparison method or error ranges for size and volume measurements. It also does not document commercial deployment, costs, performance across seasons, or whether the system maintains accuracy in every orchard and vineyard condition. Reliability remains an unresolved next step as the team prepares for potential commercialization.
Follow the story
Share it, watch the explainer, or continue with the reporting trail.
University of Canterbury team reports 3D crop scans that model fruit hidden by foliage
A short visual explainer for readers who want the story in a different rhythm.
Highlights
- AI digitally removes foliage to model fruit in 3D
- AI identifies and measures fruit hidden behind leaves
- Fruit counts accurate within 2% to 3% in tests
- Better crop data improves operational planning
Transcript
The UC Vision team developed AI that digitally removes leaves to create 3D fruit models in orchards.
Their system identifies individual apples, cherries, and grapes, linking fruit to branches and measuring size.
Testing shows fruit counts within 2% to 3% accuracy, outperforming manual sampling errors up to 23%.
Accurate crop data helps growers plan workers, packaging, and storage more efficiently before harvest.
The team continues improving reliability aiming for commercial use through HoloCrop technology soon.