3D reconstruction of fruit trees and fruit semantic segmentation based on NeRF and improved RandLA-Net
ObjectiveTo solve the problem of accurate fruit segmentation in complex orchard environment. MethodA novel method for 3D reconstruction citrus fruit trees and fruit semantic segmentation of was proposed. First, the implicit 3D representation of the fruit tree was learned from multi-view images using...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | Chinese |
| Published: |
South China Agricultural University
2025-07-01
|
| Series: | Huanan Nongye Daxue xuebao |
| Subjects: | |
| Online Access: | https://journal.scau.edu.cn/article/doi/10.7671/j.issn.1001-411X.202410015 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Summary: | ObjectiveTo solve the problem of accurate fruit segmentation in complex orchard environment. MethodA novel method for 3D reconstruction citrus fruit trees and fruit semantic segmentation of was proposed. First, the implicit 3D representation of the fruit tree was learned from multi-view images using the neural radiance field (NeRF) technology, generating high-quality point cloud models of the fruit tree. Then, the improved random local point cloud feature aggregation network (RandLA-Net) was adopted to conduct end-to-end semantic segmentation of the fruit tree point cloud, accurately extracting the fruit point cloud. In this study, targeted improvements were made to RandLA-Net. A bilateral enhancement module was added after the encoder layer, and a loss function more suitable for the fruit point cloud segmentation task was adopted. The improved segmentation network was verified using the citrus fruit tree dataset.Result The results showed that the proposed method could effectively reconstruct the 3D structure of fruit tree. The average intersection over union (mIoU) of the improved network increased by 2.64 percentage points, and the intersection over union (IoU) of the fruit increased by 7.33 percentage points, verifying the practicality of this method in the scenario of smart orchards. Conclusion This study provides a new technical support for achieving intelligent management and automated fruit harvesting in orchards. |
|---|---|
| ISSN: | 1001-411X |