基于图像处理和三维点云的荔枝表型参数提取

    Extraction of phenotypic parameters of litchi based on image processing and three-dimensional point cloud

    • 摘要:
      目的 荔枝Litchi chinensis的表型参数提取对荔枝采后分级具有重要作用,为解决荔枝采后分级效率低下的问题,本文提出了一种利用图像处理和三维点云技术的荔枝表型参数提取方法,一次性获取多种表型性状。
      方法 利用Intel Realsense D405深度传感器同时获取4个不同视角下的荔枝RGB彩色图像和深度图像,通过映射得到荔枝三维点云;根据获取的荔枝点云,计算点云曲率及法向量,识别荔枝机械损伤区域;将荔枝的RGB彩色图像在颜色空间下进行转换,判断红色像素点阈值并提取荔枝表面的红色着色率;建立荔枝的3D模型,通过计算深度图像的厚度估算荔枝体积。
      结果 通过荔枝表面三维点云的曲率成功识别荔枝的机械损伤,平均检测准确率为94%;采用RGB图像提取着色率相较于采用三维点云在检测速度上提升90%,基于RGB图像和三维点云的着色率结果与人工检测结果的决定系数分别为0.95740.9205,平均绝对误差分别为6.33%和4.37%,平均相对误差分别为4.17%和6.01%。基于深度图像提取的荔枝体积与人工测量体积的决定系数为0.8901,平均绝对误差为1.59 cm3,平均相对误差为7.94%。
      结论 本研究提出的方法能够提高荔枝表型参数提取的准确率,可为荔枝采后分级提供高效技术手段和数据支持。

       

      Abstract:
      Objective The extraction of Litchi chinensis (litchi) phenotypic parameters is essential for postharvest grading. In order to solve the low efficiency problems of litchi postharvest grading, a method of extracting litchi phenotypic parameters by image processing and three-dimensional point cloud technology was proposed, to obtain a variety of phenotypic traits at one time.
      Method The Intel Realsense D405 depth sensor was used to obtain the RGB color image and depth image of litchi under four different angles at the same time, and the three-dimensional point cloud of litchi was obtained by mapping. According to the obtained litchi point cloud, the point cloud curvature and normal vector were calculated, and the mechanical damage area of litchi was identified. The RGB color image of litchi was converted in color space, and the red coloration rate of litchi surface was extracted by judging the threshold of red pixels. The 3D model of litchi was established, and the volume value of litchi was estimated by calculating the thickness of the depth image.
      Result The mechanical injury of litchi could be identified successfully by the curvature of the three-dimensional point cloud on the surface of litchi, with the average detection accuracy of 94%. Compared with the method based on three-dimensional point cloud, the method of extracting coloration rate by using RGB color improved the detection speed by 90%. The determination coefficients between the coloring rate results based on RGB images and 3D point clouds and the manual detection results were 0.9574 and 0.9205, the average absolute errors were 6.33% and 4.37%, and the mean relative errors were 4.17% and 6.01%, respectively. The determination coefficient between litchi volume measured by depth image extration and hand was 0.890 1, the average absolute error was 1.59 cm3, and the average relative error was 7.94%.
      Conclusion The method proposed in this study can improve the accuracy of litchi phenotypic parameters extraction, and provide efficient technical means and data support for postharvest grading of litchi.

       

    /

    返回文章
    返回