Citation: | YAO Yipeng, XU Chen, CHEN Hongji, et al. Estimation of pig body measurements based on keypoint detection and multi-object tracking[J]. Journal of South China Agricultural University, 2024, 45(5): 722-729. DOI: 10.7671/j.issn.1001-411X.202404012 |
To reduce the manual workload of measuring pig body measurements in pig farms and improve measurement accuracy and efficiency.
An automatic pig body measurement estimation method based on keypoint detection and multi-object tracking was proposed. The method utilized Yolov8-Pose model to identify keypoints and bounding boxes of individual pigs. ByteTrack algorithm was employed for real-time tracking of the pig herd. Regions of interest were introduced to mitigate image distortion and improve recognition speed. Additionally, a posture and anomaly detection filter algorithm was designed to reduce errors caused by motion blur, posture abnormality and other factors.
The mean absolute errors of the body length, shoulder width, and hip width of 24 pigs in five pigpens were less than 3 cm, the mean absolute percentage errors were maintained below 4%, 6% and 7% respectively. The data processing speed reached 19.3 frames/s.
The proposed method for pig body measurement estimation based on keypoint detection and multi-object tracking provides a lightweight and easily deployable solution for automatic body measurement in pig farming scenarios.
[1] |
NEETHIRAJAN S, KEMP B. Digital livestock farming[J]. Sensing and Bio-Sensing Research, 2021, 32: 100408. doi: 10.1016/j.sbsr.2021.100408
|
[2] |
李丹, 陈一飞, 李行健, 等. 计算机视觉技术在猪行为识别中应用的研究进展[J]. 中国农业科技导报, 2019, 21(7): 59-69.
|
[3] |
NASIRAHMADI A, EDWARDS S A, STURM B. Implementation of machine vision for detecting behaviour of cattle and pigs[J]. Livestock Science, 2017, 202: 25-38. doi: 10.1016/j.livsci.2017.05.014
|
[4] |
RANČIĆ K, BLAGOJEVIĆ B, BEZDAN A, et al. Animal detection and counting from UAV images using convolutional neural networks[J]. Drones, 2023, 7(3): 179. doi: 10.3390/drones7030179
|
[5] |
VAN DER ZANDE L E, GUZHVA O, RODENBURG T B. Individual detection and tracking of group housed pigs in their home pen using computer vision[J]. Frontiers in Animal Science, 2021, 2: 669312. doi: 10.3389/fanim.2021.669312
|
[6] |
SHAO W, KAWAKAMI R, YOSHIHASHI R, et al. Cattle detection and counting in UAV images based on convolutional neural networks[J]. International Journal of Remote Sensing, 2020, 41(1): 31-52. doi: 10.1080/01431161.2019.1624858
|
[7] |
TAHERI-GARAVAND A, FATAHI S, OMID M, et al. Meat quality evaluation based on computer vision technique: A review[J]. Meat Science, 2019, 156: 183-195. doi: 10.1016/j.meatsci.2019.06.002
|
[8] |
宋兰霞, 杨毅. 基于计算机视觉的肉质大理石花纹含量的测定[J]. 云南农业大学学报(自然科学版), 2011, 26(2): 246-248.
|
[9] |
尹令, 蔡更元, 田绪红, 等. 多视角深度相机的猪体三维点云重构及体尺测量[J]. 农业工程学报, 2019, 35(23): 201-208. doi: 10.11975/j.issn.1002-6819.2019.23.025
|
[10] |
郭浩, 张胜利, 马钦, 等. 基于点云采集设备的奶牛体尺指标测量[J]. 农业工程学报, 2014, 30(5): 116-122. doi: 10.3969/j.issn.1002-6819.2014.05.015
|
[11] |
郭浩, 马钦, 张胜利, 等. 基于三维重建的动物体尺获取原型系统[J]. 农业机械学报, 2014, 45(5): 227-232. doi: 10.6041/j.issn.1000-1298.2014.05.035
|
[12] |
王小品. 基于深度学习的多目标生猪的体尺关键点定位方法研究[D]. 武汉: 华中农业大学, 2023.
|
[13] |
刘同海, 滕光辉, 付为森, 等. 基于机器视觉的猪体体尺测点提取算法与应用[J]. 农业工程学报., 2013, 29(2): 161-168.
|
[14] |
ZHU X, LYU S, WANG X, et al. TPH-YOLOv5: Improved YOLOv5 based on transformer prediction head for object detection on drone-captured scenarios[C]//2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW). Montreal: IEEE, 2021. doi: 10.1109/iccvw54120.2021.00312.
|
[15] |
REDMON J, FARHADI A. Yolov3: An incremental improvement[EB/OL]. arXiv: 1804.02767 (2018-04-08) [2024-04-06]. https://doi.org/10.48550/arXiv.1804.02767.
|
[16] |
REDMON J, DIVVALA S, GIRSHICK R, et al. You only look once: Unified, real-time object detection[C]//2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Las Vegas: IEEE, 2016. doi: 10.1109/cvpr.2016.91.
|
[17] |
殷献博, 邓小玲, 兰玉彬, 等. 基于改进YOLOX-Nano算法的柑橘梢期长势智能识别[J]. 华南农业大学学报, 2023, 44(1): 142-150. doi: 10.7671/j.issn.1001-411X.202112039
|
[18] |
杨秋妹, 陈淼彬, 黄一桂, 等. 基于改进YOLO v5n的猪只盘点算法[J]. 农业机械学报, 2023, 54(1): 251-262. doi: 10.6041/j.issn.1000-1298.2023.01.025
|
[19] |
ZHANG Y F, SUN P Z, JIANG Y, et al. ByteTrack: Multi-object tracking by associating every detection box[EB/OL] arXiv: 2110.06864 (2021-10-13) [2024-04-06]. https://doi.org/10.48550/arXiv.2110.06864.
|
[20] |
ZHENG Z Y, LI J W, QIN L F. YOLO-BYTE: An efficient multi-object tracking algorithm for automatic monitoring of dairy cows[J]. Computers and Electronics in Agriculture, 2023, 209: 107857. doi: 10.1016/j.compag.2023.107857
|
[21] |
QIAN Z, CHEN X, JIANG H. Fish tracking based on YOLO and ByteTrack[C]. 2023 16th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI). Taizhou: IEEE, 2023.
|