Multimodal fusion-based detection method of estrus cows using multisource data inspired by hidden Markov model algorithms
文献类型: 外文期刊
作者: Wang, Jun 1 ; Zhao, Yijia 1 ; Li, Xiaoxia 2 ; Zhou, Yu 3 ; Zhao, Kaixuan 4 ; Wang, Hui 5 ; Shakweer, Waleid Mohamed EL-Sayed 6 ;
作者机构: 1.Henan Univ Sci & Technol, Sch Informat Engn, Luoyang 471003, Henan, Peoples R China
2.Henan Univ Sci & Technol, Sch Anim Sci & Technol, Luoyang 471003, Henan, Peoples R China
3.Henan Univ Sci & Technol, Sch Med Technol & Engn, Luoyang 471003, Henan, Peoples R China
4.Henan Univ Sci & Technol, Sch Agr Equipment Engn, Luoyang 471003, Henan, Peoples R China
5.Chinese Acad Agr Sci, State Key Lab Anim Nutr, Inst Anim Sci, Beijing 100193, Peoples R China
6.Agr & Biol Res Inst, Natl Res Ctr, Cairo 12622, Egypt
关键词: Estrus detection; Statistical tests; Multimodal features; Feature fusion; neural network-optimized HMM
期刊名称:COMPUTERS AND ELECTRONICS IN AGRICULTURE ( 影响因子:8.9; 五年影响因子:9.3 )
ISSN: 0168-1699
年卷期: 2025 年 235 卷
页码:
收录情况: SCI
摘要: The combination of multimodal features based on vocalization and behavioral traits has been proven to enhance the robustness and accuracy of estrus detection. However, challenges still need to be addressed to improve the reliability and practicality of the identification of estrus cows, including unclear association mechanisms between multi-feature estrus traits and complex estrus states, inadequate feature selection and fusion strategies, and limitations in algorithm performance. To cope with these difficulties, the Friedman test, Mantel test, Spearman rank correlation coefficient, Kruskal-Wallis test, and Canonical Correspondence Analysis (CCA) were employed to explore the complex interactions among high-dimensional estrus data. Moreover, the model interpretability framework based on the self-attention mechanism was constructed to reveal the importance of critical features and optimize feature combinations. In addition, the multimodal fusion approach integrating standardization processing, principal component analysis, Fourier transform, statistical indicators extraction, and semi-tensor product was designed to elevate the depth of representation and the fusion effect of multidimensional data by comprehensively analyzing the relationships among various features. Furthermore, a neural network-optimized Hidden Markov Model (NN-HMM) for estrus detection was proposed to promote the capability of estrus detection by overcoming the imperfections of traditional HMM in capturing long distance dependence effect in state transition matrices, describing complex feature relationship in emission probability matrices, and dynamic adaptability of optimal path generation. The experimental results demonstrated that the selection of optimal feature combination integrating acoustic and behavioral features (number of bellowings, number of lowings, number of consecutive bellowings, vocalization frequency, standing duration, lying duration, walking duration, feeding duration, activity index, number of standing mounts, number of social behaviors, and ruminating variation index) improved estrus detection accuracy by over 18 % compared to using suboptimal feature combinations. Meanwhile, compared with Support Vector Machine (SVM), Convolutional Neural Network (CNN), and Long Short-Term Memory (LSTM) models, the accuracy of the developed multimodal fusion-based detection method increased by 8.8 %, 7.4 %, and 6.1 %, while the precision enhanced by 7.4 %, 6.0 %, and 4.3 %, respectively. Blind testing conducted on multisource estrus data from 24 multiparous and 16 primiparous cows found that the proposed prediction method advanced the prediction of estrus onset by up to 85 and 40 mins for primiparous cows and up to 75 and 60 mins for multiparous cows, respectively, significantly surpassing conventional activity index and acoustic-based methods. Therefore, the method proposed in this study undoubtedly provides a reliable solution for timely and efficient detection of estrus in dairy farms.
- 相关文献
作者其他论文 更多>>
-
The developments and prospects of plant super-pangenomes: Demands, approaches, and applications
作者:He, Wenchuang;Li, Xiaoxia;Qian, Qian;Shang, Lianguang;Qian, Qian;Shang, Lianguang;Qian, Qian;Qian, Qian;Shang, Lianguang
关键词:pangenomics; super-pangenome; plant; methodology; molecular breeding
-
Salt stress-related function of the oil body-associated protein gene LcOBAP2B in Leymus chinensis
作者:Di, Dong;Zhang, Ran;Li, Xiaoxia;Qi, Dongmei;Li, Qian;Cheng, Liqin;Wu, Zinian
关键词:Leymus chinensis; LcOBAP2B; Salt tolerance
-
Vertical flow immunoassay for multiplex mycotoxins based on photonic nitrocellulose and SERS nanotags
作者:Chen, Ruipeng;Wang, Hui;Chen, Yuxuan;Yang, Liang;Tang, Xiangfang;Xiong, Benhai;Zhao, Xiangwei;Zhao, Xiangwei;Hu, Jingfang;Li, Cheng;Kang, Haiqi
关键词:Surface-enhanced Raman scattering; Vertical flow assay; Photonic nitrocellulose (PNC); Slow-photon effect; Multiplex mycotoxin detection
-
Enzymatic synthesis of structured phospholipids with ideal w-6/3 fatty acid ratios via supplementation with α-linolenic acid from silkworm pupae oil
作者:Tan, Lu;Wang, Jin-Zheng;Wang, Xin-Ying;Yan, Cheng-Hai;Qu, Ya-Xin;Huang, Ze-Lai;Bai, Tao;Wang, Jun;Wang, Jun;Wang, Jun;Qian, Jun-Feng;Qian, Jun-Feng
关键词:Structured phospholipids; Silkworm pupae oil; alpha-linolenic acid; Functional foods
-
Comparative proteomic study of casein micelles in human and animal milks for infant nutrition improvement
作者:Ji, Zhongyuan;Yu, Zhongna;Du, Qijing;Fan, Rongbo;Wang, Jun;Han, Rongwei;Yang, Yongxin;Yu, Zhongna;Du, Qijing;Fan, Rongbo;Wang, Jun;Han, Rongwei;Yang, Yongxin;Ji, Zhongyuan
关键词:Human; Dairy animal; Milk casein micelles; Proteomics
-
Impact of Artificial Feed-Infused Nickel Nanoparticles Functionalized with Urease (Ni-Urease) on the Growth and Properties of Silkworms (Bombyx mori)
作者:Zhang, Zhan-Peng;Khurshid, Marriam;Li, Shi-Hua;Li, Yi-Jiang-Cheng;Quaye, Lydia;Herman, Richard Ansah;Wang, Jun;Herman, Richard Ansah;Wang, Jun;Wang, Jun
关键词:
Bombyx mori ; artificial feed; nickel nanoparticles; immobilized urease; silkfibers -
Fe3O4@Au magnetic SERS nanotags-based vertical flow immunoassay for simultaneous detection of fumonisin B1, aflatoxin B1 and deoxnivalenol
作者:Chen, Ruipeng;Wang, Hui;Chen, Yuxuan;Nan, Xuemei;Zhang, Fan;Yang, Liang;Tang, Xiangfang;Xiong, Benhai;Wu, Jianfeng;Li, Yongqi;Xie, Jianwei;Nisar, Muhammad Shemyal;Mao, Yu
关键词:Vertical flow assay (VFA); Fe 3 O 4 @Au; Magnetic SERS nanotags; Multiplex mycotoxins detection



