Iqbal Usama, Li Daoliang, Du Zhuangzhuang, Akhter Muhammad, Mushtaq Zohaib, Qureshi Muhammad Farrukh, Rehman Hafiz Abbad Ur
National Innovation Center for Digital Fishery, Beijing 100083, China.
Key Laboratory of Smart Farming Technologies for Aquatic Animal and Livestock, Ministry of Agriculture and Rural Affairs, Beijing 100083, China.
Animals (Basel). 2024 Jun 5;14(11):1690. doi: 10.3390/ani14111690.
Understanding the feeding dynamics of aquatic animals is crucial for aquaculture optimization and ecosystem management. This paper proposes a novel framework for analyzing fish feeding behavior based on a fusion of spectrogram-extracted features and deep learning architecture. Raw audio waveforms are first transformed into Log Mel Spectrograms, and a fusion of features such as the Discrete Wavelet Transform, the Gabor filter, the Local Binary Pattern, and the Laplacian High Pass Filter, followed by a well-adapted deep model, is proposed to capture crucial spectral and spectral information that can help distinguish between the various forms of fish feeding behavior. The Involutional Neural Network (INN)-based deep learning model is used for classification, achieving an accuracy of up to 97% across various temporal segments. The proposed methodology is shown to be effective in accurately classifying the feeding intensities of , enabling insights pertinent to aquaculture enhancement and ecosystem management. Future work may include additional feature extraction modalities and multi-modal data integration to further our understanding and contribute towards the sustainable management of marine resources.
了解水生动物的摄食动态对于水产养殖优化和生态系统管理至关重要。本文提出了一个基于频谱图提取特征与深度学习架构融合的鱼类摄食行为分析新框架。原始音频波形首先被转换为对数梅尔频谱图,接着提出融合离散小波变换、伽柏滤波器、局部二值模式和拉普拉斯高通滤波器等特征,随后采用一个适配良好的深度模型,以捕捉有助于区分各种鱼类摄食行为形式的关键频谱和谱信息。基于内卷神经网络(INN)的深度学习模型用于分类,在各个时间段内实现了高达97%的准确率。所提出的方法被证明在准确分类[具体鱼类名称缺失]的摄食强度方面是有效的,能够提供与水产养殖强化和生态系统管理相关的见解。未来的工作可能包括额外的特征提取模式和多模态数据整合,以进一步增进我们的理解,并为海洋资源的可持续管理做出贡献。