Modelling of nitrogen content estimation in cotton based on UAV ‘Spectrum-Image’ data fusion
DOI:
https://doi.org/10.15835/nbha53414781Keywords:
cotton, data fusion, digital image, hyperspectral, nitrogen, UAVAbstract
Nitrogen is crucial for crop growth, development, yield, and quality. Traditional nutrition monitoring relies on single data sources; however, spatial coverage and information limitations hamper the accuracy of such monitoring methods. The recently developed unmanned aerial vehicle (UAV) remote sensing technology has emerged as an efficient and convenient method of crop nutrition monitoring, which allows the integration of data from sources, such as hyperspectral and digital images, resulting in comprehensive and multi‐angular insights. This study is aimed at enhancing crop monitoring accuracy by integrating multiple data types obtained at the UAV scale, using ‘Xinluzao 53’ cotton as an experimental subject. Nitrogen content was obtained via hyperspectral and digital imaging and the features of the two data sources analyzed by constructing four machine learning models: Ridge (RR), back-propagation neural network (BPNN), random forest (RF), and Bagging, which were integrated with the multilevel data fusion methods to obtain nutrition information. The results indicated optimal efficacy for RF together with the UAV ‘spectrum-image’ feature-level fusion framework, with a validation set R2 of 0.915 and RMSE of 1.562, while the optimal decision-level fusion framework was found to be Bagging, with a validation set R2 of 0.923 and RMSE of 1.488. UAV-based ‘spectral-image’ multilevel fusion frameworks were found to enhance the accuracy of monitoring, with the optimum decision-level fusion evaluation indices providing crucial theoretical support for precision agriculture in the future.
References
Anami BS, Malvade NN, Palaiah S (2020). Classification of yield affecting biotic and abiotic paddy crop stresses using field images. Information Processing in Agriculture 7(2):272-285. https://doi.org/10.1016/j.inpa.2019.08.005
Anas M, Liao F, Verma KK, Sarwar MA, Mahmood A, Chen ZL, Li Q, Zeng XP, Liu Y, Li YR (2020). Fate of nitrogen in agriculture and environment: Agronomic, eco-physiological and molecular approaches to improve nitrogen use efficiency. Biological Research 53(1):47. https://doi.org/10.1186/s40659-020-00312-4
Blekanov I, Molin A, Zhang D, Mitrofanov E, Mitrofanova O, Li Y (2023). Monitoring of grain crops nitrogen status from UAV multispectral images coupled with deep learning approaches. Computers and Electronics in Agriculture 212:108047. https://doi.org/10.1016/j.compag.2023.108047
Cuaran J, Leon J (2021). Crop monitoring using unmanned aerial vehicles: A review. Agricultural Reviews 42(2):121-132. https://doi.org/10.18805/ag.R-180
Cui H, Bing Y, Zhang X, Wang Z, Li L, Miao A (2022). Prediction of maize seed vigor based on first-order difference characteristics of hyperspectral data. Agronomy 12(8):1899. https://doi.org/10.3390/agronomy12081899
Ding Y, Qin S, Ma L, Chen X, Yao Q, Yang M, Ma Y, Lv X, Zhang Z (2022). A study on cotton yield prediction based on the chlorophyll fluorescence parameters of upper leaves. Notulae Botanicae Horti Agrobotanici Cluj-Napoca 50(3):12775. https://doi.org/10.15835/nbha50312775
Espejo-Garcia B, Malounas I, Mylonas N, Kasimati A, Fountas S (2022). Using EfficientNet and transfer learning for image-based diagnosis of nutrient deficiencies. Computers and Electronics in Agriculture 196:106868. https://doi.org/10.1016/j.compag.2022.106868
Gamba P, Chanussot J (2008). Foreword to the special issue on data fusion. IEEE Transactions on Geoscience and Remote Sensing 46(5):1283-1288. https://doi.org/10.1109/TGRS.2008.919761
Hajabdollahi M, Esfandiarpoor R, Najarian K, Karimi N, Samavi S, Reza Soroushmehr SM (2019). Hierarchical pruning for simplification of convolutional neural networks in diabetic retinopathy classification. In: 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE, Berlin, Germany pp 970-973. https://doi.org/10.1109/EMBC.2019.8857769
Hall DL, Llinas J (1997). An introduction to multisensor data fusion. Proceedings of the IEEE 85(1):6-23. https://doi.org/10.1109/5.554205
Lee KJ, Lee BW (2013). Estimation of rice growth and nitrogen nutrition status using color digital camera image analysis. European Journal of Agronomy 48:57-65. https://doi.org/10.1016/j.eja.2013.02.011
Li H, Li D, Xu K, Cao W, Jiang X, Ni J (2022). Monitoring of nitrogen indices in wheat leaves based on the integration of spectral and canopy structure information. Agronomy 12(4):833. https://doi.org/10.3390/agronomy12040833
Liu Y, Chen Y, Wen M, Lu Y, Ma F (2023). Accuracy comparison of estimation on cotton leaf and plant nitrogen content based on UAV digital image under different nutrition treatments. Agronomy 13(7):1686. https://doi.org/10.3390/agronomy13071686
Peng J, Manevski K, Kørup K, Larsen R, Andersen MN (2021a). Random forest regression results in accurate assessment of potato nitrogen status based on multispectral data from different platforms and the critical concentration approach. Field Crops Research 268:108158. https://doi.org/10.1016/j.fcr.2021.108158
Peng Y, Wang L, Zhao L, Liu Z, Lin C, Hu Y, Liu L (2021b). Estimation of soil nutrient content using hyperspectral data. Agriculture 11(11):1129. https://doi.org/10.3390/agriculture11111129
Qiao M, Xia G, Xu Y, Cui T, Fan C, Li Y, Han S, Qian J (2024). Generic prediction model of moisture content for maize kernels by combing spectral and color data through hyperspectral imaging. Vibrational Spectroscopy 131:103663. https://doi.org/10.1016/j.vibspec.2024.103663
Qin S, Ding Y, Zhou T, Zhai M, Zhang Z, Fan M, Lv X, Zhang Z, Zhang L (2024) “Image-Spectral” fusion monitoring of small cotton samples nitrogen content based on improved deep forest. Computer and Electronics in Agriculture 221:109002. https://doi.org/10.1016/j.compag.2024.109002
Qin S, Ren H, Chen S, Ding Y, Li H, Lv X, Zhang Z, Zhang L (2025). Deep learning time-series prediction method for cotton nitrogen content based on small sample hyperspectral data. Industrial Crops and Products 233:121467. https://doi.org/10.1016/j.indcrop.2025.121467
Shi H, Guo J, An J, Tang Z, Wang X, Li W, Zhao X, Jin L, Xiang Y, Li Z, Zhang F (2023). Estimation of chlorophyll content in soybean crop at different growth stages based on optimal spectral index. Agronomy 13(3):663. https://doi.org/10.3390/agronomy13030663
Song J, Shi X, Wang H, Lv X, Zhang W, Wang J, Li T, Li W (2024). Improving soil quality index prediction by fusion of Vis-NIR and pXRF spectral data. Geoderma 447:116938. https://doi.org/10.1016/j.geoderma.2024.116938
Sun L, Yang C, Wang J, Cui X, Suo X, Fan X, Ji P, Gao L, Zhang Y (2024a). Automatic modeling prediction method of nitrogen content in maize leaves based on machine vision and CNN. Agronomy 14(1):124. https://doi.org/10.3390/agronomy14010124
Sun T, Li Z, Wang Z, Liu Y, Zhu Z, Zhao Y, Xie W, Cui S, Chen G, Yang W, Zhang Z, Zhang F (2024b). Monitoring of nitrogen concentration in soybean leaves at multiple spatial vertical scales based on spectral parameters. Plants 13(1):140. https://doi.org/10.3390/plants13010140
Wang H, Dai Y, Yao Q, Ma L, Zhang Z, Lv X (2025). Multi-task learning model driven by climate and remote sensing data collaboration for mid-season cotton yield prediction. Field Crops Research 333:110070. https://doi.org/10.1016/j.fcr.2025.110070
Wang KR, Pan WC, Li SK, Chen B, Xiao H, Wang FY, Chen JL (2011). Monitoring models of the plant nitrogen content based on cotton canopy hyperspectral reflectance. Spectroscopy And Spectral Analysis 31(7):1868-1872. https://doi.org/10.3964/j.issn.1000-0593(2011)07-1868-05
Wu J, Bai T, Li X (2024). Inverting chlorophyll content in jujube leaves using a back-propagation neural network–random forest–ridge regression algorithm with combined hyperspectral data and image color channels. Agronomy 14(1):140. https://doi.org/10.3390/agronomy14010140
Yang J, Gong W, Shi S, Du L, Sun J, Song SL (2016). Estimation of nitrogen content based on fluorescence spectrum and principal component analysis in paddy rice. Plant, Soil and Environment 62(4):178-183. https://doi.org/10.17221/802/2015-PSE
Yao Q, Wang H, Zhang Z, Qin S, Ma L, Chen X, Wang H, Wang L, Lü X (2025). Estimation model of potassium content in cotton leaves based on hyperspectral information of multi-leaf position. Journal of Integrative Agriculture 24(11):4225-4241. https://doi.org/10.1016/j.jia.2024.03.012
Yin C, Lv X, Zhang L, Ma L, Wang H, Zhang L, Zhang Z (2022). Hyperspectral UAV images at different altitudes for monitoring the leaf nitrogen content in cotton crops. Remote Sensing 14(11):2576. https://doi.org/10.3390/rs14112576
Zhang J, Cheng T, Shi L, Wang W, Niu Z, Guo W, Ma X (2022). Combining spectral and texture features of UAV hyperspectral images for leaf nitrogen content monitoring in winter wheat. International Journal of Remote Sensing 43(7):2335-2356. https://doi.org/10.1080/01431161.2021.2019847
Zhang LZ, Wang DW, Zhang YM, Cheng YS, Li HJ, Hu CS (2010). Diagnosis of N nutrient status of corn using digital image processing technique. Chinese Journal of Eco-Agriculture 18(6):1340-1344. https://doi.org/10.3724/SP.J.1011.2010.01340
Zhou X, Yang M, Chen X, Ma L, Yin C, Qin S, Wang L, Lv X, Zhang Z (2023). Estimation of cotton nitrogen content based on multi-angle hyperspectral data and machine learning models. Remote Sensing 15(4):955. https://doi.org/10.3390/rs15040955
Zhu W, Rezaei EE, Nouri H, Sun Z, Li J, Yu D, Siebert S (2022). UAV-based indicators of crop growth are robust for distinct water and nutrient management but vary between crop development phases. Field Crops Research 284:108582. https://doi.org/10.1016/j.fcr.2022.108582
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Mengxin FAN, Shizhe QIN, Fan JIANG, Yufan YI, Hang LI, Cheng ZHANG, Wenxing BAI, Wenkai WANG, Ying WANG, Zhigang WANG, Xin LV, Ze ZHANG, Qiang ZHANG, Lulu MA
This work is licensed under a Creative Commons Attribution 4.0 International License.
License:
Open Access Journal:
The journal allows the author(s) to retain publishing rights without restriction. Users are allowed to read, download, copy, distribute, print, search, or link to the full texts of the articles, or use them for any other lawful purpose, without asking prior permission from the publisher or the author.
.png)
