AN INTELLIGENT PLANT MONITORING AND EARLY WARNING SYSTEM BASED
Abstract
The present study is aimed at systematizing scientific knowledge about diseases of agricultural crops with the subsequent integration of the data obtained into automated agricultural production management systems. The relevance of the work is due to the need to minimize economic losses in crop production through early diagnosis of pathologies and optimization of phytosanitary control. As part of the study, a classification of plant diseases was carried out.The basil plant (Ocimum basilicum L.), characterized by high susceptibility to phytopathogens under intensive cultivation conditions, was chosen as a model object. To create an automated diagnostic tool, a specialized dataset was collected, including 214 images of basil at various stages of vegetation. The shooting was carried out under controlled conditions using an RGB camera. Each sample is annotated with the localization of damage and the affected area. Special attention is paid to the methodological aspects of the formation of data banks for biological systems. It has been established that the key problems are the high variability of morphological features in plants, the influence of environmental factors on the visual manifestations of diseases. Based on the analysis of the data obtained, the architecture of the early warning system is proposed, which includes three modules: a sensor unit – small cameras and microclimate sensors. The algorithmic block is a neural network model for semantic image segmentation and algorithms for assessing the dynamics of pathology development. The decision – making and notification interface provides recommendations for adjusting irrigation regimes, applying pesticides and trace elements. The convolutional neural network is trained based on the YOLOv11 framework using data augmentation methods (Gaussian noise, affine transformations) and transfer learning. Validation of the model on the test sample showed a detection accuracy of 74.7% (F1-score = 0.72). To reduce false positives, postprocessing of predictions has been implemented, taking into account the spatial and temporal correlation of the data. The developed prototype demonstrates the potential of integrating computer vision and agronomy to create predictive control systems. Further research is planned to expand the dataset and increase parametrs, as well as the introduction of data processing algorithms on edge devices to reduce delays in decision-making. The results obtained can be adapted for other indoor crops, which contributes to the development of precision agriculture and reduces anthropogenic stress on agroecosystems
References
1. Anantrasirichai N., Hannuna S., Canagarajah N. Towards automated mobile-phone-based plant pathology
management, arXiv preprint arXiv:1912.09239, 2019.
2. Abade A., Ferreira P. A., de Barros Vidal F. Plant diseases recognition on images using convolutional neural
networks: A systematic review, Computers and Electronics in Agriculture, 2021, Vol. 185, pp. 106125.
3. Kozarenko V.A. Metody raspoznavaniya meditsinskikh izobrazheniy v zadachakh komp'yuternoy
diagnostiki [Methods of medical image recognition in computer diagnostics tasks], Elektronnaya biblioteka
Gomel'skogo gosudarstvennogo universiteta [Electronic Library of Gomel State University]. Available at:
https://elib.gsu.by/bitstream/123456789/11756/1/Kozar_Recognition_methods_for_medical.pdf.
4. Smirnov A.V., Ivanova E.P. Effektivnost' svertochnykh neyronnykh setey razlichnoy arkhitektury dlya
zadachi diagnostiki depressii po dannym EEG [The effectiveness of convolutional neural networks of
various architectures for the task of diagnosing depression according to EEG data], Izvestiya
Saratovskogo universiteta [Proceedings of the Saratov University], 2023. Available at:
zadachi-diagnostiki.
5. Petrov K.S., Orlov A.D. Razrabotka avtomatizirovannykh algoritmov komp'yuternogo zreniya dlya
obrabotki meditsinskikh izobrazheniy [Development of automated computer vision algorithms for medical
image processing], KiberLeninka [CyberLeninka], 2022. Available at: https://cyberleninka.ru/article/
n/razrabotka-avtomatizirovannyh-algoritmov-kompyuternogo-zreniya-dlya-obrabotki-meditsinskihizobrazheniy.
6. Luo M. and Rhodes P. A study of digital camera colorimetric characterisation based on polynomial
modeling, Color Research and Application, 2001, 26, pp. 76-84.
7. Hannuna S., Kunkel T., Anantrasirichai N., Canagarajah N. Colour Correction for Assessing Plant
Pathology Using Low Quality Cameras, Proceedings of the International Conference on Bioinformatics
Models, Methods and Algorithms, 2011, pp. 326-331.
8. Wang Z., Chi Z. and Feng D. Shape based leaf image retrieval, IEE Proc of Vision, Image and Signal
Processing, 2003, 150, pp. 34-43.
9. Anantrasirichai N., Hannuna Sion, Canagarajah Nishan. Automatic Leaf Extraction from Outdoor
Images, arXiv:1709.06437.
10. Arkhipov A.G., Kosogor S.N., Motorin O.A., Gorbachev M.I., Suvorov G.A., Truflyak E.V. Tsifrovaya
transformatsiya sel'skogo khozyaystva Rossii [Digital transformation of agriculture in Russia]. Moscow:
FGBNU «Rosinformagrotekh», 2019, 80 p.
11. Zhukov A.O., Kulikov A.K., Kartsan I.N. Optimization of the control algorithm for heterogeneous robotic
agricultural monitoring tools, IOP Conference Series: Earth and Environmental Science.
Vol. 839, Innovative Development of Agrarian-and-Food Technologies, 2021. Sci. 839 032039. DOI:
10.1088/1755-1315/839/3/032039.
12. Zhukov A.O., Kulikov A.K., Surovtseva E.K. Razrabotka algoritma raspredeleniya zadach v gruppe
geterogennykh robototekhnicheskikh sredstv na osnove ekonomicheskikh mekhanizmov [Development
of an algorithm for distributing tasks in a group of heterogeneous robotic tools based on economic
mechanisms], Robototekhnika i tekhnicheskaya kibernetika [Robotics and Technical Cybernetics],
2018. Available at: https://doi.org/10.31776/RTCJ.6405.
13. Rumiantsev B., Dzhatdoeva S., Sadykhov E., Kochkarov A. A Model for the Determination of Potato
Tuber Mass by the Measurement of Carbon Dioxide Concentration, Plants, 2023, 12, 2962. Available
at: https://doi.org/10.3390/plants12162962в.
14. Rumiantsev B., Dzhatdoeva S., Zotov V., Kochkarov A. Analysis of the Potato Vegetation Stages Based
on the Dynamics of Water Consumption in the Closed Urban Vertical Farm with Automated Microclimate
Control, Agronomy, 2023, 13, 954. Available at: https://doi.org/10.3390/agronomy13040954.
15. Rumiantsev B.V., Kochkarov R.A., Kochkarov A.A. Graph-Clustering Method for Construction of the
Optimal Movement Trajectory under the Terrain Patrolling, Mathematics, 2023, 11, 223. Available at:
https://doi.org/10.3390/math11010223.
16. Kochkarov A.A., Kulikov A.K., Rumyantsev B.V. Opyt primeneniya i perspektivy ispol'zovaniya
iskusstvennogo intellekta v oblasti agrobiotekhnologiy [Experience of using state intelligence in industry.
Microbiological], Gorizonty matematicheskogo modelirovaniya i teoriya samoorganizatsii. K 95-
letiyu so dnya rozhdeniya S.P. Kurdyumova [Horizons of mathematical modeling and theory of selforganization.
On the 95th anniversary of S.P. Kurdyumov's birth]. Moscow: IPM im. M.V. Keldysha,
2024, pp. 144-153. Available at: https://doi.org/10.20948/k95-8.
17. Altieri M. Agroecology: The Science of Sustainable Agriculture. CRC Press, Endereço. 2nd ed. February
2018.
18. Sharada P. Mohanty, David P. Hughes, and Marcel Salathé. Using deep learning for image-based
plant disease detection, Frontiers in Plant Science, 2016, 7:1419.
19. Sally A. Miller, Fen D. Beed, and Carrie Lapaire Harmon. Plant Disease Diagnostic Capabilities and
Networks, Annual Review of Phytopathology, Sep 2009, 47 (1), pp. 15-38.
20. Anne-Katrin Mahlein. Plant disease detection by imaging sensors – parallels and specific demands for
precision agriculture and plant phenotyping, Plant Disease, 2016, 100 (2), pp. 241-251