Leakage-Aware Ablation of Data Augmentation for Sugarcane Leaf Disease Classification: Operator- and Severity-Specific Effects
DOI:
https://doi.org/10.63158/journalisi.v8i5.1896Keywords:
Sugarcane leaf disease classification, data augmentation, dataset leakage, image deduplication, MobileNetV2Abstract
Conventional image augmentation is widely used to improve model generalization; however, its benefit in fine-grained plant disease classification can be overstated when duplicated or near-duplicated images cross the train–test boundary. This study tests whether conventional augmentation remains beneficial for sugarcane leaf disease classification after controlling duplicate leakage. The original Sugarcane Leaf Dataset contained 6,748 images and was audited using MD5, perceptual hash (pHash), and structural similarity index measure (SSIM), yielding 5,389 curated images. A leakage-aware stratified 70/15/15 train–validation–test split evaluated 13 augmentation configurations using ImageNet-pretrained MobileNetV2 across three random seeds, totaling 39 runs. Macro-F1 performance was assessed through paired stratified bootstrap analysis and an exact Page test. The baseline attained the highest mean Macro-F1 (0.9646 ± 0.0068), while photometric augmentation produced comparable performance (0.9643 ± 0.0079). Geometric policies generally reduced performance, and combined augmentation achieved the lowest Macro-F1 (0.8029). The Page test indicated an overall negative ordered trend, although the medium recipe outperformed the light recipe. These results demonstrate that augmentation policies must be validated by operator and severity level, rather than enabled by default in plant disease recognition.
Downloads
References
[1] S. Thite, Y. Suryawanshi, K. Patil, and P. Chumchu, “Sugarcane leaf dataset: A dataset for disease detection and classification for machine learning applications,” Data Brief, vol. 53, p. 110268, 2024, doi: 10.1016/j.dib.2024.110268.
[2] S. Srinivasan, S. M. Prabin, S. K. Mathivanan, H. Rajadurai, S. Kulandaivelu, and M. A. Shah, “Sugarcane leaf disease classification using deep neural network approach,” BMC Plant Biol., vol. 25, no. 1, p. 282, 2025, doi: 10.1186/s12870-025-06289-0.
[3] S. D. Daphal and S. M. Koli, “Enhancing sugarcane disease classification with ensemble deep learning: A comparative study with transfer learning techniques,” Heliyon, vol. 9, no. 8, p. e18261, 2023, doi: 10.1016/j.heliyon.2023.e18261.
[4] S. D. Daphal and S. M. Koli, “Enhanced deep learning technique for sugarcane leaf disease classification and mobile application integration,” Heliyon, vol. 10, no. 8, p. e29438, 2024, doi: 10.1016/j.heliyon.2024.e29438.
[5] M. Shoaib et al., “An advanced deep learning models-based plant disease detection: A review of recent research,” Front. Plant Sci., vol. 14, Art. no. 1158933, 2023, doi: 10.3389/fpls.2023.1158933.
[6] J. Liu and X. Wang, “Plant diseases and pests detection based on deep learning: a review,” Plant Methods, vol. 17, no. 1, p. 22, 2021, doi: 10.1186/s13007-021-00722-9.
[7] M. Sandler, A. Howard, M. Zhu, A. Zhmoginov, and L.-C. Chen, “MobileNetV2: Inverted Residuals and Linear Bottlenecks,” in 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2018, pp. 4510–4520. doi: 10.1109/CVPR.2018.00474.
[8] C. Shorten and T. M. Khoshgoftaar, “A survey on Image Data Augmentation for Deep Learning,” J. Big Data, vol. 6, no. 1, p. 60, 2019, doi: 10.1186/s40537-019-0197-0.
[9] M. Xu, S. Yoon, A. Fuentes, and D. S. Park, “A Comprehensive Survey of Image Augmentation Techniques for Deep Learning,” Pattern Recognit., vol. 137, p. 109347, 2023, doi: 10.1016/j.patcog.2023.109347.
[10] A. Buslaev, V. I. Iglovikov, E. Khvedchenya, A. Parinov, M. Druzhinin, and A. A. Kalinin, “Albumentations: Fast and Flexible Image Augmentations,” Information, vol. 11, no. 2, Art. no. 125, Feb. 2020, doi: 10.3390/info11020125.
[11] C. Gong, D. Wang, M. Li, V. Chandra, and Q. Liu, “KeepAugment: A Simple Information-Preserving Data Augmentation Approach,” in 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021, pp. 1055–1064. doi: 10.1109/CVPR46437.2021.00111.
[12] E. D. Cubuk, B. Zoph, J. Shlens, and Q. V. Le, “Randaugment: Practical automated data augmentation with a reduced search space,” in 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), IEEE, Jun. 2020, pp. 3008–3017. doi: 10.1109/CVPRW50498.2020.00359.
[13] S. G. Muller and F. Hutter, “TrivialAugment: Tuning-free Yet State-of-the-Art Data Augmentation,” in 2021 IEEE/CVF International Conference on Computer Vision (ICCV), IEEE, Oct. 2021, pp. 754–762. doi: 10.1109/ICCV48922.2021.00081.
[14] Y. Liu, S. Yan, L. Leal-Taixé, J. Hays, and D. Ramanan, “Soft Augmentation for Image Classification,” in 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023, pp. 16241–16250. doi: 10.1109/CVPR52729.2023.01558.
[15] M. Xu, S. Yoon, A. Fuentes, J. Yang, and D. S. Park, “Style-Consistent Image Translation: A Novel Data Augmentation Paradigm to Improve Plant Disease Recognition,” Front. Plant Sci., vol. 12, Art. no. 773142, 2022, doi: 10.3389/fpls.2021.773142.
[16] M. Xu et al., “Embracing limited and imperfect training datasets: opportunities and challenges in plant disease recognition using deep learning,” Front. Plant Sci., vol. 14, Art. no. 1225409, 2023, doi: 10.3389/fpls.2023.1225409.
[17] Q. H. Cap, H. Uga, S. Kagiwada, and H. Iyatomi, “LeafGAN: An Effective Data Augmentation Method for Practical Plant Disease Diagnosis,” IEEE Transactions on Automation Science and Engineering, vol. 19, no. 2, pp. 1258–1267, 2022, doi: 10.1109/TASE.2020.3041499.
[18] M. B. Diallo et al., “Enhanced-RICAP: a novel data augmentation strategy for improved deep learning-based plant disease identification and mobile diagnosis,” Front. Plant Sci., vol. 16, Art. no. 1646611, 2025, doi: 10.3389/fpls.2025.1646611.
[19] Y. Lu, D. Chen, E. Olaniyi, and Y. Huang, “Generative adversarial networks (GANs) for image augmentation in agriculture: A systematic review,” Comput. Electron. Agric., vol. 200, p. 107208, 2022, doi: 10.1016/j.compag.2022.107208.
[20] J. Dong et al., “Data-centric annotation analysis for plant disease detection: Strategy, consistency, and performance,” Front. Plant Sci., vol. 13, Art. no. 1037655, 2022, doi: 10.3389/fpls.2022.1037655.
[21] B. Barz and J. Denzler, “Do We Train on Test Data? Purging CIFAR of Near-Duplicates,” J. Imaging, vol. 6, no. 6, Art. no. 41, 2020, doi: 10.3390/jimaging6060041.
[22] I. E. Tampu, A. Eklund, and N. Haj-Hosseini, “Inflation of test accuracy due to data leakage in deep learning-based classification of OCT images,” Sci. Data, vol. 9, no. 1, p. 580, 2022, doi: 10.1038/s41597-022-01618-6.
[23] A. Aghabagherloo, A. Abadi, S. Sarkar, V. A. Dasu, and B. Preneel, “Impact of Data Duplication on Deep Neural Network-Based Image Classifiers: Robust vs. Standard Models,” in 2025 IEEE Security and Privacy Workshops (SPW), 2025, pp. 177–183. doi: 10.1109/SPW67851.2025.00023.
[24] B. Cassidy, C. Kendrick, A. Brodzicki, J. Jaworek-Korjakowska, and M. H. Yap, “Analysis of the ISIC image datasets: Usage, benchmarks and recommendations,” Med. Image Anal., vol. 75, p. 102305, 2022, doi: 10.1016/j.media.2021.102305.
[25] E. B. Page, “Ordered Hypotheses for Multiple Treatments: A Significance Test for Linear Ranks,” J. Am. Stat. Assoc., vol. 58, no. 301, pp. 216–230, 1963, doi: 10.2307/2282965.
[26] J. M. Johnson and T. M. Khoshgoftaar, “Survey on deep learning with class imbalance,” J. Big Data, vol. 6, no. 1, p. 27, 2019, doi: 10.1186/s40537-019-0192-5.
[27] H. He and E. A. Garcia, “Learning from Imbalanced Data,” IEEE Trans. Knowl. Data Eng., vol. 21, no. 9, pp. 1263–1284, 2009, doi: 10.1109/TKDE.2008.239.
[28] B. Efron and R. J. Tibshirani, An Introduction to the Bootstrap, 1st ed. Chapman and Hall/CRC, 1994. doi: 10.1201/9780429246593.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Journal of Information Systems and Informatics
This work is licensed under a Creative Commons Attribution 4.0 International License.
Author's Declaration
- The Authors certify that they have read, understood, and agreed to the Journal of Information Systems and Informatics (JournalISI) submission guidelines, policies, and submission declaration. The submission has been prepared using the provided template.
- The Authors certify that all authors have approved the publication of this manuscript and that there is no conflict of interest.
- The Authors confirm that the manuscript is their original work, has not received prior publication, is not under consideration for publication elsewhere, and has not been previously published.
- The Authors confirm that all authors listed on the title page have contributed significantly to the work, have read the manuscript, attest to the validity and legitimacy of the data and its interpretation, and agree to its submission.
- The Authors confirm that the manuscript is not copied from or plagiarized from any other published work.
- The Authors declare that the manuscript will not be submitted for publication in any other journal or magazine until a decision is made by the journal editors.
- If the manuscript is finally accepted for publication, the Authors confirm that they will either proceed with publication immediately or withdraw the manuscript in accordance with the journal’s withdrawal policies.
- The Authors agree that, upon publication of the manuscript in this journal, they transfer copyright or assign exclusive rights to the publisher, including commercial rights
