CLOVES-4603: Benchmarking Classical Texture Features and Fine-Tuned Deep Models for Clove Quality Grading
Abstract
We introduce CLOVES-4603, the first public benchmark dataset for automated clove quality grading, comprising 4,603 standardized 224x224 RGB images spanning four commercial grades collected at the Zanzibar State Trading Corporation (ZSTC). We benchmark classical texture pipelines (HOG+SVM, GLCM+GLRLM+LBP fusion) against fine-tuned deep learning models including ResNet-50, MobileNetV3, and a frozen DINOv2 vision transformer. ResNet-50 achieves 99.67% accuracy on the test set, whereas texture-fusion SVM reaches 92.94%, providing a strong and deployment-friendly classical baseline. This benchmark informs real-world deployment trade-offs between accuracy, latency, and computational cost in agricultural settings where infrastructure is limited.
Key Findings & Contributions
- Introduces CLOVES-4603, the first open benchmark dataset of 4,603 lot-aware stratified images spanning four ISO 2254-2004 / ZSTC commercial clove quality grades collected in Zanzibar.
- Establishes rigorous 5-seed evaluation protocols with bootstrap 95% confidence intervals comparing classical texture descriptors, self-supervised vision transformers, and fine-tuned CNNs.
- Demonstrates that combined GLCM+GLRLM+LBP texture fusion with RBF-SVM achieves 92.94% test accuracy without GPUs, outperforming HOG+SVM (32.68%) by +60.26 percentage points.
- Profiles accuracy-latency-parameter Pareto trade-offs showing MobileNetV3-Large reaches 99.35% accuracy as a mobile-ready alternative to ResNet-50 (99.67%).
Key Empirical Figure
Benchmark Results
CLOVES-4603 Five-Paradigm Test Benchmark (n = 921 Held-Out Images)
| Method / Architecture | Test Accuracy (%) | Training Mode / Features |
|---|---|---|
| ResNet-50 | 99.67% | Fine-tuned ImageNet CNN (99.66% F1) |
| MobileNetV3-Large | 99.35% | Lightweight edge-deployable CNN |
| DINOv2 ViT-B/14 | 94.90% | Frozen self-supervised linear probe |
| GLCM + GLRLM + LBP SVM | 92.94% | Classical 96-dim texture fusion |
| HOG + SVM | 32.68% | Shape-gradient classical baseline |
BibTeX
@inproceedings{nyalala2026cloves4603,
title={CLOVES-4603: Benchmarking Classical Texture Features and Fine-Tuned Deep Models for Clove Quality Grading},
author={Nyalala, Innocent and Vincent, Patrick Ndowo},
booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops -- Vision for Agriculture (CV4A)},
year={2026},
url={https://openreview.net/pdf?id=V1UbAtXS4M}
} Nyalala, I., & Vincent, P. N. (2026). CLOVES-4603: Benchmarking Classical Texture Features and Fine-Tuned Deep Models for Clove Quality Grading. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops (V4A). https://openreview.net/pdf?id=V1UbAtXS4M