Classification of Crops through Self-Supervised Decomposition for Transfer Learning


  • J. Jayanth Department of Electronics and Communication Engineering, GSSS Institute of Engineering & Technology for Women, Mysore-570016, Karnataka, India
  • H. K. Ravikiran Department of Electronics and Communication Engineering, Navkis College of Engineering, Hassan-573217, Karnataka, India
  • K. M. Madhu Department of Civil Engineering, Rajeev Institute of Technology, Hassan-573201, Karnataka, India



Self-Supervised (2S) Transfer Learning, High-Resolution Image Classification, Spectral Features, TVSM, 3DCAE, GAN Model


The 2S-DT (Self-Supervised Decomposition for Transfer Learning) model, created for crop categorization using remotely sensed data, is a unique method introduced in this paper. It deals with the difficulty of incorrectly identifying crops with comparable phenology patterns, a problem that frequently arises in agricultural remote sensing. Two datasets from Nanajangudu taluk in the Mysore district, which has a widely varied irrigated agriculture system, are used to assess the model. Using self-supervised learning, the 2S-DT model addresses the misclassification issue that frequently occurs when working with unlabeled classes, especially in high-resolution images. It uses class decomposition (CD) layer and a downstream learning approach. Using the model’s learning and the particulars of each geographical context, this layer improves the information’s arrangement. Our model architecture’s foundation is ResNet, a well-known deep learning framework. Each residual block in our ResNet architecture is made up of two 3x3 convolutional layers. Each convolutional layer is followed by batch normalization and Rectified Linear Unit (ReLU) activation functions, which improve the model’s capacity for learning. We utilized a 7x7 convolutional layer with 64 filters and a stride of 2 for Conv1 in ResNet18, resulting in an output size of 112x112x64. Conv2, which consists of Res2a and Res2b, generated an output with the dimensions 48x48x64. Conv3, which included Res3a and Res3b, produced an output with the dimensions 28x28x128. These architectural selections were made with our experimental needs in mind. The 2S-DT model’s newly added features make it easier to identify classes and update weights, improving the stability of the features’ spatial and spectral data. Extensive tests performed on two datasets show the model’s viability. Overall accuracy has improved significantly, with the 2S-DT model surpassing comparable models like TVSM, 3DCAE, and GAN Model by obtaining 95.65% accuracy for dataset 1 and 88.91% accuracy for dataset 2.


Download data is not yet available.


Arel, I., Rose, D. C., & Karnowski, T. P. (2010). Research frontier: deep machine learning - A new frontier in artificial intelligence research. IEEE Computational Intelligence Magazine, 5(4), 13-18.

Bolton, D. K., & Friedl, M. A. (2013). Forecasting crop yield using remotely sensed vegetation indices and crop phenology metrics. Agricultural and Forest Meteorology, 173, 74-84.

Bruzzone, L., Chi, M., & Marconcini, M. (2005, July 29). Transductive SVMs for semisupervised classification of hyperspectral data. Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05. (pp. 4). IEEE.

Esch, T., Metz, A., Marconcini, M., & Keil, M. (2014). Combined use of multi-seasonal high and medium resolution satellite imagery for parcel-related mapping of cropland and grassland. International Journal of Applied Earth Observation and Geoinformation, 28, 230-237.

Gallego, J., Kravchenko, A. N., Kussul, N. N., Skakun, S. V., Shelestov, A. Y., & Grypych, Y. A. (2012). Efficiency assessment of different approaches to crop classification based on satellite and ground observations. Journal of Automation and Information Sciences, 44(5), 67-80.

Gao, F., Anderson, M. C., Zhang, X., Yang, Z., Alfieri, J. G., Kustas, W. P., Mueller, R., Johnson, D. M., & Prueger, J. H. (2017). Toward mapping crop progress at field scales through fusion of Landsat and MODIS imagery. Remote Sensing of Environment, 188, 9-25.

Hedhli, I., Moser, G., Zerubia, J., & Serpico, S. B. (2016). A new cascade model for the hierarchical joint classification of multitemporal and multiresolution remote sensing data. IEEE Transactions on Geoscience and Remote Sensing, 54(11), 6333-6348.

Jayanth, J., Shalini, V. S., Kumar, T. A., & Koliwad, S. (2020). Classification of field-level crop types with a time series satellite data using deep neural network. In D. Hemanth (Eds.), Artificial Intelligence Techniques for Satellite Image Analysis (Vol. 24, pp. 49-67) Cham, Switzerland: Springer.

Kussul, N., Lavreniuk, M., Skakun, S., & Shelestov, A. (2017). Deep learning classification of land cover and crop types using remote sensing data. IEEE Geoscience and Remote Sensing Letters, 14(5), 778-782.

LeCun, Y., Bengio, Y., & Hinton, G. (2015). Deep learning. Nature, 521, 436-444.

Li, Y., Zhang, H., & Shen, Q. (2017). Spectral–spatial classification of hyperspectral imagery with 3D convolutional neural network. Remote Sensing, 9(1), 67.

Löw, F., Michel, U., Dech, S., & Conrad, C. (2013). Impact of feature selection on the accuracy and spatial uncertainty of per-field crop classification using support vector machines. ISPRS Journal of Photogrammetry and Remote Sensing, 85, 102-119.

Mathur, A., & Foody, G. M. (2008). Crop classification by support vector machine with intelligently selected training data for an operational application. International Journal of Remote Sensing, 29(8), 2227-2240.

Mei, S., Ji, J., Geng, Y., Zhang, Z., Li, X., & Du, Q. (2019). Unsupervised spatial–spectral feature learning by 3D convolutional autoencoder for hyperspectral classification. IEEE Transactions on Geoscience and Remote Sensing, 57(9), 6808-6820.

Omkar, S. N., Senthilnath, J., Mudigere, D., & Kumar, M. M. (2008). Crop classification using biologically-inspired techniques with high resolution satellite image. Journal of the Indian Society of Remote Sensing, 36, 175-182.

Radford, A., Metz, L., & Chintala, S. (2015). Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv preprint. arXiv:1511.06434.



How to Cite

Jayanth, J., Ravikiran, H. K., & Madhu, K. M. (2023). Classification of Crops through Self-Supervised Decomposition for Transfer Learning. Journal of Aridland Agriculture, 9, 81–91.