Hyperspectral Images Segmentation: A Proposal. Proposition d’une Stratégie de Segmentation D’Images Hyperspectrales

Hyperspectral Images Segmentation: A Proposal

Proposition d’une Stratégie de Segmentation D’Images Hyperspectrales

Nathalie Goretta Jean-Michel Roger  Fiorio Christophe  Véronique Bellon-Maurel  Gilles Rabatel  Camille Lelong 

Cemagref, UMR ITAP Information et Technolologie pour les agro-procédés, Montpellier FRANCE

Lirmm, Montpellier FRANCE

Cirad, UMR TETIS, Montpellier FRANCE

31 January 2008
30 April 2009
| Citation



Hyper-Spectral Imaging (HIS) also known as chemical or spectroscopic imaging is an emerging technique that combines imaging and spectroscopy to capture both spectral and spatial information from an object. Hyperspectral images are made up of contiguous wavebands in a given spectral band. These images provide information on the chemical make-up profile of objects, thus allowing the differentiation of objects of the same colour but which possess make-up profile. Yet, whatever the application field, most of the methods devoted to HIS processing conduct data analysis without taking into account spatial information.Pixels are processed individually, as an array of spectral data without any spatial structure. Standard classification approaches are thus widely used (k-means, fuzzy-c-means hierarchical classification...). Linear modelling methods such as Partial Least Square analysis (PLS) or non linear approaches like support vector machine (SVM) are also used at different scales (remote sensing or laboratory applications). However, with the development of high resolution sensors, coupled exploitation of spectral and spatial information to process complex images, would appear to be a very relevant approach. However, few methods are proposed in the literature. The most recent approaches can be broadly classified in two main categories. The first ones are related to a direct extension of individual pixel classification methods using just the spectral dimension (k-means, fuzzy-c-means or FCM, Support Vector Machine or SVM). Spatial dimension is integrated as an additionnal classification parameter (Markov fields with local homogeneity constrainst [5], Support Vector Machine or SVM with spectral and spatial kernels combination [2], geometrically guided fuzzy C-means [3]...). The second ones combine the two fields related to each dimension (spectral and spatial), namely chemometric and image analysis. Various strategies have been attempted. The first one is to rely on chemometrics methods (Principal Component Analysis or PCA, Independant Component Analysis or ICA, Curvilinear Component Analysis...) to reduce the spectral dimension and then to apply standard images processingtechnics on the resulting score images i.e. data projection on a subspace. Another approach is to extend the definition of basic image processing operators to this new dimensionality (morphological operators for example [1, 4]). However, the approaches mentioned above tend to favour only one description either directly or indirectly (spectral or spatial). The purpose of this paper is to propose a hyperspectral processing approach that strikes a better balance in the treatment of both kinds of information.

To achieve this, a generic scheme is proposed to associate more closely the spectral and spatial aspects symmetrically and conjunctively. This method, called butterfly, aims to perform an iterative and a cross analysis of data in the spectral and the spatial domains lead to the segmentation of the hyperspectral image. The strategy is based on two steps: 

- Extraction of a spatial structure (topology) incorporating a spectral structure,

- Extraction of a spectral structure (latent variables) incorporating a spatial structure,

These steps are processed in a successive, iterative and inter-dependent way.

In this article, we will focus solely on specific notions of topology i.e. the notions of connectivity and adjacency. Thus, the first stage deals with the use of commonly used image processing tools (region segmentation algorithms) on a limited number of score images. This makes it relatively easy to process. To carry out the second step, we use chemometric tools to reveal a subspace (latent variables) enabling the characterization of heterogeneity of the obtained image partitions. However, the scheme can be applied on two different ways depending on the region segmentation strategy used i.e. top down approaches (splitting) or bottom-up approaches (merging). We have implemented this scheme by using a split and merge strategy based on the quadtree approach. Each phase is done over successive steps (iterations). At each iteration of the split phase, the data are projected on k1 suitable latent variables. The split of each existing region (partition) into four disjoints quadrants is tested and the one maximising the Wilks Lambda parameter is chosen. At each iteration of the merge phase, the data are projected on k2 suitable latent variables and all the merging of two adjacent regions are tested. The one maximising the Wilks Lambda parameter is chosen.

Lastly, we tested our approach on a simple synthetic image to show more precisely its characteristics and also on two real images at different scales (in field acquisition on crop, remote sensing image of urban zone). The results obtained on real images underline the benefit of the butterfly approach. However, futher work will be undertaken to investigate the influence of various parameters. Moreover, other topology notions and image analysis algorithm could be also investigated.


Cet article présente une stratégie de segmentation d’images hyperspectrales liant de façon symétrique et conjointe les aspects spectraux et spatiaux. Pour cela, nous proposons de construire des variables latentes permettant de définir un sous-espace représentant au mieux la topologie de l’image. Dans cet article, nous limiterons cette notion de topologie à la seule appartenance aux régions. Pour ce faire, nous utilisons d’une part les notions de l’analyse discriminante (variance intra, inter) et les propriétés des algorithmes de segmentation en région liées à celles-ci. Le principe générique théorique est exposé puis décliné sous la forme d’un exemple d’implémentation optimisé utilisant un algorithme de segmentation en région type split and merge. Les résultats obtenus sur une image de synthèse puis réelle sont exposés et commentés.


Hyperspectral imaging, segmentation, chemometric.

Mots clés

Imagerie hyperspectrale, segmentation d’images, chimiométrie.

1. Introduction
2. Théorie
3. Matériel et Méthode
4. Résultats
5. Conclusion

[1] V. BELLON-MAUREL and J. DUBOIS. NIR Hyperspectral Imaging in Food and Agricultural Science in Infrared and Raman Spectroscopic Imaging. Wiley Publ, 2008.

[2] J.A. BENEDIKTSSON, J.A. PALMASON, and J. SVEINSSON. Classification of hyperspectral data from urban areas based on extended morphological profiles. IEEE Transactions on Geoscience and Remote Sensing, 43(3):480-491, 2005.

[3] J. BEZDEK. Pattern recognition with fuzzy objective functions. Plenum Press, New York, 1981.

[4] L. BRIAN, A.L. STEWARD, R. P. KALEITA, and D.A.A EWING. Genetic algorithms for Hyperspectral Range and Operator Selection. In ASAE Annual Meeting, 2005.

[5] G. CAMPS-VALLS, L. GOMEZ-CHOVA, J. MUNOZ-MARI, J. VILA-FRANCES, and J. CALPE-MARAVILLA. Composite kernels for hyperspectral image classification. Geoscience and Remote Sensing Letters, 3(1):93-97, 2006.

[6] S. DI ZENZO. A note on gradient of a multi-image. Computer vision, graphics, and image processing, 33:116-125, 1986.

[7] J.M DUARTE-CARVAJALINO, M. VÉLEZ-REYES, and P. CASTILLO. Scale-space in hyperspectral image analysis. Algorithms anf Technologies for Multispectral, Hyperspectral, and Ultraspectral Imagery XII, Orlando (Kissimmee), FL, USA, SPIE, volume 6233-42, 2006.

[8] C. FIORIO and J. GUSTEDT. Two linear time union-find strategie for image processing. In Theoretical Computer Sciences, 54:165-181, 1996.

[9] S.L. HOROWITZ and T. PAVLIDIS. Picture Segmentation by a Directed Split and Merge Procedure. In CMetImAly77, pages 101-11, 1977.

[10] Zhi HUANG, Brian J. TURNER, Stephen J. DURY, Ian R. WALLIS, and William J. FOLEY. Estimating foliage nitrogen concentration from HYMAP data using continuum removal analysis. Remote Sensing of Environment, 93(1-2):18-29, 2004.

[11] R.L. KETTIG and D.A LANDGREBE. Classification of multispectral image data by extraction and Classification of homogeneous objects. IEEE Transactions on geoscience Electronics, GE-14(1):12-29, 1977.

[12] D.A. LANDGREBE. The Development of a Spectral-Spatial Classifier for Earth Observational Data. Pattern Recognition Letters, 12(3):165-175, 1980.

[13] M. LENNON, G. MERCIER, M.C. MOUCHOT, and L. HUBERTMOY. Independent component analysis as a tool for the dimensionalityreduction and the representation of hyperspectral images. In IEEE Geoscience and Remote sensing symposium, IGARSS2001, volume 6, pages 2893-2895, 2001.

[14] S. MCDONALD, K.O. NIEMANN, D.G. GOODENOUGH, A. DYK, C. WEST, and M. Tian Han MURDOCH. Hyperspectral remote sensing of conifer chemistry and moisture. In IEEE International Geoscience and Remote Sensing Symposium, IGARSS2003, volume 1, pages 552-554, Toulouse, France, 2003.

[15] G. MERCIER, S. DERRODE, and M. LENNON. Hyperspectral image segmentation with Markov chain model. In IEEE International Geoscience and Remote Sensing Symposium, 2003. IGARSS ’03. Proceedings. 2003, volume 6, pages 3766- 3768, Toulouse, France, 2003.

[16] J. C. NOORDAM, W. H. A. M. VAN DEN BROEK, and L. M. C. BUYDENS. Unsupervised Segmentation of Predefined Shapes in Multivariate Images. Journal of Chemometrics, 17:216-224, 2003.

[17] J. C. NOORDAM and W.H.A.M. VAN DEN BROEK. Multivariate image segmentation based on geometrically guided fuzzy c-means clustering. Journal of Chemometrics, 16:1-11, 2002.

[18] J.A. PALMASON, J.A BENEDIKTSSON, and K. ARNASON. Morphological transformations and feature extraction for urban data with high spectral and spatial resolution. In IGARSS, volume 1, pages 470-472, Toulouse, France, 2003.

[19] P. PERONA and J. MALIK. Scale-Space and Edge Detection Using Anisotropic Diffusion. Transactions on Pattern Analysis and Machine Intelligence, IEEE, 12(7):629-639, 1990.

[20] A. PLAZA. Morphological Hyperspectral Image Classification: A Parallel Processing Perspective. In Chein-I Chang, editor, Hyperspectral Data Exploitation, pages Pages353-378. John Wiley and Sons, Inc, 2007.

[21] O. PRONY, X. DESCOMBES, and J. ZERUBIA. Classification des images satellitaires hyperspectrales en zone rurale et périurbaine. Rapport de recherche INRIA 4008, INRIA, septembre 2000.

[22] W. H. A. M. VAN DEN BROEK, E. P. P. A. DERKS, E. W. VAN DE VEN, D. WIENKE, P. GELADI, and L. M. C. BUYDENS. Plastic identification by remote sensing spectroscopic NIR imaging using kernel partial least squares (kpls). Chemometrics and Intelligent Laboratory Systems, 35(2):187-197, 1996.

[23] S. WILKS. Multidimensional scatter. Standford Press, 1960.