Image Anal Stereol 2011;30:111-122 Original Research Paper STRUCTURALLY ADAPTIVE MATHEMATICAL MORPHOLOGY BASED ON NONLINEAR SCALE-SPACE DECOMPOSITIONS Jesus Angulo and Santiago Velasco-Forero CMM-Centre de Morphologie Mathematique, Mathematiques et Systemes, MINES Paristech, France e-mail: jesus.angulo@mines-paristech.fr, santiago.velasco@mines-paristech.fr (Accepted June 20, 2011) ABSTRACT Standard formulation of morphological operators is translation invariant in the space and in the intensity: the same processing is considered for each point of the image. a current challenging topic in mathematical morphology is the construction of adaptive operators. In previous works, the adaptive operators are based either on spatially variable neighbourhoods according to the local regularity, or on size variable neighbourhoods according to the local intensity. This paper introduces a new framework: the structurally adaptive mathematical morphology. More precisely, the rationale behind the present approach is to work on a nonlinear multi-scale image decomposition, and then to adapt intrinsically the size of the operator to the local scale of the structures. The properties of the derived operators are investigated and their practical performances are compared with respect to standard morphological operators using natural image examples. Keywords: adaptive filters, leveUing, mathematical morphology, morphological scale-space, structure decomposition. INTRODUCTION Mathematical morphology is a well-known nonlinear image processing methodology based on the application of lattice theory to spatial structures (Serra, 1988; Heijmans and Ronse, 1990). Let £ be a subset of the Euclidean R'^ or the discrete space Z'^, considered as the support space of the image, and let be a set of grey-levels, corresponding to tl^ space of values of the image. It is assumed that ^ = R = Ru{-oo,+oo}. A grey-level image is represented by a function. E X (1) i.e., f G maps each pixel x G E into a grey-level value t e t = /(x). The two basic morphological mappings ^ -^{E, are the grey-level dilation and the grey-level erosion given respectively by and /) (x) = sup (/(x-h) +0(h)) \iee eö(/)(x)=mf(/(x + h)-ö(h)), net (2) (3) where / G is the original grey-level image and b G •^{E, ^) is the fixed structuring function. The further convention for ambiguous expression is considered: /(x — h) + ö(h) = —0° when /(x — h) = -00 or 0(h) = -00, and that /(x + h) - ö(h) = +00 when f{x + h) = +0° or ö(h) = —0°. The other morphological operators, such as the opening and the closing, are obtained as products of dilation/erosion. For instance, starting from the adjunction pair {5t,, Eb}, the opening and closing of a grey-level image f according to the structuring fianction b are the mappings ^) ^ ^(-E, given respectively by rö(/)(x) = [5,(e,(/))](x), (p,(/)(x) = [e,(5,(/))](x). (4) Particularly interesting in theory and in practical appHcations (Soille, 1999), the flat grey-level dilation and erosion is obtained when the structuring function is flat and becomes a structuring element More precisely, a flat structuring fianction of support subspace B is defined as b{x) = 0 xg5 -00 x^BF where 5 is a Boolean set, i.e., B (Z E or B e ^{E), which defines the "shape" of the structuring element. We notice that B^ denotes the complement set of B {i.e., Bf]BF = % and BVJB^ = E). The structuring element is defined at the origin 0 G then to each point p of £ corresponds the translation mapping 0 to p, and this translation maps Bonto i.e., = {b + p : b G 5}. Therefore, the ßat dilation and erosion of a grey-level image f{x) with respect to the structuring element B are respectively 55(/)(x)=sup(/(x-h)) he5 (5) = {^(y)K(y) = sup[/(z)],zG5,}, and e5(/)(x) = inf(/(x + h)) (6) = {/(y)K(y) = mf[/(z)],zG4}, where 5 is the refection of B with respect to the origin, i.e.,B={-h\heB}. Standard formulation of morphological operators is translation invariant in the space ("horizontal" direction invariance) and in the grey-level intensity ("vertical" direction invariance), see properties and proofs in (Heijmans and Ronse, 1990), i.e., for a given translated image ^z) = /(x + y) + r, it is obtained that 8b{g) (z) = 8b{ f) (x + y) + r. But of course, this result is true if and only if the same structuring function b{x) is considered for each point x of the image. A current challenging topic in mathematical morphology is the construction of adaptive operators; or in other words, operators whose structuring functions become dependent on position or on the input image itself In previous works, the proposed adaptive operators have been based on two main approaches. - On the one hand, a variability on the support space E: spatially variable shape of structuring functions according to i) the geometric position in the image: perspective-adapted Morphology by Beucher et al. (1987) and by Cuisenaire (2006), ii) the local regularity of image values: morphological amoebas by Lerallut et al. (2005), intrinsic structuring elements by Debayle and Pinoli (2005) morphological bilateral filtering by Angulo (2011), iii) the orientation: curvilinear morpho-hessian filter by Tankyevych et al. (2008), locally-variant anisotropic morphological filters by Verdu-Monedero etal. (2011). - On the other hand, a variability on the value space variable size of structuring functions according to the local intensity or contrast: viscous watershed by Vachier and Meyer (2005) and viscous openings/closings by Vachier and Meyer (2007), together with a PDE formulation by Maragos and Vachier (2008). For a recent overview on the state-the-art on adaptive morphology, the interested reader is invited to papers by Maragos and Vachier (2009) and by Verdu-Monedero e? aZ (2011). Another recent study by Roerdink (2009) is very interesting for understanding the theoretical limitations of input-adaptive morphological operators. Motivation of the new adaptive framework The intensity-adaptive operators, or level-varying operators, studied in Vachier and Meyer (2007) and Maragos and Vachier (2008) are typically implemented using a level-set decomposition, followed by the processing of each level set by a flat operator of a size which depends on the index of the particular level set and finally the image reconstitution from the processed level sets. Hence, the adaptavility for each point depends on the absolute intensity value. Two points of the image associated to structures of similar scale but of different intensity are processed differently. This work introduces a new framework of nonlinear adaptive operators: the structurally adaptive mathematical morphology. More precisely, the rationale behind the present approach is to work on a nonlinear multi-scale image decomposition based on a morphological family of operators called levellings (Meyer, 1998; Meyer and Maragos, 2000). Then, the size of the structuring function ö(x) at point x is intrinsically adapted to the local scale of the structures. In other words, two regions of the image appearing in a similar scale will undergo a nonlinear processing of similar "size" independently of the absolute intensities. The value of the processed image will be obtained by the reconstitution of the processed scales. We notice also that our approach is not limited to flat morphological operators. The properties of the derived operators are investigated and their practical performances are compared with respect to standard morphological operators using natural image examples. The paper is an extended and improved version of the conference paper (Angulo and Velasco-Forero, 2010). Paper organisation The rest of the paper is organised as follows. In the first part of Methods Section is presented the structural image model, using a pyramid of levellings, which is the basic ingredient for the present adaptability framework. Then, the second part of Methods Section introduces the structurally adaptive pseudo-dilation and pseudo-erosion and other associated operators, including also the study of the algebraic properties of these new operators. Results Section discusses various examples which illustrate the behavior of the structurally adaptive operators for typical applications of mathematical morphology. Finally, Section on conclusions and perspectives closes the paper. METHODS STRUCTURAL IMAGE MODEL USING A PYRAMID OF LEVELLINGS The classical tool from mathematical morphology for multi-scale image decomposition is based on the granulometric analysis (Serra, 1982; Maragos, 1989). A granulometry is the study of the size distribution of the objects of an image (Serra, 1982). Formally, forthe discrete case, a granulometry is a family of openings r = {Yn}n>o that depends on a positive parameter n (which expresses a size factor) such as: i) 7o(^)(x) = /(x); 11) /(x) < ^x) ^ r,(/)(x) < > 0, 111) < /(x),V/3>0, v/G ^); and iv) Jn verifies the granulometric semigroup absorption law; i.e., JnJm = JmYn = rmax(«,«3) , V/3, ffl > 0 . Moreover, a granulometry by closings (or anti-granulometry) can be defined as a family of increasing closings O = {(Pn}n>o- In practice, the most usefial granulometry and anti-granulometry are those associated to morphological flat openings and closings: 75„(/) = 5B„ieB„if)) and (pB„if) = ^Bni^Bnif)) respectively, where Bi = Bis a isotropic structuring element of unit size (unitary discrete disk), and En is the homothetic structuring element of size n, with n= 1,2, • • •. The granulometric analysis of an image /with respect to a finite T consists in computing the pyramid of opened images and then in calculating the image residue between two successive openings: The pyramid of residues of openings leads to a decomposition of bright structures into N scales. We recall that the subgraph of the opened image by Bj is equivalent to the union of the translations of the structuring when it fits the subgraph of the original image (Serra, 1982), or in other terms, image structures in the foreground {i.e., bright ones) that cannot contain Bj are removed by the opening. Therefore, the residue pj^ extracts the structures removed between Bi-\ and Bi. By duality, the image decomposition into N scales of dark structures is obtained from the pyramid of residues of closings where In summary, using morphological openings and closings, it is obtained a pair of nonlinear scale-space image decomposition, i.e.. Furthermore, morphological openings/closings deal selectively with the grey-level structures according to their support size but they also "distort" the contours (level sets) of the image objects. In mathematical morphology, the powerful geodesic operators (Serra, 1988; Soille, 1999) (or connected filters) are perfectly able to deal with the objects, without distorting their contours. For all these reasons, we have considered for the present structurally adaptive operators a multi-scale framework which, on the one hand, decomposes simultaneously bright and dark structures (by means of alternate sequential filters); and on the other hand, uses geodesic operators (in particular, the levelling operator) to extract precisely the grey-level objects. Let us consider in detail this methodology. Nonlinear scale-space based on viscous levellings The levelling (Meyer, 1998) of the reference image /(x) according to the marker image m(x) (this latter is generally a rough simplification of the reference image), denoted A(/,m)(x), is a morphological geodesic filter which simplifies textures and eliminates small details of the reference image according to the marked structures, but preserving the contours of remaining objects. In practice, the levelling is obtained by iteration of geodesic dilations and erosions until idempotence. More precisely, a straightforward algorithm is as follows (Meyer, 1998): Uf,m){x)=A\f{x),m{x)) , (7) such that the idempotence has been reached, i.e., where the i-iteration is A\f,m) = {fAa{A'-\f,m))) Vj8 {A'-\f,m)) , (8) with the initial step A\f,in) = {fha{m))\jß{in). (9) Levellings of different nature are obtained according to the pair of transformations (a,j8) used in Eq. 8 and 9. More precisely, two of the most interesting are (Meyer, 1998) - standard levelling: | o Z f^^ . I P — ones ,--------^--------, /(x) ^ {{p+(/)(x)}f.i; {pr(/)(x)}f.a . - VISCOUS levelling: { Fig. 1 shows a comparison of standard levelling vs. viscous levelling using three different marker images. We observe that even the structures which have been removed from the marker can be reconstructed (by strict geodesic propagation) by standard levelling. On the contrary, viscous levelling produces a reconstruction more faithful to the simplification degree driven by the marker. Consequently, by its skilfial properties on structure regularisation, we consider here the viscous levelling as the fiandamental operator for our structural decomposition. (a) f (hi) mi = AASFb^ (/) (b2) m4 = AASFb^(/) (b3) m = AASFb^ (/) (cl) A(/,m2) (c2) X( f,nn) (c3)X(f,nis) (dl) A(/,m2) (d2) A(/,m4) (d3)A(/,m8) Figure 1. Comparison of standard (a = and ß = £bJ and viscous levelling (a = Yb^ andß = Eb^ (Pb^) scale-space: First row (a), original image; second row (b), AASF markers; third row (c), standard levellings; fourth row (d), viscous levellings. A pyramid of levellings is then obtained by associating to the image a pyramid of markers, i.e., /(x) ^ ^ , (10) which leads to a nonlinear scale-space (Meyer and Maragos, 2000). The marker at level i determines the degree of simplification of the corresponding levelled image; the simplification effect increases with i. The levelling can be considered as the activity supremum between an opening by reconstruction and a closing by reconstruction (Meyer, 1998), leading to a brigh/dark symmetric operator. Let C f stand for the image complement (or negative) of / G •^{E, i.e., C/(x) = -/(x) a ^ = R and C/(x) = Wx-/(x) if = [0,Wx]. We have for the levelling the following property: CA(C/,Cm) = X{f,m), which means that (f,g) ^( f,g) is always a self-dual mapping. In addition, if m derives from / by a self-dual operation, i.e., m = m{ f) with Cm(C/) = m{f) then levelling f X{f,m{f)) is self-dual. We notice that this important relation is distinct from that of invariance under complement m(C /) = m{ f) which does not imply self-duality for /1-^ A (/, /)). Hence, to obtain a self-dual and symmetric processing of brigh/dark structures, a self-dual family of marker images is required. Classical examples of self-dual filters are the convolution with Gaussian kernels or the (weighted) median filters. In particular, the nonlinear scale spaces associated to levellings where the markers are Gaussian filters have been studied by Meyer and Maragos (2000). In addition, this kind of marker was also used in (Sofou et al., 2005) to extract the texture layer of an image as the residue of the corresponding levelling. Nevertheless, we propose in this study to use as multi-scale markers the averaged alternate sequential Mer5(AASF): AASFB„{f){^) = , (11) where the pair of alternate sequential filters (ASF) (Serra, 1988) are given by the following products of openings and closings ' ASF'b, (f) (x) = [(pBn Yb„--- (PB2 752 m>0,we have ASFy^ASFl;" = ASFI'^^ASFI'" = ASF^'" , ,, n m n n n=max(n,m)' and consequently this property is inherited by AASFb„. ASF are very usefial for noise cancellation and smoothing since they produces progressive simplification of image structures. This behaviour is related with their property of compatibility with scale modifications {i.e., intuitively that means that the filter of order k works at a scale 1 as a filter of order 1 at a scale 1). Theoretically, ASF are not self-dual, but our symmetric averaged version AASFb„ leads to an quasi self-dual operator: we have observed that in practice the difference between AASFß^iJ^ and ZAASFB„{f){^) is always negligible. The main drawback of AASFb„ is the computation time, which increases with the size n of the scale. However, using well-known optimized implementations of discrete dilation/erosion for the openings/closings, the final computation time is not nowadays a limiting point. The rationale behind this choice of AASFb„, instead of a Gaussian filter of equivalent scale n, is because we have observed empirically that the viscous levellings associated with alternate sequential filter are more effective for extracting the bright/dark structures of corresponding scale n. id id (al)A(/,m2) (a2)A(/,m4) {d3)X{e,m) {h\)n = f- (b2)r4 = A(/,m2)- (b3)= ^(/,^4)-X(f,m2) Kf,nn) X(f,ms) Figure 2. Example of laplacian pyramid on viscous levelling scale-space (original image on Fig. 1): ßrst row (a), pyramid of viscous levellings; second row (b), derivative of the viscous levelling pyramid. Structural image model We have now all the ingredients to introduce the following structural model image: /(x) = C+5(x) N i=l (13) where c is the continuous component, 5(x) is the structure component, and are the texture components at A'^ scales. More precisely, given the levelling scale-space {A (f, mi) (x) , the components of the present image model can be calculated as follows. - The continuous component is obtained as the mean value of the last levelled image, i.e., We can consider that c varies with the DC level of the image acquisition device. In the operators presented in this paper c does not give any usefial information but is still necessary for ongoing research on adaptive self-dual operators (see perspectives section); The structure component corresponds to the mean-centred last levelled image, i.e., s{x) = (15) c = mean(A(/,m#)(x)) . (14) Therefore, the image 5(x) represents the most simplified image according to the choice of scale N. In other words, the level-sets of the significant objects having a "support size" bigger than the structuring element Bpj. - The texture components are obtained as the derivative of the levelling pyramid, i.e., = , (16) where mo(x) = /(x). Each residue image ti represents the brigh/dark objects which were in scale image i — 1 but have been removed in scale image i; that is, level-sets of objects whose "support size" is comprised between both successive scales. The intensity at each point of tj is the relative intensity of the object (which is invariant to monotone increasing intensity transformation on original image). In fact, the residue image between two successive levellings can be considered as a "morphological laplacian pyramid". In natural images, we can suppose that the texture components are sparse images (i.e., only a limited number of pixels are different of 0) and that the complexity of the original image is split into a simpler image (structure component) and a scale-complexity bounded series of images (texture components). Our additive image decomposition model can be considered as generalisation of the Cartoon + Texture decomposition by Meyer (2002): /(x) = u{x) + v(x) where u{x) is the cartoon component (homogeneous zones of the objects) and v(x) is the texture oscillation, which is usually solved using variational algorithms (Aujol et al., 2006). The terms can be identified as u(x) = c + 5(x) and v(x) = E^i^ilx). The value N of the larger structuring element (scale of structure equivalent) in our model is equivalent to the "scale size" in other Cartoon + Texture decomposition algorithms (Buades et al, 2010). (a) c+ s(x) (c) u(x) (d) l \ in order to reduce the number of processed discrete scales (reduction of computation time). The structural adaptive pseudo-dilation and pseudo-erosion are dual operators with respect to the grey-level inversion, i.e., V/ G •^{E, ^m±.M ( f) = Cem:fcM (C f) ■ However, the fundamental law which links the pair of dilation/erosion, the adjunction property, fails for the introduced structurally adaptive operators, Sni±M{f) f< Sni-kMig) ■ As recently pointed out by Roerdink (2009), this drawback is common to any adaptive morphology dilation/erosion where the processing at each point depends on the input value. Moreover, as a consequence of the lack of adjunction property, other properties are also lost. Typically, the structural adaptive pseudo-dilation (pseudo-erosion) does not commute with the supremum (inflmum), i.e., \/f,ge ^{E, Snj±M{f\/g) + ^m±.M{f)"^^m±.M{g) ■ Figure 5. Effect of scaling on the ßat structurally adaptive dilation for the same size M = 8 .• (a) sparse scale parametrization m = 2 (smallest scale) and k = 2 (sampling size); (b) dense scale parametrization m=l (smallestscale) andk=l (samplingsize). Properties of structurally adaptive operators Let us consider the algebraic properties of these two morphological operators. The proofs are not included but are easily obtained from the standard properties of erosion and dilation. - The structural adaptive pseudo-dilation (pseudoerosion) is extensive (anti-extensive), i.e., V / G f < Sni-.tM (f) and f> £m±M (f) ■ - Another fundamental property of standard morphology which fails is the increasiness. The structural adaptive pseudo-dilation/pseudo-erosion are generally not increasing operators, i.e., f < g does not always involve that 5m:tM{f) < 5m.tM{g)- In fact, the property is verified if Vi: A (f, ASFb,_, (/)) - a (/, ASFB,{ f)) < l{gASFB,_,{g))-l{gASFB,{g))^ or in other terms, the ordering must be preserved in the derivative pyramid, which is not always the case. In mathematical morphology, a pair of dual operators which are extensive and anti-extensive are respectively a thickening and thinning (Serra, 1982; Soifle, 1999); therefore, the structurally adaptive operators are just algebraic grey-level thickenings/thinnings. In any case, despite the lack of some properties, the operators 5tn±M (f) and em±M (f) can be used to construct structurally adaptive gradient, laplacian, toggle mapping, etc. Adaptive pseudo-opening and pseudo-closing Due to the fact that the introduced structurally adaptive operators are not formally a pair of adjunct dilation/erosion, their product 5„j±M£m.kM{f) is not an algebraic opening. Hence, we prefer to formulate the structurally adaptive pseudo-opening as M f^rw.tM{f) = c+rbMis)+ X (19) i=m,m+k,--- and dually, the structurally adaptive pseudo-closing is defined by M f ^ (Pm±M ( /) = C+ ^ÖM (s) + X ^bi (ti) ■ (20) i=m,m+k,--- The structural adaptive opening in Eq. 19 (closing in Eq. 20) is anti-extensive (extensive) but it is not increasing. The idempotency, 77(/) = /(/), is the property which guarantees the stability of standard opening/closing. Even if our adaptive operators are not strictly idempotent, their iteration is almost stable when AASF filters are used for the levelling decomposition. mrbj/) mjbM) (bl)7,,j„(/)(x) (cl)fA+^(/)(x) (b2)7,,...„(/)(x) (h\) f) Figure 7. Image detail extraction using the white top-hat: (a) original image, (bl) standard parabolic opening (n=10), (cl) standard parabolic white tophat, (b2) structural adaptive pseudo-opening (M = 10, m = 2, k=2), (c2) corresponding structural adaptive white top-hat. Figure 6. Comparison of parabolic structural adaptive pseudo-openings (second row, b) vs. the corresponding standard parabolic openings (ßrst row, a). As we can observe in the example given in Fig. 6, the adaptive opening 7^228 amoves bright objects smaller than the size of the structuring fianction but, with respect to the standard opening jb^, the notion of "smaller than" depends on the scale of decomposition of the object. The product of operators Ym±M{f) and (Pm±M{f) can be then used to define other more complex operators. APPLICATIONS AND RESULTS Let us illustrate the performance of the present operators by means of four typical applications of mathematical morphology. The first case study, depicted in Fig. 7, corresponds to a coronary network acquired by contrast-enhanced radiography. Besides the vessels, the image presents a strong and irregular background (which includes other structures such as the ribs). In order to extract the vessels, the classical top-hat (Serra, 1982) is particularly usefial: (21) i.e., residue between the original image / and the opening ^^ ^^ isotropic opening should be bigger than the diameter of the thickest vessels. For the particular example, we consider a parabolic structuring fianction of width n = 10. As we can observe, the standard opening produces a rough regularisation by removing all the peaks smaller than Ö10 whereas the structurally adaptive opening removes also the peaks at different scales but preserves better the secondary structures; hence, the comparison of the standard against the adaptive top-hat th^ Ö2 210 (shows that the second one presents a better extraction of thin vessels as well as less texture and irregularities. The second application, given in Fig. 8, deals with an example of image denoising and detail simplification. The mosaic image is quite textured and noisy and the aim is to filter it out in order to obtain a more regular image where the main contours are well preserved. This goal can be achieved by means of the morphological centre operator (Serra, 1988), defined in terms of two products of openings and closings of a chosen size: = ^K±MyK.tM^K.tMi f) ' (22) f) = fbn.tM^b^±Mfbn,±M( f) ■ (23) We compare in particular the denoising effect using a flat structuring element of size N = 4 and a parabolic structuring function of similar width. As we can observe in the images, the adaptive flat or parabolic versions of the operator, Cßi-i-^if) and i outperforms clearly the effects of the standard ones l^B^f) and l^b^f)', yielding a more efficient denoising/simplification image, especially the parabolic case, with an excellent contour preservation of remaining structures. In order to compare quantitatively the behavior of standard vs. adaptive morphological centre, we have evaluated in an experiment the quantitative assessment of noisy images. Fig. 9 summarizes the results of this experiment: starting from an image corrupted with four different levels of Gaussian noise and with four different levels of impulsive noise ("salt and pepper" noise) , we have filtered out the eight images using standard parabolic centre ^^^ and structural adaptive parabolic centre C0114, and then, we have computed the PSNR value with respect to the original image. For all the noise levels, the value of PSNR is better for the structurally adaptive case than for the standard one. We note also that the "size" of the filter 4 is not particularly appropriate for low Gaussian noise levels or for high impulsive noise levels, but even in such a case the trade-off between denoising and image preservation is better for the adaptive version of the morphological center. (b2) (x) Figure 8. Image ßltering/denoising using morphological center: (a) original image, (bl) ßat centre operator (disk of size n = A), (b2) parabolic centre operator (paraboloid of width n = A), (cl) structural adaptive ßat centre (M = 4, m = I, k = I), (c2) structural adaptive parabolic centre (M = 4, m=l,k= I). The next problem concerns an aerial image of an airport, including objects of different size, but not well contrasted, see Fig. 10. The morphological laplacian (or nonlinear laplace filter as introduced by van Vliet e? a/. (1989)) is defined in terms of dilation and the erosion as (24) A simple but efficient image contrast enhancement is obtained by subtracting the laplacian image from the original one: (al) (a2) (a3) (a4) (bl) (b2) (b3) (b4) (cl) (c2) (c3) (c4) Pr= 2.5% Pr=5% Pr=7.5% Pr=12.5% (fl) (f2) (f3) (f4) C7= 10 C7 = 20 C7 = 40 C7 = 80 CÖ4 24.65 24.18 20.58 15.36 WA-A 25.18 24.30 22.45 18.40 2.5% 5% 7.5% 12.5% CÖ4 26.08 19.02 14.93 12.22 Wa-A 27.59 24.59 24.45 23.34 (g) Values of PSNR Figure 9. Evaluation of image denoising using morphological center: ßrst row and fourth row, original images; second row and fifth row, parabolic centre (paraboloid of width n = A); third and sixth row, structural adaptive parabolic centre (M = 4, m = 1, k= \). Original image was corrupted with Gaussian noise in ßrst row: ßrst column (7 = 10, second column o = 20, third column o = 40, fourth column o = 80; and with impulsive noise ("salt and pepper" noise which consists in randomly replacing a percentage of pixels with white pixels and the same percentage with black pixels) in fourth row: ßrst column Pr = 2.5%, second column Pr = 5%, third column Pr = 7.5%, fourth column Pr = 12.5% . Table (g) provides the corresponding values ofPSNR. (hi)ipt,{f) Figure 10. Image enhancement using morphological laplacian: (a) original image, (bl) standard parabolic laplacian (paraboloid of width n = 4), (b2) structural adaptive laplacian (M = 4, m = 1, k = 1), (cl) enhanced image using parabolic laplacian, (c2) enhanced image using structural adaptive laplacian . At the bottom are zoom-in frames of a square section cropped from original image (a), standard enhanced image (cl) and structural adaptive enhanced image (c2). We observe that the structurally adaptive laplacian ^PbiiS^^ produces a more balanced contrast enhancement than the standard one lpt,^{f). In particular, the small objects are enhanced in a small neighborhood and the large in a proportional neighborhood. In the standard case, all the structures are equally enhanced. By the way, the laplacian-based enhancement is an example of structurally adaptive operator which probably is better to be implemented using a full scale decomposition, with m = 1 and k=l. The last case study deals with an edge detector which can be implemented using only a pair of morphological erosion and dilation, and which is useful for complex images, like the one given in Fig. 11. In fact, the zero crossings of the laplacian PbmkM^^^-' ^^ ^^^ classical Marr-Hildreth model, correspond to the edges of image f. In order to select only the most prominent edges, the zero crossing detector is "multiplied" by the binary image obtained with a threshold by hysteresis of the morphological gradient (Serra, 1982; Soille, 1999) given by Ib^tm^ f) = Sh^-tuif) -^b^tm^ f) ■ (26) Besides the size parameter of the laplacian and the gradient, the single parameter of this edge detection model is the threshold value for the gradient. We observe again in this example that the structurally adaptive gradient using a parabolic structuring function, is more appropriate than the standard counterpart. The comparison by simple visual assessment of edge detection is not conclusive, but it seems that in the adaptive case the edges of small objects are better detected. CONCLUSIONS AND PERSPECTIVES We have discussed an additive image model associated to a nonlinear multi-scale image decomposition using a family of viscous levellings. Then, working on this decomposition, we have introduced structurally adaptive morphological operators, where each component of the image is processed with a structuring function of size intrinsically adapted to the corresponding local scale. We have shown that, in practical applications, the proposed operators perform better than standard ones for object extraction, image denoising, image enhancement, etc. This positive behaviour is justified by the fact that, using geodesic operators for image decomposition, the different objects are almost individually processed and the "interferences" between adjacent objects are notably reduced. In addition, we have proved that another advantage of the adaptability is the fact that the choice of the "size" for the erosions/dilations and the openings/closings is much less critical. However, we have also demonstrated that the underlying algebraic structure of the structurally adaptive operators is less rich than the standard ones. (b2) (cl) Edges from (bl) (c2) Edges from (b2) Figure 11. Image edge detection (third row) using gradient (second row) and zero-crossing of laplacian: (a) original image, (bl) standard parabolic thick gradient (n = A), (b2) structural adaptive thick gradient (M = A, m = I, k = I), (cl) edges obtained as the zero-crossings of standard parabolic laplacian on the binary mask obtained by hysteresis-based thresholding of gradient (bl), (c2) edges obtained as the zero-crossings of structural adaptive parabolic laplacian on the binary mask obtained by hysteresis-based thresholding of gradient (b2). As we have discussed, in the present image model, the structure and texture terms are positive/negative signals and consequently, in ongoing work, we will formulate adaptive self-dual erosion and opening. Finally, sparsity properties of our image model suggest us to consider it as a starting point to explore the notion of sparse mathematical morphology in future research. REFERENCES Angulo J, Velasco-Forero S (2010). Structurally Adaptive Mathematical Morphology on Nonlinear Scale-Space Representations. In: Proc IEEE Int Conf Image Proc (ICIP'IO) 121-4. Angulo J (2011). Morphological bilateral filtering and spatially-variant adaptive structuring functions. In: Soille P, Pesaresi M, Ouzounis G, eds. Proc Int Symp Math Morpho (ISMM'11). Lect Notes Comput Sci 6671:212-23. Aujol JF, Gilboa G, Chan T, Osher S (2006). Structure-Texture Image Decomposition - Modeling, Algorithms, and Parameter Selection. Int J Comput Vision 67(1):111-36. Buades A, Le T, Morel J.-M, Vese L.A (2009). Cartoon+Texture Image Decomposition. Image Processing On Line (IPOL) Journal, www.ipol.im. Buades A, Le T, Morel J.-M, Vese L.A (2010). Fast cartoon + texture image filters. IEEE T Image Proc 19(18):1978-86. Beucher S, Blosseville J.M, Lenoir F (1987). Traffic Spatial Measurements Using Video Image Processing. In: Casasent DP, Hall EL, eds. Proc SPIE 848:648-55. Cuisenaire O (2006). Locally adaptable mathematical morphology using distance transformations. Pattern Recogn39(3):405-16. Debayle J, Pinoli J (2005). Spatially adaptive morphological image filtering using intrinsic structuring elements. Image Anal Sterol 24:145-58. Lerallut R, Decenciere E, Meyer F (2005). Image Filtering Using Morphological Amoebas. In: Proc Int Symp Math Morpho (ISMM'05) 13-22. Maragos P (1989). Pattern Spectrum and Multiscale Shape Representation. IEEE T Pattern Anal 11:701-16. Maragos P, Vachier C (2008). A PDE Formulation for Viscous Morphological Operators with Extensions to Intensity-Adaptive Operators. In: Proc IEEE Int Conf Image Proc (ICIP'08) 2200-3. Maragos P, Vachier C (2009). Overview of adaptive morphology: trends and perspectives. In: Proc IEEE Int Conf Image Proc (ICIP'09) 2241-4. Meyer F (1998). The levelings. In: Proc Int Symp Math Morpho (ISMM'98) 199-206. Meyer F, Maragos P (2000). Nonlinear scale-space representation with morphological levelings. J Vis Commun Image R 11:245-65. Meyer Y (2002). Oscillating Patterns in Image Processing and Nonlinear Evolution Equations. University Lecture Series Vol. 22, Providence: American Mathematical Society. Heijmans H, Ronse C (1990). The Algebraic Basis of Mathematical Morphology. Part I: Dilations and Erosions. Comput Vision Graph 50(3):245-95. Roerdink J (2009). Adaptivity and group invariance in mathematical morphology. In: Proc IEEE Int Conf Image Proc (ICIP'09) 2253-6. Serra J (1982). Image Analysis and Mathematical Morphology, Vol I. London: Academic Press. Serra J, ed. (1988). Image Analysis and Mathematical Morphology Vol.2: Theoretical Advances. London: Academic Press. Sofou a, Evangelopoulos G, Maragos P (2005). Coupled geometric and texture PDE-based segmentation. In: Proc IEEE Int Conf Image Proc (ICIP'05) II:650-3. Soille P (1999). Morphological Image Analysis. Berlin: Springer-Verlag. Tankyevych O, Talbot H, Dokladal P (2008). Curvilinear morpho-hessian filter. In: Proc 5th IEEE Int Symp Biomed Imag: From Nano to Macro (ISBI'08) 1011-4. Vachier C, Meyer F (2005). The Viscous Watershed Transform. J Math Imaging Vis 22:251-67. Vachier C, Meyer F (2007). News fromviscousland. In: Proc Int Symp Math Morphol (ISMM'07) 189-200. van Vliet L.J, Young I.T, Beckers G.L (1989). A Nonlinear Operator as Edge Detector in Noisy Images. Comput Vision Graph 45:167-95. Verdii-Monedero R, Angulo J, Serra J (2011). Anisotropic Morphological Filters With Spatially-Variant Structuring Elements Based on Image-Dependent Gradient Fields. IEEE T Image Process 20(12):200-12.