deformable daisy matcher for robust iris recognition · deformable daisy matcher for robust iris...

4
DEFORMABLE DAISY MATCHER FOR ROBUST IRIS RECOGNITION Man Zhang, Zhenan Sun, Tieniu Tan National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, P.O. Box 2728, Beijing, P.R. China, 100190 { zhangman, znsun, tnt }@nlpr.ia.ac.cn ABSTRACT Iris is rich of texture information for reliable personal identifi- cation. However, nonlinear deformation of iris pattern caused by pupil dilation or contraction raises a grand challenge to iris recognition. This paper proposes a novel iris recognition method namely Deformable DAISY Matcher (DDM) for ro- bust iris feature matching. Firstly, dense DAISY descriptors are extracted to represent regional iris features, which are ro- bust against intra-class variations of iris images. Then a set of iris key points are localized on the feature map. Finally deformation tolerant matching strategy is proposed to match corresponding key points of iris images. Experimental results on two iris image databases demonstrate DDM is better than state-of-the-art iris recognition methods. Index TermsIris recognition, DAISY descriptor, key point matching, robust features 1. INTRODUCTION Iris is the frontal annular part of a human eye and exhibits rich texture information under near infrared illumination. Iris texture is highly discriminating and stable during life, thus iris recognition offers a reliable method for personal identi- fication [1]. However, it is a challenging task to match iris images because iris pattern deforms significantly under dif- ferent illumination conditions. A person’s pupil contracts in the bright and dilates in the dark. Usually, human’s pupil di- ameter changes from 1.5mm to 7mm [2]. The change of pupil size leads to nonlinear iris deformation and difficulty of iris matching. It is reported iris deformation is the main source of false reject errors in iris recognition. There are mainly two approaches possible to solve this problem. One is iris image normalization. Daugman [1] pro- posed a linear normalization method to correct iris deforma- tion and remove size effects. Yuan et al. [3] employed a mesh- work model to describe the relationship of iris collagen fibers between different iris sizes. Wei et al. [4] used a Gaussian function to normalize the nonlinear deformation of iris tex- ture. The other solution to deformed iris matching is robust feature representation and matching. Sun et al. [5] proposed qualitative representation for iris texture, which is robust to iris deformation. Thornton [6] estimated maximum posteriori probability parameters of two deformed irises for matching under a Bayesian modal. Although many methods have been proposed, deformed iris matching is still an open problem. This paper addresses the problem of deformed iris match- ing and proposes a novel approach namely Deformable DAISY Matcher (DDM) for robust iris feature extraction and deformation tolerant matching. The flowchart of this method is shown in Fig.1. In the system, iris images are already acquired and linearly normalized as input. In feature extraction stage, DAISY descriptor [7] is densely extract- ed from normalized images. The descriptor of each pixel consists of its weighted orientation gradient and its neigh- bors’. After feature extraction, iris key points are selected based on the pixel descriptor for matching in a local region. Because of DAISY descriptor’s desirable characteristics [7], DDM is robust to noise and illumination changes. Besides, the algorithm replace fixed point matching by dynamic point matching in a certain region, thus it is tolerant to deforma- tion caused misalignment. Moreover, it does not need any prior knowledge and iris physiological model. The proposed method achieves a better performance on two deformed iris databases than Sun’s Ordinal Measures [5] and Daugman’s Gabor filtering [8]. Fig. 1. Flowchart of iris recognition The remainder of this paper is organized as follows. Sec- 2011 18th IEEE International Conference on Image Processing 978-1-4577-1302-6/11/$26.00 ©2011 IEEE 3250

Upload: dinhhanh

Post on 18-Apr-2018

215 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: Deformable DAISY Matcher for Robust Iris Recognition · DEFORMABLE DAISY MATCHER FOR ROBUST IRIS RECOGNITION ... by Gaussian kernel convolution. ... Deformable DAISY Matcher for Robust

DEFORMABLE DAISY MATCHER FOR ROBUST IRIS RECOGNITION

Man Zhang, Zhenan Sun, Tieniu Tan

National Laboratory of Pattern Recognition, Institute of Automation,Chinese Academy of Sciences, P.O. Box 2728, Beijing, P.R. China, 100190

{ zhangman, znsun, tnt }@nlpr.ia.ac.cn

ABSTRACT

Iris is rich of texture information for reliable personal identifi-cation. However, nonlinear deformation of iris pattern causedby pupil dilation or contraction raises a grand challenge toiris recognition. This paper proposes a novel iris recognitionmethod namely Deformable DAISY Matcher (DDM) for ro-bust iris feature matching. Firstly, dense DAISY descriptorsare extracted to represent regional iris features, which are ro-bust against intra-class variations of iris images. Then a setof iris key points are localized on the feature map. Finallydeformation tolerant matching strategy is proposed to matchcorresponding key points of iris images. Experimental resultson two iris image databases demonstrate DDM is better thanstate-of-the-art iris recognition methods.

Index Terms— Iris recognition, DAISY descriptor, keypoint matching, robust features

1. INTRODUCTION

Iris is the frontal annular part of a human eye and exhibitsrich texture information under near infrared illumination. Iristexture is highly discriminating and stable during life, thusiris recognition offers a reliable method for personal identi-fication [1]. However, it is a challenging task to match irisimages because iris pattern deforms significantly under dif-ferent illumination conditions. A person’s pupil contracts inthe bright and dilates in the dark. Usually, human’s pupil di-ameter changes from 1.5mm to 7mm [2]. The change of pupilsize leads to nonlinear iris deformation and difficulty of irismatching. It is reported iris deformation is the main source offalse reject errors in iris recognition.

There are mainly two approaches possible to solve thisproblem. One is iris image normalization. Daugman [1] pro-posed a linear normalization method to correct iris deforma-tion and remove size effects. Yuan et al. [3] employed a mesh-work model to describe the relationship of iris collagen fibersbetween different iris sizes. Wei et al. [4] used a Gaussianfunction to normalize the nonlinear deformation of iris tex-ture. The other solution to deformed iris matching is robustfeature representation and matching. Sun et al. [5] proposedqualitative representation for iris texture, which is robust to

iris deformation. Thornton [6] estimated maximum posterioriprobability parameters of two deformed irises for matchingunder a Bayesian modal. Although many methods have beenproposed, deformed iris matching is still an open problem.

This paper addresses the problem of deformed iris match-ing and proposes a novel approach namely DeformableDAISY Matcher (DDM) for robust iris feature extractionand deformation tolerant matching. The flowchart of thismethod is shown in Fig.1. In the system, iris images arealready acquired and linearly normalized as input. In featureextraction stage, DAISY descriptor [7] is densely extract-ed from normalized images. The descriptor of each pixelconsists of its weighted orientation gradient and its neigh-bors’. After feature extraction, iris key points are selectedbased on the pixel descriptor for matching in a local region.Because of DAISY descriptor’s desirable characteristics [7],DDM is robust to noise and illumination changes. Besides,the algorithm replace fixed point matching by dynamic pointmatching in a certain region, thus it is tolerant to deforma-tion caused misalignment. Moreover, it does not need anyprior knowledge and iris physiological model. The proposedmethod achieves a better performance on two deformed irisdatabases than Sun’s Ordinal Measures [5] and Daugman’sGabor filtering [8].

Fig. 1. Flowchart of iris recognition

The remainder of this paper is organized as follows. Sec-

2011 18th IEEE International Conference on Image Processing

978-1-4577-1302-6/11/$26.00 ©2011 IEEE 3250

Page 2: Deformable DAISY Matcher for Robust Iris Recognition · DEFORMABLE DAISY MATCHER FOR ROBUST IRIS RECOGNITION ... by Gaussian kernel convolution. ... Deformable DAISY Matcher for Robust

tion 2 gives technical details of DDM algorithm. Section3 shows the experimental results on different iris databases.Section 4 concludes the paper.

2. TECHNICAL DETAILS

2.1. Motivation

A person’s pupil size changes in different illumination en-vironment. When an iris image is acquired, pupil dilationand contraction causes elastic deformation of iris texture withvarying degrees. As shown in Fig. 2, there are two iris imagesfrom the same class in CASIA-IrisV3-Lamp Database [9].The top left and top right images were acquired in dim andbright environment respectively.

Fig. 2. Deformed iris examples from the same class (Thisfigure is better viewed in color.)

Serious deformed iris matching can be ubiquitously foundin real iris recognition systems. In application, persons usu-ally register and identify at different time, which causes largeillumination variance and iris deformation. Existed featuresrobust to iris deformation are mainly for fixed point matching.When irises deform seriously, the existed algorithms generatehigh false reject rate. To solve this problem, DDM is pro-posed in this paper. The DAISY feature in DDM is robust tonoise and illumination, and key point selection for matchingdynamically in a local region can solve serious deformationproblem. This method combines the strengths of feature andkey point matching for seriously deformed iris matching.

Fig. 3. Composition of DDM

2.2. Feature Extraction

For a given normalized iris image, a local dense descriptornamed DAISY [7] is extracted. DAISY densely computes ori-entation gradient of each image pixel. The descriptor of eachpixel is contributed by the gradient vectors, which is weighted

by Gaussian kernel convolution. The flowchart of descriptorextraction is shown in Fig. 4.

Fig. 4. Flowchart of DAISY descriptor extraction

At the first stage, orientation maps are computed firstly asfollows

Go = (∂I∂o

)+ (1)

where I is the normalized iris image, o is one of the 8defined orientations and ()+ means max( ∂I

∂o , 0). To removeeffect of additive noise, Go is convolved with a Gaussian ker-nel.

GΣ0o = GΣ0

∗ ( ∂I∂o

)+ (2)

where GΣ0o is defined as a convolved orientation map in a

certain orientation o.In order to weight different areas of GΣ0

o fast, convolutionwith Gaussian kernels of different scales at different levels isused.

GΣio = GΣi

∗GΣi−1o (i = 1, 2, ..., 5) (3)

At pixel location(m,n), the vector hΣ(m,n) formed by 8orientation maps can be noted as Equation 4

hΣi(m,n) = norm([GΣi

1 (m,n), .,GΣi8 (m,n)]) (4)

where GΣi1 (m,n), ...,GΣi

8 (m,n)(i = 1, 2...5) mean the pix-el values at (m,n) in convolved orientation maps of the sameweight in different orientations respectively, and norm meansthe normalized the value of vector between 0 and 1.

Since we chose 5 convolution layers and pixel neighborsin 4 directions, the DAISY descriptor Des(m,n) at the loca-tion (m,n) is defined as

Des(m,n) =

hΣ1(m,n),

hΣ1(l1(m,n,R1)), ..., hΣ1(lN (m,n,R1)),hΣ2(l1(m,n,R2)), ..., hΣ2(lN (m,n,R2)),hΣ3(l1(m,n,R3)), ..., hΣ3(lN (m,n,R3)),hΣ4(l1(m,n,R4)), ..., hΣ4(lN (m,n,R4)),hΣ5(l1(m,n,R5)), ..., hΣ5(lN (m,n,R5))

T

(5)where li(m,n,Rj) (i = 1, 2, 3, 4; j = 1, 2...5) means the

pixel at a distance of Rj in the ith direction from the center

2011 18th IEEE International Conference on Image Processing

3251

Page 3: Deformable DAISY Matcher for Robust Iris Recognition · DEFORMABLE DAISY MATCHER FOR ROBUST IRIS RECOGNITION ... by Gaussian kernel convolution. ... Deformable DAISY Matcher for Robust

pixel. Thus the descriptor of the pixel at location (m,n) is a168 dimension vector ((1 + 4× 5)× 8 = 168).

2.3. Key Point Matching

Commonly, iris images are linear normalized. This methodtransforms an iris image shape from a circular to a fixed rect-angle. However, the normalized images from the same classare also widely different because of iris elastic deformation asshown in Fig. 2. Therefore, iris deformation poses a challengeto recognition performance.

This paper proposes a key point matching method basedon DAISY descriptor to solve deformation problem. Thereis a 168-D DAISY descriptor vector of every pixel, and thepixels which have maximum descriptor energy in their owneight-neighbor are selected as key points, where feature ener-gy means the sum of squares of feature values in each dimen-sion. These points are usually stable and not affected by illu-mination and noise because of the robust feature of DAISY.

Fig. 5. Key point matching. Stars mark key points from thetwo images and circle labels the matching one of M.

As shown in Fig. 5, a certain key point M is chosen fromthe probe image as an example and its 8 nearest key points inthe gallery image are selected as candidate points. In Fig. 5,the 8 candidate points are labeled as Ci(i = 1, 2...8), and thesimilarity between them and M are measured as follow.

Di = |DesM −DesCi | (6)

where Di means the similarity of M and Ci, and Des∗ meansthe DAISY descriptor of key point *.

Thus matching score (MS) of M is defined as

MSM = min(Di) i = 1, 2...8 (7)

Meanwhile the key point Carg min(Di) is defined as thematching point of M. After all the key points from a probeimage finds their matching ones respectively, the matchingresult of two images is calculated by averaging all of the keypoint matching scores.

3. EXPERIMENTS

Recognition results of the proposed method are comparedwith two recognition methods, which perform well in many

public databases. (1) Iris features are qualitatively represent-ed by Ordinal Measures [5]. Tri-lobe and two-lobe ordinalfilters with different configurations are fused for recognition.(2) Gabor wavelets [8] are used to filter and code irises formatching.

Experiments are performed on two challenging databaseswith serious iris deformation. The first database is a manual-ly selected subset from CASIA-Iris-Thousand Database [10].This subset is denoted as DB1, in which intra-class variationcaused by iris deformation is serious. There are 2000 iris im-ages from 200 classes in DB1. The ratio of pupil radius to irisradius varies from 0.27 to 0.62.

In the experiments, four images from each class are se-lected randomly for registration and others are for identify-ing. Experimental results of DB1, Equal error rate (EER) anddiscriminating index (DI), are shown as Table 1 and Fig. 6.

Table 1. Results on DB1EER DI

Gabor filtering 0.32% 4.9407Ordinal Measures 0.32% 5.4955Deformable DAISY Matcher 0.21% 4.9506

Fig. 6. ROC curves on DB1

The second database is CASIA-Iris-Lamp Database [9].When the iris images were acquired, a lamp was turned off/onto introduce large intra-difference to the database. There aremore than 800 classes in this database, and each class containsabout 20 images. The ratio of pupil radius to iris radius variesfrom 0.19 to 0.67 in this database. The comparison algorithmsand parameters are set as same as DB1. Experimental resultsare shown as Table 2 and Fig. 7.

DAISY descriptor is robust to illumination change and ad-ditive noise, meanwhile it can be computed efficiently [7].Due to its characteristic, the selected key points based onDAISY are stable and suitable for deformed iris matching.In the experiments on two databases, although the deformed

2011 18th IEEE International Conference on Image Processing

3252

Page 4: Deformable DAISY Matcher for Robust Iris Recognition · DEFORMABLE DAISY MATCHER FOR ROBUST IRIS RECOGNITION ... by Gaussian kernel convolution. ... Deformable DAISY Matcher for Robust

Table 2. Results on Lamp Database

EER DI

Gabor filtering 0.88% 4.1148Ordinal Measures 0.84% 4.0469Deformable DAISY Matcher 0.59% 6.3683

Fig. 7. ROC curves on Lamp database

irises from the same class are very distinctive, the selectedkey points can make deformed pattern matching much sim-ple and practicable. In Fig. 8, there are four examples fromthe two databases mentioned in the paper. These irises areseriously deformed and can not be well addressed by Ordi-nal Measures or Gabor filtering. However, DDM can classifythem correctly. Compared with the two state-of-the-art irisrecognition algorithms, DDM is more robust to deformation.

Fig. 8. Examples of deformed irises

However, the key point matching method is not robust tomotion blur and defocus. Iris texture will be unclear underthese conditions, thus lots of wrong key points are selectedfor matching. False rejection caused by these matching errorsdecreases recognition performance.

4. CONCLUSIONS

Deformable DAISY Matcher proposed in the paper is robustto iris deformation . The three main stages of the method areas follows. Firstly, dense DAISY descriptors are extractedfrom normalized iris images with low computation cost. Sec-

ondly, key points are selected based on DAISY. Finally, allkey points find their matching ones in other images respec-tively for deformed iris matching.

This algorithm is robust to illumination change and noisebecause of the extracted descriptors. Meanwhile the dynamickey point matching makes it easy for deformed pattern match-ing. Moreover, it does not need any iris deformation mod-el and other prior knowledge. Thus the proposed method issuitable for deformed iris matching, even if iris deformationis serious. Experimental results show that DDM is an effec-tive approach which is shown to significantly reduce the errorrates of deformed iris recognition. Since iris deformation isan important issue in iris recognition, we will continue to fo-cus on the algorithms of deformation correction and deformedpattern matching in the future.

5. ACKNOWLEDGEMENT

This work is funded by National Natural Science Foundation of Chi-na (Grant No. 60736018, 61075024) and International S&T Coop-eration Program of China (Grant NO.2010DFB14110).

6. REFERENCES

[1] J. G. Daugman, “High confidence visual recognition of personsby a test of statistical independence,” IEEE Transactions onPattern Analysis and Machine Intelligence, vol. 15, no. 11, pp.1148–1161, 1993.

[2] Harry J. Wyatt, “A ‘minimum-wear-and-tear’ meshwork forthe iris,” Vision Research, vol. 40, no. 16, pp. 2167–2176,2000.

[3] Xiaoyan Yuan and Pengfei Shi, A Non-linear NormalizationModel for Iris Recognition, vol. 3781 of Lecture Notes in Com-puter Science, pp. 135–141, 2005.

[4] Z Wei, T Tan, and Z Sun, “Nonlinear iris deformation correc-tion based on gaussian model,” Advances in Biometrics, pp.780–789, 2007.

[5] Zhenan Sun and Tieniu Tan, “Ordinal measures for iris recog-nition,” IEEE Transactions on Pattern Analysis and MachineIntelligence, vol. 31, no. 12, pp. 2211–26, 2009.

[6] J. Thornton, M. Savvides, and Bvkv Kumar, “A bayesian ap-proach to deformed pattern matching of iris images,” IEEETransactions on Pattern Analysis and Machine Intelligence,vol. 29, no. 4, pp. 596–606, 2007.

[7] E. Tola, V. Lepetit, and P. Fua, “Daisy: An efficient densedescriptor applied to wide-baseline stereo,” IEEE Transactionson Pattern Analysis and Machine Intelligence, vol. 32, no. 5,pp. 815–830, 2010.

[8] J. Daugman, “How iris recognition works,” IEEE Transactionson Circuits and Systems for Video Technology, vol. 14, no. 1,pp. 21–30, 2004.

[9] “CASIA-Iris-Lamp Database,” http://biometrics.idealtest.org/.

[10] “CASIA-Iris-Thousand Database,” http://biometrics.idealtest.org/.

2011 18th IEEE International Conference on Image Processing

3253