image group information access division information technology … · 1 day ago · 9 details for...

Participant Results Proprietary Fingerprint Template Evaluation II (PFT-II)

Participant 3O — Beijing Hisign Technology Co., Ltd.

Image Group

Information Access Division

Information Technology Laboratory

http://www.nist.gov/itl/iad/ig/pftii.cfm

http://www.nist.gov/itl/iad/ig/pftii.cfm

Contents

1 1K Sample Evaluation 3

2 Full Evaluation 5

3 Original PFT Dataset 13

List of Figures

1 1K Sample Evaluation – Template Size Distribution . . . . . . . . . . . . . . . . . . . . . . . . 3 2 1K Sample Evaluation – Enrollment and Comparison Timing . . . . . . . . . . . . . . . . . . . 4 3 Full Evaluation – DET for POEBVA, DHS2, AZLA, and combined from R Index, L Index, and

R/L Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 4 Full Evaluation – DET for all fnger positions from AZLA . . . . . . . . . . . . . . . . . . . . . 6 5 Full Evaluation – EERs and FTEs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7 6 Full Evaluation – FMR@FNMR = (0.002, 0.005) and 95% Confdence Intervals . . . . . . . . . 8 7 Full Evaluation – FNMR@FMR = 0.0001 and 95% Confdence Intervals . . . . . . . . . . . . . 9 8 Original PFT Dataset – DET . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13

List of Tables

1 Sample Dataset — Template Size Distribution . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3 2 Enrollment Times (sec) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4 3 Comparison Times (sec) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4 4 EER and FTE — Dataset AZLA . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10 5 EER and FTE — Dataset DHS2 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10 6 EER and FTE — Dataset POEBVA . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10 7 Details for FNMR@FMR = 0.0001 and FMR@FNMR = (0.002, 0.005) — Dataset AZLA . . . . . 11 8 Details for FNMR@FMR = 0.0001 and FMR@FNMR = (0.002, 0.005) — Dataset DHS2 . . . . . 12 9 Details for FNMR@FMR = 0.0001 and FMR@FNMR = (0.002, 0.005) — Dataset POEBVA . . . 12 10 Details for EER, FNMR@FMR = 0.0001, and FMR@FNMR = 0.005 — Original PFT Dataset . . 13

01 02 03 06 07 08 01+06 02+07 03+08 3R Thumb R Index R Middle L Thumb L Index L Middle R/L Thumb R/L Index R/L Middle

3O — Beijing Hisign Technology Co., Ltd. 1 1K SAMPLE EVALUATION

1 1K Sample Evaluation

Dataset

Tem

plat

e S

ize

(byt

e)

0

2500

5000

7500

10000

12500

15000

17500

20000

AZ Gallery

AZ Probe

LA Gallery

LA Probe

DHS2 Gallery

DHS2 Probe

POEBVA Gallery

POEBVA Probe

Figure 1: 1K Sample Evaluation – Template Size Distribution

AZ LA DHS2 POEBVA

Gallery Probe Gallery Probe Gallery Probe Gallery Probe

Dimensions 800x800 800x800 412x1000 400x776 368x368 368x368 500x500 368x368

Maximum 4096

75% 4096

Median 4096

25% 4096

Minimum 4096

4096 4096 4096 4096 4096 4096

4096 4096 4096 4096 4096 4096

4096 4096 4096 4096 4096 4096

4096 4096 4096 4096 4096 4096

4096 4096 4096 4096 4096 4096

4096

4096

4096

4096

4096

Table 1: Sample Dataset — Template Size Distribution


3O — Beijing Hisign Technology Co., Ltd. 1 1K SAMPLE EVALUATION

Tim

e (s

ec)

0

1

2

3

4

AZ LADHS2

POEBVA

●

●

●

●

●

●●

●●

●●

●●

●●●

●

●

●

●●

●

●

●

●●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●●●●

●

●

●

●

●

●

●

●●●●

●

●

●

●●

●

●

●

●

●

●

●

●

●●

●●●

●

●

●

●

●

●

●

●

●

●●

●

●

●

●●●

●

●

●●

●●●●●

●

●●

●

●

●●

●●

●

●

●

●●

●●

●

●●

●●

●

●

●

●●●●

●

●

●

●●●●●●●●●●

●

●●●

●●

●

●●●●

●

●●●●●●●●●●

●●●●

●●●●●●●

●●●

●●●●●●●●●●●

●

●●

●●●●

●

●

Enrollment Time

0.001

0.01

0.1

AZ LADHS2

POEBVA

●

●●●

●

●

●●

●

●

●

●

●

●

●

●

●

●●

●

●

●●

●

●

●●

●

●●

●

●

●

●

●

●●

●

●

●●

●

●●●

●

●

●

●

●

●

●

●

●●

●

●

●

●●●

●

●

●

●●●

●

●●

●

●

●●●●

●

●

●●●●

●

●

●

●

●

●

●●

●●●

●

●●●●●●

●

●

●

●

●●

●

●

●

●

●●●

●

●

●

●●

●

●

●

●●●●

●

●

●

●

●

●

●

●●

●

●●

●

●

●

●

●

Comparison Time

Figure 2: 1K Sample Evaluation – Enrollment and Comparison Timing

AZ LA DHS2 POEBVA AZ LA DHS2 POEBVA

Maximum 4.207 2.750 1.092 1.489

75% 2.536 1.576 0.697 0.771

Median 2.178 1.366 0.628 0.663

25% 1.854 1.187 0.555 0.583

Minimum 0.910 0.000 0.254 0.207

Maximum 0.537 0.531 0.482 0.481

75% 0.111 0.077 0.037 0.035

Median 0.092 0.065 0.031 0.028

25% 0.076 0.054 0.026 0.023

Minimum 0.033 0.001 0.012 0.003

Table 2: Enrollment Times (sec) Table 3: Comparison Times (sec)


3O — Beijing Hisign Technology Co., Ltd. 2 FULL EVALUATION

2 Full Evaluation

False Match Rate (FMR)

Fals

e N

on−

Mat

ch R

ate

(FN

MR

)

0.0001

0.001

0.01

0.1

0.00

01

0.00

1

0.01

●

●●●

●

●●●

●

●●●

●

●●●

●

●●●

0.0800.0630.058

0.0450.040

02

0.0001

0.001

0.01

0.1

●● ●●

●● ●●●●

●●

●● ●●

●● ●●0.077

0.0620.0570.0450.039

07

0.0001

0.001

0.01

0.1

0.0001

0.001

0.01

0.1

●

●●

●

●

●● ●

●

●● ●

●

●●●

●

●●●

0.1130.0950.086

0.0700.063

02+07

AZLADHS2POEBVACombined

@ Threshold● ● ●

● ● ●

Figure 3: Full Evaluation – DET for POEBVA, DHS2, AZLA, and combined from R Index, L Index, and R/L Index




Fals

e N

on−

Mat

ch R

ate

(FN

MR

)

0.0001

0.001

0.01

0.1

0.00

01

0.00

1

0.01 0.

1

03 08

0.00

01

0.00

1

0.01 0.

1

0.0001

0.001

0.01

0.1

03+080.0001

0.001

0.01

0.1

02 07

0.0001

0.001

0.01

0.1

02+070.0001

0.001

0.01

0.1

01

0.00

01

0.00

1

0.01

0.1

06

0.0001

0.001

0.01

0.1

01+06

p2pp2rr2r

Figure 4: Full Evaluation – DET for all fnger positions from AZLA



Error Rate

Com

paris

on T

ype

+ D

atas

et +

Fin

ger

r2r azla 03+08r2r azla 02+07r2r azla 01+06

r2r azla 08r2r azla 07r2r azla 06r2r azla 03r2r azla 02r2r azla 01

p2r azla 03+08p2r azla 02+07p2r azla 01+06

p2r azla 08p2r azla 07p2r azla 06p2r azla 03p2r azla 02p2r azla 01

p2p azla 03+08p2p azla 02+07p2p azla 01+06

p2p azla 08p2p azla 07p2p azla 06p2p azla 03p2p azla 02p2p azla 01

p2p dhs2 02+07p2p dhs2 07p2p dhs2 02

p2p poebva 02+07p2p poebva 07p2p poebva 02

0.00001 0.0001 0.001 0.01 0.1

(0.00970)

(0.01589)

(0.00170)

(0.02164)

(0.02027)

(0.00554)

(0.01232)

(0.01623)

(0.01668)

(0.01132)

(0.01820)

(0.01747)

(0.00417)

(0.00499)

(0.00522)

(0.01479)

(0.02082)

(0.02035)

(0.01358)

(0.02403)

(0.02322)

(0.00532)

(0.00813)

(0.00877)

(0.01153)

(0.01068)

(0.01034)

(0.01119)

(0.01178)

(0.01109)

(0.00427)

(0.00397)

(0.00417)

EER

0.00001 0.0001 0.001 0.01 0.1

(0.00046)

(0.00047)

(0.00047)

(0.00050)

(0.00026)

(0.00038)

(0.03426)

(0.00103)

(0.00047)

(0.00027)

(0.00084)

(0.00042)

(0.01726)

(0.00093)

(0.00045)

(0.00668)

(0.00031)

(0.00015)

(0.00009)

(0.00029)

(0.00018)

(0.00339)

(0.00030)

(0.00017)

(0.00008)

(0.00004)

(0.00004)

(0.00006)

(0.00004)

(0.00006)

(0.00007)

(0.00004)

(0.00005)

FTE

Figure 5: Full Evaluation – EERs and FTEs




Com

paris

on T

ype

+ D

atas

et +

Fin

ger









0.0001 0.001 0.01 0.1 1

(0.43138)

(0.75148)

(0.00086)

(0.83879)

(0.82917)

(0.08983)

(0.68371)

(0.82203)

(0.82239)

(0.60605)

(0.83790)

(0.84590)

(0.05042)

(0.15368)

(0.24829)

(0.74254)

(0.82959)

(0.82504)

(0.71901)

(0.87638)

(0.87549)

(0.11992)

(0.39563)

(0.45537)

(0.62999)

(0.52307)

(0.54053)

(0.59842)

(0.62557)

(0.62754)

(0.05427)

(0.03737)

(0.04347)

FMR@FNMR=.002

0.0001 0.001 0.01 0.1 1

(0.08983)

(0.37394)

(NA)

(0.57142)

(0.51350)

(0.00837)

(0.20858)

(0.44522)

(0.45484)

(0.14827)

(0.54436)

(0.51912)

(0.00186)

(0.00496)

(0.00648)

(0.34599)

(0.56647)

(0.55902)

(0.31232)

(0.67903)

(0.65064)

(0.00661)

(0.05392)

(0.07445)

(0.20627)

(0.12882)

(0.13083)

(0.15937)

(0.19679)

(0.18714)

(0.00228)

(0.00165)

(0.00213)

FMR@FNMR=.005

Figure 6: Full Evaluation – FMR@FNMR = (0.002, 0.005) and 95% Confdence Intervals

Note: “n/a” indicates that the value could not be reliably measured with the available sample size.



False Non−Match Rate (FNMR)

Com

paris

on T

ype

+ D

atas

et +

Fin

ger









0.0001 0.001 0.01 0.1

(0.02101)

(0.03362)

(0.00330)

(0.04234)

(0.04298)

(0.01192)

(0.03976)

(0.03112)

(0.02998)

(0.03152)

(0.03504)

(0.03448)

(0.00888)

(0.00863)

(0.00900)

(0.06307)

(0.05991)

(0.05838)

(0.05050)

(0.06095)

(0.06011)

(0.01528)

(0.02001)

(0.01978)

(0.05393)

(0.03633)

(0.03665)

(0.04741)

(0.03972)

(0.03880)

(0.01142)

(0.00995)

(0.01077)

FNMR@FMR=.0001

Figure 7: Full Evaluation – FNMR@FMR = 0.0001 and 95% Confdence Intervals




Rol

led

to R

olle

d Pl

ain

to R

olle

d Pl

ain

to P

lain

EER FTE Rate

R Thumb 0.0123 0.0343

R Index 0.0162 0.0010

R Middle 0.0167 0.0005

L Thumb 0.0113 0.0003

L Index 0.0182 0.0008

L Middle 0.0175 0.0004

R/L Thumb 0.0042 0.0173

R/L Index 0.0050 0.0009

R/L Middle 0.0052 0.0004

R Thumb 0.0148 0.0067

R Index 0.0208 0.0003

R Middle 0.0204 0.0002

L Thumb 0.0136 0.0001

L Index 0.0240 0.0003

L Middle 0.0232 0.0002

R/L Thumb 0.0053 0.0034

R/L Index 0.0081 0.0003

R/L Middle 0.0088 0.0002

R Thumb 0.0115 0.0001

R Index 0.0107 0.0000

R Middle 0.0103 0.0000

L Thumb 0.0112 0.0001

L Index 0.0118 0.0000

L Middle 0.0111 0.0001

R/L Thumb 0.0043 0.0001

R/L Index 0.0040 0.0000

R/L Middle 0.0042 0.0001

Table 4: EER and FTE — Dataset AZLA

EER FTE Rate

R Index 0.0216 0.0005

L Index 0.0203 0.0003

R/L Index 0.0055 0.0004

Table 5: EER and FTE — Dataset DHS2

EER FTE Rate

R Index 0.0097 0.0005

L Index 0.0159 0.0005

R/L Index 0.0017 0.0005

Table 6: EER and FTE — Dataset POEBVA



FNMR@FMR = 0.0001 FMR@FNMR = 0.002 FMR@FNMR = 0.005

R Thumb 0.0398 ±0.00111 0.6837 ±0.00263 0.2086 ±0.00230

R Index 0.0311 ±0.00098 0.8220 ±0.00216 0.4452 ±0.00281

R Middle 0.0300 ±0.00097 0.8224 ±0.00216 0.4548 ±0.00282

L Thumb 0.0315 ±0.00099 0.6060 ±0.00277 0.1483 ±0.00201

L Index 0.0350 ±0.00104 0.8379 ±0.00209 0.5444 ±0.00282

L Middle 0.0345 ±0.00103 0.8459 ±0.00204 0.5191 ±0.00283

R/L Thumb 0.0089 ±0.00053 0.0504 ±0.00124 0.0019 ±0.00024

R/L Index 0.0086 ±0.00052 0.1537 ±0.00204 0.0050 ±0.00040

R/L Middle 0.0090 ±0.00053 0.2483 ±0.00244 0.0065 ±0.00045

R Thumb 0.0631 ±0.00137 0.7425 ±0.00247 0.3460 ±0.00269

R Index 0.0599 ±0.00134 0.8296 ±0.00213 0.5665 ±0.00280

R Middle 0.0584 ±0.00133 0.8250 ±0.00215 0.5590 ±0.00281

L Thumb 0.0505 ±0.00124 0.7190 ±0.00254 0.3123 ±0.00262

L Index 0.0610 ±0.00135 0.8764 ±0.00186 0.6790 ±0.00264

L Middle 0.0601 ±0.00135 0.8755 ±0.00187 0.6506 ±0.00270

R/L Thumb 0.0153 ±0.00069 0.1199 ±0.00184 0.0066 ±0.00046

R/L Index 0.0200 ±0.00079 0.3956 ±0.00277 0.0539 ±0.00128

R/L Middle 0.0198 ±0.00079 0.4554 ±0.00282 0.0745 ±0.00148

R Thumb 0.0539 ±0.00128 0.6300 ±0.00273 0.2063 ±0.00229

R Index 0.0363 ±0.00106 0.5231 ±0.00283 0.1288 ±0.00189

R Middle 0.0367 ±0.00106 0.5405 ±0.00282 0.1308 ±0.00191

L Thumb 0.0474 ±0.00120 0.5984 ±0.00277 0.1594 ±0.00207

L Index 0.0397 ±0.00111 0.6256 ±0.00274 0.1968 ±0.00225

L Middle 0.0388 ±0.00109 0.6275 ±0.00274 0.1871 ±0.00221

R/L Thumb 0.0114 ±0.00060 0.0543 ±0.00128 0.0023 ±0.00027

R/L Index 0.0100 ±0.00056 0.0374 ±0.00107 0.0016 ±0.00023

R/L Middle 0.0108 ±0.00058 0.0435 ±0.00115 0.0021 ±0.00026

Rol

led

to R

olle

d Pl

ain

to R

olle

d Pl

ain

to P

lain

Table 7: Details for FNMR@FMR = 0.0001 and FMR@FNMR = (0.002, 0.005) — Dataset AZLA




R Index 0.0423 ±0.00114 0.8388 ±0.00208 0.5714 ±0.00280

L Index 0.0430 ±0.00115 0.8292 ±0.00213 0.5135 ±0.00283

R/L Index 0.0119 ±0.00061 0.0898 ±0.00162 0.0084 ±0.00052

Table 8: Details for FNMR@FMR = 0.0001 and FMR@FNMR = (0.002, 0.005) — Dataset DHS2


R Index 0.0210 ±0.00081 0.4314 ±0.00280 0.0898 ±0.00162

L Index 0.0336 ±0.00102 0.7515 ±0.00245 0.3739 ±0.00274

R/L Index 0.0033 ±0.00032 0.0009 ±0.00017 n/a

Table 9: Details for FNMR@FMR = 0.0001 and FMR@FNMR = (0.002, 0.005) — Dataset POEBVA


3O — Beijing Hisign Technology Co., Ltd. 3 ORIGINAL PFT DATASET

3 Original PFT Dataset


Fals

e N

on−

Mat

ch R

ate

(FN

MR

)

0.0001

0.001

0.01

0.1

0.00

01

0.00

1

0.01 0.

1

02

0.00

01

0.00

1

0.01

0.1

07

0.00

01

0.00

1

0.01 0.

1

02+07

AZLADHS2POEBVA

Figure 8: Original PFT Dataset – DET

EER FNMR@FMR = 0.0001 FMR@FNMR = 0.005

R Index 0.0164 0.0306 0.4267

L Index 0.0183 0.0372 0.5727

R/L Index 0.0052 0.0095 0.0066

R Index 0.0211 0.0415 0.5608

L Index 0.0198 0.0405 0.5043

R/L Index 0.0052 0.0120 0.0062

R Index 0.0092 0.0201 0.0654

L Index 0.0138 0.0317 0.2394

R/L Index 0.0015 0.0031 n/aPOEB

VA

D

HS2

A

ZLA

Table 10: Details for EER, FNMR@FMR = 0.0001, and FMR@FNMR = 0.005 — Original PFT Dataset


Generated on Tuesday 2nd September, 2014, 13:39 13

image group information access division information technology … · 1 day ago · 9 details for...

Documents