advances in testing and evaluation using human-biometric sensor interaction modules

24
BIOMETRICS 2014 – OCTOBER 21st ADVANCES IN TESTING AND EVALUATION USING HUMAN-BIOMETRIC SENSOR INTERACTION MODULES

Upload: international-center-for-biometric-research

Post on 02-Dec-2014

56 views

Category:

Technology


2 download

DESCRIPTION

This is the presentation given at the Biometrics 2014 conference in London on October 21st, 2014

TRANSCRIPT

Page 1: Advances in testing and evaluation using Human-Biometric sensor interaction modules

BIOMETRICS 2014 – OCTOBER 21st

ADVANCES IN TESTING AND EVALUATION USING HUMAN-BIOMETRIC SENSOR

INTERACTION MODULES

Page 2: Advances in testing and evaluation using Human-Biometric sensor interaction modules

•Examine the advances in Human Biometric Sensor Interaction model

• Current models

• Work ongoing in the Center

TALK TODAY

Page 3: Advances in testing and evaluation using Human-Biometric sensor interaction modules

WHAT IS THE HUMAN BIOMETRIC SENSOR INTERACTION MODEL

Page 4: Advances in testing and evaluation using Human-Biometric sensor interaction modules

•Traditional biometric testing

• Algorithm testing

• Well established metrics

• Well understood testing methodologies

•Operational testing

• Harder to do

• Access to environments

• Test methodologies dependent in some cases on the test

EVALUATION OF BIOMETRIC TESTING

Page 5: Advances in testing and evaluation using Human-Biometric sensor interaction modules

•Training

• How do users get accustomed to devices?

• Can they remember how to use them?

• How do we provide good training to the users that has a consistent message?

GAPS IN BIOMETRIC TESTING

Page 6: Advances in testing and evaluation using Human-Biometric sensor interaction modules

•Accessibility

• How many people know people who have problems with interacting with a biometric systems?

• How do we deal with accessibility and usability issues?

• Hearing and sight issues

GAPS IN BIOMETRIC TESTING

Page 7: Advances in testing and evaluation using Human-Biometric sensor interaction modules

•Human Factors

• Testing and evaluating biometric systems by looking at how the users interact with the system

• Are performance results different in an operational environment than collect in a lab?

• Are these performance results due to the environment?

GAPS IN BIOMETRIC TESTING

Page 8: Advances in testing and evaluation using Human-Biometric sensor interaction modules

• Is the error always subject centric?

• The role of the device?

• The role of the operator?

GAPS IN BIOMETRIC TESTING

Page 9: Advances in testing and evaluation using Human-Biometric sensor interaction modules

TESTING ENVIRONMENTS ARE MORE COMPLEX

Page 10: Advances in testing and evaluation using Human-Biometric sensor interaction modules

BACKGROUND OF THE HBSI MODEL

Page 11: Advances in testing and evaluation using Human-Biometric sensor interaction modules

HBSI MODEL

Page 12: Advances in testing and evaluation using Human-Biometric sensor interaction modules

•Development of the model

• Initially tested the model on iris, fingerprint

• Then introduced the “Dynamic HBSI model” in partnership with University of Kent, Canterbury

• On to more complex systems such as border gates and mobile platforms

HUMAN BIOMETRIC SENSOR INTERACTION

Page 13: Advances in testing and evaluation using Human-Biometric sensor interaction modules

• Challenges are that devices and biometric systems are:

• Now multifaceted

• Variety of form factors, deployments, applications

• In the hands of more customers

• They become more demanding

• Technology development cycle is short

• Opportunity is how to test and evaluate the interactions without it becoming burdensome to a test facility

CHALLENGES / OPPORTUNITIES

Page 14: Advances in testing and evaluation using Human-Biometric sensor interaction modules

•Border gate – the interaction is more than just presenting your biometric

• Heathrow last night….

USE CASE: BORDER GATES

Page 15: Advances in testing and evaluation using Human-Biometric sensor interaction modules

•Token - the passport

•People traveling - potential incorrect passport

•Throughput issues - how to measure

CHALLENGES

Page 16: Advances in testing and evaluation using Human-Biometric sensor interaction modules

•Token

•False Claim

•Attack

NEW ADDITIONS TO THE HSBI MODEL

Page 17: Advances in testing and evaluation using Human-Biometric sensor interaction modules

• HBSI and Border Gates

• Building a border gate in the center to test various technologies, including iris, fingerprint, documents

• Throughput research

• Usability using the Kinect

• Novel performance metrics such as the Stability Score Index

TESTING AND EVALUATION RESEARCH

Page 18: Advances in testing and evaluation using Human-Biometric sensor interaction modules
Page 19: Advances in testing and evaluation using Human-Biometric sensor interaction modules
Page 20: Advances in testing and evaluation using Human-Biometric sensor interaction modules

•Mobile devices are important as well, and we continue to work in this area:

• Wild testing

• Illumination / Noise / Controlled environments

• Voice, face, signature, palm, and multi-factor authentication

TESTING AND EVALUATION RESEARCH

Page 21: Advances in testing and evaluation using Human-Biometric sensor interaction modules

QUESTIONS

Page 22: Advances in testing and evaluation using Human-Biometric sensor interaction modules

TOKEN HBSI MODEL

Page 23: Advances in testing and evaluation using Human-Biometric sensor interaction modules

TOKEN HBSI MODEL

Page 24: Advances in testing and evaluation using Human-Biometric sensor interaction modules

TOKEN HBSI MODEL