Single Engine Multimodal Biometrics

1
Single Engine Multimodal Biometrics
PRESENTED BY
Dr. Andrzej Rucinski Andrzej.Rucinski_at_unh.edu
AUTHORS
University of New Hampshire National
Infrastructure Institutes Center for
Infrastructure Expertise
Dr. Andrzej Rucinski Andrzej.Rucinski_at_unh.edu
Artur Skrygulec Artur.Skrygulec_at_avalton.com
2
OUTLINE
Infrastructure
Biometrics 101
Single Engine Biometrics
Virtual Instrumentation
Applications
Contacts
3
OUTLINE
Infrastructure
Biometrics 101
Single Engine Biometrics
Virtual Instrumentation
Applications
Contacts
4
INFRASTRUCTURE

• National Infrastructure Institute (NI2)
• Fast Pattern Recognition Corporation (FPR)
• Spaceflight Systems Corporation (SSC)
• University of New Hampshire (UNH)

5
INFRASTRUCTURE

• National Infrastructure Institute (NI2)
• Fast Pattern Recognition Corporation (FPR)
• Spaceflight Systems Corporation (SSC)
• University of New Hampshire (UNH)

6
INFRASTRUCTURE NI2

• National Infrastructure Institute (NI2)
• Mission explore best practices and creative
  solutions involving critical infrastructure
  issues related to homeland security.
• Goal research on infrastructure issues to
  provide both government and the private sector
  with solutions to improve the management and
  protection of our nation's built infrastructure.
• Specific projects

7
INFRASTRUCTURE NI2

• National Infrastructure Institute (NI2)
• Specific Projects

8
INFRASTRUCTURE NI2

• National Infrastructure Institute (NI2)
• Canada-United States Cargo Security Project

• Provide a rapidly assembled prototype test-bed
  for elements of cargo container supply chain
  security
• Production of demonstration models for the
  international container shipping system

• Improving security practices by using
  point-of-origin security, in-transit tracking and
  monitoring and data query capability designed to
  validate and facilitate the movement of
  containerized cargo

9
INFRASTRUCTURE NI2

• National Infrastructure Institute (NI2)
• Specific Projects

10
INFRASTRUCTURE NI2

• National Infrastructure Institute (NI2)
• School Bus Project Mission
• Develop a Safe Secure School Bus Prototype

• Build a safe school bus system prototype
• Assist Safe Secure Schools committee to define
  standards
• Cooperate with local firms (GlobaFone)
• Demonstrate a pathway to homeland security
  business in the State of New Hampshire

11
INFRASTRUCTURE NI2 Contacts
National Infrastructure Institute (NI2)

• Donald P. Bliss
• NI2 Center for Infrastructure Expertise
• 100 Arboretum Drive
• Portsmouth, NH 03801, U.S.A.
• Phone [phone]
• Fax [phone]
• Email dbliss_at_ni2.org

Contacts
12
INFRASTRUCTURE

• National Infrastructure Institute (NI2)
• Fast Pattern Recognition Corporation (FPR)
• Spaceflight Systems Corporation (SSC)
• University of New Hampshire (UNH)

13
INFRASTRUCTURE FPR

• Fast Pattern Recognition Corporation (FPR)
• Patented Technology
• Biometric Recognition Engine
• Fast Pattern Recognition Technology
• Proven Correlation Based Algorithm
• Multiple Applications
• Fingerprint
• Face
• Voice
• Shape
• Image

14
INFRASTRUCTURE FPR
Fast Pattern Recognition Corporation
(FPR) Reliability
15
INFRASTRUCTURE FPR Contacts
Fast Pattern Recognition Corporation (FPR)

• Dr. John T. Apostolos
• Fast Pattern Recognition Corp.
• 3 Majestic Lane
• Merrimack, NH 03054, U.S.A.
• Phone [phone]
• Fax [phone]
• Email JA720_at_aol.com

Contacts
16
INFRASTRUCTURE

• National Infrastructure Institute (NI2)
• Fast Pattern Recognition Corporation (FPR)
• Spaceflight Systems Corporation (SSC)
• University of New Hampshire (UNH)

17
INFRASTRUCTURE SSC

• Spaceflight Systems Corporation (SSC)
• SSC Founded October 1989
• SEA Biometrics, LLC
• ESCA, Inc.

• Primarily Satellite Electronics Technology S/W
• 19 Engineers, 2 Administrative
• Bedford N.H. (10 minutes to Manchester Airport)
• 9,700 square foot office space
• 1,500 square foot secure facility

18
INFRASTRUCTURE SSC

• Spaceflight Systems Corporation (SSC)
• Custom Spaceflight Electronics
• Real-time Applications Software
• Ground Workstations
• Specialized Algorithms
• Advanced Technology
• FPGA Design Services
• Demonstrations
• Proofs-of-Concept

19
INFRASTRUCTURE SSC
Spaceflight Systems Corporation (SSC) Experience
Naval Research Laboratory Pre-Configured I/F
Payload Program Microelectronics Photonics Test
Bed On-Board Processor
USAF/SD Solar Mass Ejection Instrument
Camera P78-1 Command and Telemetry System Defense
Meteorological Support Program
Goddard Spaceflight Center Upper Atmosphere
Research Satellite Spectral UV Irradiance
Monitor Large Aperture Solar Camera
ARO Triangle Research Park Army 04 STTR Biometric
Fusion
BAE and Lockheed Martin On-Board Processor
Communications Synchronization Unit
Commercial (ESCA) MD2 Medicine Dispenser
20
INFRASTRUCTURE SSC

• Spaceflight Systems Corporation (SSC)
• Products Designed/Supported

MD2 Medicine Dispenser Commercial
Technology On-line with Service Center Remote
Programming Remote Monitoring Automatic Caretaker
Alerts
On-Board Processor (OBP) Satellite
Computer Multi-processor Radiation Tolerant
S-Band Interface Electronics (SBIFE) Digital
Radio Receiver Space Technology
21
INFRASTRUCTURE SSC

• Spaceflight Systems Corporation
• Biometric Multimodal Solution

22
INFRASTRUCTURE SSC Contacts
Spaceflight Systems Corporation (SSC)

• Dr. R. Sterling Eanes
• Spaceflight Systems Corporation
• 47 Constitution Drive
• Bedford, NH 03110, U.S.A.
• Phone [phone]
• Fax [phone]
• Email sterling_at_ssc-nh.com

Contacts
23
INFRASTRUCTURE

• National Infrastructure Institute (NI2)
• Fast Pattern Recognition Corporation (FPR)
• Spaceflight Systems Corporation (SSC)
• University of New Hampshire (UNH)

24
INFRASTRUCTURE UNH

• University of New Hampshire (UNH)

• Research Assets Design
• Research Assets Tests
• TQM Research Assets Reliability
• UNH Security Engineering Assets

25
INFRASTRUCTURE UNH

• University of New Hampshire
• Research Assets Design
• Design Automation Lab

VHDL description library ieee use
ieee.std_logic_1164.all use ieee.std_logic_unsign
ed.all entity control_counter is port (clk
in std_logic -- signal from oscillator
enable in std_logic -- enable from instruction
decoder reset in std_logic -- reset
from TAP,active '0' status out
std_logic -- goes to '1' if only the counter
reached max ctrl out std_logic
) end control_counter architecture
control_counter of control_counter is
.
26
INFRASTRUCTURE UNH

• University of New Hampshire
• Research Assets Tests

- an IEEE 1149.1/IEEE 1149.4 cell library for
MOSIS AMI 0.5
- the design methodology for IEEE 1149.4
compatible designs
- the R, and C measurement methodologies using
IEEE 1149.4
- the corrosion monitoring module for IEEE 1149.4
27
INFRASTRUCTURE UNH

• University of New Hampshire
• Research Assets Tests

• The research has been done in the areas of
• Design For Test (DFT)
• Built In Self Test (BIST)
• IEEE P1500 Embedded Core Test

• We work with the ATE tools
• MCT 2000
• Eclipse System
• JTAG Technologies

28
INFRASTRUCTURE UNH

• University of New Hampshire
• TQM Research Assets Reliability

PRISM as a reliability estimation tool
29
INFRASTRUCTURE UNH

• University of New Hampshire
• UNH Security Engineering Assets

Fingerprint Identification
30
INFRASTRUCTURE UNH

• University of New Hampshire
• UNH Security Engineering Assets
• Adaptation of a SW/HW Application
• Reverse Engineering
• Modification of the Algorithm (Matlab)
• Development of the VHDL Prototype
• Implementation in FPGA

31
INFRASTRUCTURE UNH

• University of New Hampshire
• UNH Security Engineering Assets

DES PROJECT (Encryption)
KEY          00451338957377INPUT      
e5c7cdde872bf27cOUTPUT   5c5b2158f9d8ed9b
32
INFRASTRUCTURE UNH Contacts
University of New Hampshire (UNH)

• Dr. Andrzej Rucinski
• University of New Hampshire
• Department of Electrical and Computer Engineering
• Durham, NH 03824, U.S.A.
• Phone [phone]
• Fax [phone]
• Email andrzej.rucinski_at_unh.edu

Contacts
33
OUTLINE
Infrastructure
Biometrics 101
Single Engine Biometrics
Virtual Instrumentation
Applications
Contacts
34
BIOMETRICS 101 Motivation

• Geopolitical Situation
• Global Economy
• Terrorism
• Public Safety
• Personal Security
• Protection of Privacy (Identity Theft)
• Password, PIN, Access Card, Biometrics
• Technology
• Complex and Fast DSP ICs (SoC)
• Reliable Biometric Authentication Algorithms
• VHDL Development Tools (Parameterization,
  Testability)
• Technology Independence and Upgradeability
• What is the best personal authorization system?

35
BIOMETRICS 101 Fundamentals

• Biometrics) any human physiological and/or
  behavioral characteristic can be used as a
  biometric characteristic as long as it satisfies
  the following requirements
• Universality each person should have the
  characteristic
• Distinctiveness any two persons should be
  sufficiently different in terms of the
  characteristic
• Permanence the characteristic should be
  sufficiently invariant over a period of time
• Collectability the characteristic can be
  measured quantitatively

) A. K. Jain, A. Ross, An Introduction to
Biometric Recognition, IEEE Transactions on
Circuits and Systems for Video Technology, vol.
14, no. 1, January 2004
36
BIOMETRICS 101 Fundamentals

• Biometrics
• Eye Features (Iris, Retina)
• FACE
• DNA
• Hand Geometry
• FINGERPRINT
• Voice Recognition
• Signature Scan
• Body Odor
• Keystroke Pattern

37
BIOMETRICS 101 Fundamentals

• Biometric System
• Enrollment
• Identification
• Verification
• Fingerprint Recognition Algorithms
• Extraction of Minutiae Points
• Entire Ridge Pattern

Biometric System ) a pattern recognition
system that operates by acquiring biometric data
from an individual, extracting a feature set from
acquired data, and comparing this feature set
against the template in the database. Depending
on the application a biometric system may operate
either in verification or identification mode.
) A. K. Jain, A. Ross, An Introduction to
Biometric Recognition, IEEE Transactions on
Circuits and Systems for Video Technology, vol.
14, no. 1, January 2004
38
BIOMETRICS 101 Fundamentals
Enrollment Enrollment (Figure 6 a) is a
process of collecting a users biometric data and
identification data. The biometric data is
typically stored as a template in a template
database that can be referred to during
verification or identification procedures. Veri
fication ) in the verification mode (1-to-1
matching), the system validates a persons
identity by comparing the captured biometric data
with her own biometric template(s) stored in the
system database. In such a system an individual
who desires to be recognized claims an identity
via a personal identification number, user name
or smart card. Identification ) in the
identification mode (1-to-many matching), the
system recognizes an individual by searching the
templates of all the users in the database for a
match
) A. K. Jain, A. Ross, An Introduction to
Biometric Recognition, IEEE Transactions on
Circuits and Systems for Video Technology, vol.
14, no. 1, January 2004
39
BIOMETRICS 101 Targets

• Miniaturization (SoC)
• Low Power (Less than 1Watt)
• Fast (under 100ms)
• Secure
• Upgradeable
• Designed for Testability
• Reliable in Harsh Environments

40
BIOMETRICS 101 TQM Methodology
Gajskis Diagram
TQM Loop
41
BIOMETRICS 101 TQM Methodology

• Design Specification
• Architecture Definition
• Technology Mapping
• Algorithm Development
• Virtual Prototyping
• Technology Migration
• Interfaces Development
• Hardware Prototype Development

• Reliability Model

• Verification and Testing

42
BIOMETRICS 101 Proof-of-the-Concept

• Infrastructure
• University of new Hampshire
• FPR Fast Pattern Recognition Corporation
• NHRIC New Hampshire Research Industrial Center
• Multidisciplinary Project
• Software
• Hardware
• Mechanics
• Technology Migration
• Biometrics Engine for Recognition
• Image Recognition System
• Fingerprint
• Face
• Voice
• IR (Infra Red) Image

43
BIOMETRICS 101 Design Process

• Hardware Design
• Block Diagrams

44
BIOMETRICS 101 Design Process

• Software Design
• Dataflow Block Diagrams

45
BIOMETRICS 101 Design Process

• Technology Migration

46
BIOMETRICS 101 Design Process

• System Assembly

47
BIOMETRICS 101 Design Process
System Assembly
48
BIOMETRICS 101 Proof-of-the-Concept
49
BIOMETRICS 101 Proof-of-the-Concept
Xilinx-VIRTEX II Prototype Fingerprint
Recognition System Successfully
Assembled! Processing/Recognition Time 19
ms/user ! Reliability 97 Power Supply 1.5 V
and 3.3 V Size 2" x 2" x 0.5"
50
OUTLINE
Infrastructure
Biometrics 101
Single Engine Biometrics
Virtual Instrumentation
Applications
Contacts
51
SINGLE ENGINE BIOMETRICS

• Enrollment/Authentication Common Operations
• Step 1 Image Capture and Storage
• Step 2 Spatial Filtering
• Step 3 1-D FFT
• Step 4 Cutting off Negative Frequency Components
• Enrollment Specific Operations
• Step 5 Complex Conjugate
• Step 6 Chirp Signal
• Step 7 Hard Limit
• Step 8 Template Storage
• Authentication Specific Operations
• Step 5 Template Multiplication
• Step 6 Matched Filtering
• Step 7 Decision

52
SINGLE ENGINE BIOMETRICS

• Enrollment/Authentication Common Operations
• Step 1 Image Capture and Storage
• Step 2 Spatial Filtering
• Step 3 1-D FFT
• Step 4 Cutting off Negative Frequency Components
• Enrollment Specific Operations
• Step 5 Complex Conjugate
• Step 6 Chirp Signal
• Step 7 Hard Limit
• Step 8 Template Storage
• Authentication Specific Operations
• Step 5 Template Multiplication
• Step 6 Matched Filtering
• Step 7 Decision

53
ENROLLMENT/AUTHENTICATION Common Operations
Step 1
Step 2
Step 1 Fingerprint Image Capture Using
Fingerprint Sensor Step 2 Fingerprint Image
Internal Storage
54
ENROLLMENT/AUTHENTICATION Common Operations
Step 3 Spatial Filtering Using 9x9
Convolution Kernel
55
ENROLLMENT/AUTHENTICATION Common Operations
Step 4 1-D Discrete Fourier Transformation/Nega
tive Frequency Components Removal
56
SINGLE ENGINE BIOMETRICS

• Enrollment/Authentication Common Operations
• Step 1 Image Capture and Storage
• Step 2 Spatial Filtering
• Step 3 1-D FFT
• Step 4 Cutting off Negative Frequency Components
• Enrollment Specific Operations
• Step 5 Complex Conjugate
• Step 6 Chirp Signal
• Step 7 Hard Limit
• Step 8 Template Storage
• Authentication Specific Operations
• Step 5 Template Multiplication
• Step 6 Matched Filtering
• Step 7 Decision

57
ENROLLMENT Specific Operations
Step 5
Step 5 Complex Conjugate cajb gt ca-jb
58
ENROLLMENT Specific Operations
Step 6
Step 6 Complex Chirp Multiplication (Frequency
Domain Representation) k1,2...,1024
59
ENROLLMENT Specific Operations
Before Limiting
After Limiting
Step 7 Hard Limit Function (16 bit -gt 1 bit),
Template Storage
60
SINGLE ENGINE BIOMETRICS

• Enrollment/Authentication Common Operations
• Step 1 Image Capture and Storage
• Step 2 Spatial Filtering
• Step 3 1-D FFT
• Step 4 Cutting off Negative Frequency Components
• Enrollment Specific Operations
• Step 5 Complex Conjugate
• Step 6 Chirp Signal
• Step 7 Hard Limit
• Step 8 Template Storage
• Authentication Specific Operations
• Step 5 Template Multiplication
• Step 6 Matched Filtering
• Step 7 Decision

61
AUTHENTICATION Specific Operations
Spatial Filtering
Step 5
Step 5 Multiplication of Unknown Image Data with
Templates Stored in Enrollment Database
62
AUTHENTICATION Specific Operations
Multiplication Result U Unknown Image U -
Complex Conjugate of U T Template C Chirp
Signal (Fourier Transform)
k1,2,3,,1024 ?3.14 e2.71
63
AUTHENTICATION Specific Operations
Spatial Filtering
Step 6
Step 7
Step 6 Frequency Domain Filter Matched to Chirp
Signal Used in Enrollment Completes
Correlation Step 7 Decision Block
Threshold/Weighting/Adaptation
64
AUTHENTICATION Specific Operations
Correlation Result
65
SINGLE ENGINE BIOMETRICS Multimodal Test Results
66
OUTLINE
Infrastructure
Biometrics 101
Single Engine Biometrics
Virtual Instrumentation
Applications
Contacts
67
VIRTUAL INSTRUMENTATION

• National Instruments
• Data Acquisition Cards
• (DAQ) Hardware
• LabVIEW Virtual
• Engine Software
• Speed and Accuracy
• Remote Solutions
• PDA
• Laptop
• WWW Web Servers

68
VIRTUAL INSTRUMENTATION

• Mechanics
• Electronics
• Environment
• Machine
• Human
• Animal
• Anything You May Attach Sensor To

69
VIRTUAL INSTRUMENTATION

• Speed
• Accuracy
• Reliability
• Digital
• Analog

• Temperature
• Pressure
• Humidity
• Acceleration
• Current/Voltage
• Frequency
• etc.

70
VIRTUAL INSTRUMENTATION

• Speed
• Accuracy
• Reliability
• Number of Channels

• Fixed Solutions
• Mobile Solutions
• Satellite
• Wireless
• Network

71
VIRTUAL INSTRUMENTATION

• Data Storage
• Data Processing
• Data Visualization
• Data Analyzing
• Data Threshold
• Feedback Action

72
VIRTUAL INSTRUMENTATION

• Customized Reports
• Local/Remote Reporting
• Web Reporting
• Report Distribution
• E-mail
• Fax
• Short Message
• Logs
• Report Storage

73
OUTLINE
Infrastructure
Biometrics 101
Single Engine Biometrics
Virtual Instrumentation
Applications
Contacts
74
APPLICATIONS Single Engine Biometrics

• FPR Pattern Recognition
• EKG
• Blood Tests
• Brest Cancer Diagnostics
• Virtual Instrumentation and Measurement
• Remote Monitoring and Controlling
• Remote Surgeries
• WWW-NET Server
• Data Transmission
• Voice Transmission
• Vision Transmission

75
APPLICATIONS Single Engine Biometrics

• FPR Pattern Recognition
• Breast Cancer Diagnostics

76
APPLICATIONS Single Engine Biometrics

• FPR Pattern Recognition
• Voice Recognition

77
APPLICATIONS Single Engine Biometrics

• Pattern Recognition SSC Multimodal Recognition
  Prototype
• Face and Fingerprint Recognition Multimodal
  Biometrics

78
APPLICATIONS Virtual Instrumentation

• NI LabVIEW PDA-Based System Helps EMS Personnel
  Save Lives
• Industry
• Medical/Medical Instrumentation
• Product
• LabVIEW PDA

The Challenge Delivering a portable, noninvasive
instrument for first responders to assess a
patients neurological condition and provide
early detection of traumatic brain injury (TBI)
as well as diagnosis and differentiation of
stroke.
http//sine.ni.com/csol/cds/item/vw/p/id/546/nid/1
24400
79
APPLICATIONS Virtual Instrumentation

• NI-IMAQ and LabVIEW Automate the Study of Eye
  Motion
• Industry
• Life Science
• Product
• Data Acquisition, LabVIEW, Vision

The Challenge Finding a means to automate the
monitoring of human eye motion to aid physicians
in researching internal ear diseases.
http//sine.ni.com/csol/cds/item/vw/p/id/185/nid/1
24400
80
APPLICATIONS Virtual Instrumentation

• LabVIEW PDA Module for Incubator Monitoring
  System
• Industry
• Medical/Medical Instrumentation
• Product
• LabVIEW, LabVIEW PDA

The Challenge Creating a system to monitor the
temperature and humidity inside incubators at a
hospital intensive care unit.
http//sine.ni.com/csol/cds/item/vw/p/id/561/nid/1
24400
81
OUTLINE
Infrastructure
Biometrics 101
Single Engine Biometrics
Virtual Instrumentation
Applications
Contacts
82
QUESTIONS/CONTACTS
Thank you
Dr. Andrzej Rucinski Artur
Skrygulec University of New Hampshire AVALTON
Technologies Inc. Department of Electrical and
Computer Engineering 18 Benajah Road Durham, NH
03824, U.S.A. Barrington, NH 03825 Phone
(1-603) 862-1381 Phone (1-603)
969-2180 Fax [phone] Fax (1-603)
218-6166 Email Andrzej.Rucinski_at_unh.edu Email
Artur.Skrygulec_at_avalton.com