Deriving OT Usability Metrics and Test Scenarios for Authentication in Industry 4.0

Deriving OT Usability Metrics and Test Scenarios for Authentication in Industry 4.0

Supervisor(s): Nikolai Puch, Sebastian Peters
Status: finished
Topic: Others
Author: Fabian Blank
Submission: 2026-04-17
Type of Thesis: Guided Research
Thesis topic in co-operation with the Fraunhofer Institute for Applied and Integrated Security AISEC, Garching

Description

Considerable research exists on the usability of authentication factors in IT. However, industrial applications remain almost entirely 
unexplored. Findings from IT environments may not transfer well to industrial use due to protective equipment or unique environmental 
conditions. These factors motivated the testbed we previously proposed. We conduct a systematic literature review of System Usability 
Scale (SUS) scores across 12 authentication methods. These include password, fingerprint, RFID, and FIDO2, and together establish the 
first cross-factor reference baseline. This reveals critical gaps in research on some authentication factors, most notably RFID and 
PIN authentication.
To complement SUS-based usability evaluations, we define a set of quantitative metrics for efficiency and effectiveness. Based on this work, 
we propose a within-subject study design. We perform an a priori power analysis to determine sample size. Further, we propose concrete test 
scenarios that embed authentication within realistic production tasks. Together, these contributions provide the methodological foundation 
for the first systematic evaluation of authentication usability in an industrial environment.

Index Terms — Usability, Testbed, Authentication, Industry 4.0, OT Security