
Smart Eye Pro in a Helicopter Simulator with DLR Institute of Flight Systems
Eye Tracker Assists Researchers in Human Factor Studies
The University of the German Armed Forces in Munich focuses on scientific work and the academic study of German officers. The university offers a total of 18 programs of study in 10 departments, and about 2800 students attended in 2017. The scientific facilities enable high-level, internationally competitive research.
This study is conducted at the Institute of Flight Systems, which is organized within the Aerospace Engineering Department.
“It was clear that no other system was as accurate
and as easy to use as the Smart Eye Pro system”
— Yannick Brand, Researcher at the DLR Institute of Flight Systems
The Research
Smart Eye Pro is used to estimate the current activity and workload of helicopter crews based on gaze movements. The study group has deployed the Smart Eye Pro system in a helicopter mission simulator. Two eye-tracking systems are synchronized to capture the head orientation and gaze direction of two pilots simultaneously. The tracking data produced by Smart Eye Pro is forwarded live to an analysis system designed by the study group.
The analysis operates in two stages. The first stage recognizes when the gaze intersects with areas of interest (so-called AOIs, representing, for example, buttons or instruments), enabled by the Smart Eye Pro 3D world model. The second stage performs a 2-dimensional error estimate for the intersection coordinates, then matches the position to the internal representation of the currently shown object on the screen, e.g., an object on the tactical map. As a result, the analysis has produced a semantic gaze tracking application.
The complete tracking and analysis system produces statistics, visualizations, and graphs that report the activity and workload of the pilots during a mission. In addition, an adaptive associate system uses this information to automatically support the crew in optimizing their activities and mitigating high workloads.
Why Smart Eye Pro?
“We knew what we needed to get to make the study successful. It had to be a remote eye tracking system that was scalable in terms of number of cameras, provided very accurate measurements and was easy to use.” Yannick Brand, one of the researchers of the Institute of Flight Systems, has been part of the study from the beginning and as the project progressed he has become more and more convinced that Smart Eye was the right choice.
The study group reviewed other eye trackers on the market. However, none of them was as good a fit as Smart Eye. “There are really only a few companies that have this kind of advanced solution. But it was clear that no other system was as accurate and as easy to use as the Smart Eye Pro system”.
How has it been using Smart Eye Pro?
All through the study, Smart Eye Pro has proven to be stable and robust. Thanks to both flexibility in HW configuration and a high number of different output parameters provided by the SW algorithm, Smart Eye Pro is, by the University of the German Armed Forces, considered to be a very versatile research instrument that can be utilized in different applications aimed at a range of studies (not only human factors).
“During the first set-up and in our initial learning process, we thought Smart Eye Pro required quite some time for the calibration process. But when we saw the level of accuracy in gaze measurement it gave us, we gladly took that extra time into account”.
During 2017, Smart Eye was asked by the university to alter the behavior of the SW. “I was pleased by the amount of attention that we got,” Yannick continues. “We received immediate interim help from the support team, and the product management and development teams provided the final solution to our request promptly.

