Your Name - Portfolio

Featured Projects

Exploiting deflectometric information for high precision eye tracking:

Eye-tracking plays a crucial role in the development of virtual reality devices, neuroscience research, and psychology. However, an accurate, robust, and fast eye-tracking solution remains a considerable challenge for state-of-the-art methods. In our work, we rethink the way specular reflections on the eye surface can be used for fast and accurate eye tracking. Our approach introduces a novel method for eye tracking that combines principles from optical metrology and computational imaging. Compared to the state-of-the-art reflection-based eye tracking approaches, we easily improve the data density by a factor of >3300X, making our method more robust and accurate. We have levergaed different techniques to explore the deflectometic information to estimate the gaze direction, including stereo deflectometry, differentiable rendering and deep learning.

Accurate 3D reconstruction of shiny and specular surfaces:

Accurate and fast 3D imaging of specular or shiny surfaces still poses major challenges for state-of-the-art optical mea- surement principles. Most of common 3D imaging methods can only measure matt surface, such as active triangulation and time-of-flight. Frequently used methods, such as phase-measuring deflectometry (PMD) or shape-from-polarization (SfP), rely on strong assumptions about the measured objects, limiting their generalizability in broader application areas like medical imaging, industrial inspection, virtual reality, or cultural heritage analysis. In our group, we tackle this issue by leveraging and fusing different 3D imaging modalities. For example, We creatively combine polarization cues from SfP with geometric information obtained from PMD to resolve all arising ambiguities and unrealistic assumptions in the 3D measurement. Moreover, we take the advantage of single-shot fringe triangulation and polarization to measure the shiny part for industrial inspection.

Associated Publications:

Shape Measurement of Mixed Reflectance Scenes using Event-Triangulation-Deflectometry:

Traditional optical 3D imaging techniques are limited to specific surface types, such as either diffuse or specular. In this research, we develop a novel technique that enables fast event-based 3D imaging of “mixed reflectance scenes” with high accuracy by jointly exploiting 3D imaging principles: active triangulation and deflectometry. On the captured events, we use epipolar constraints to separate the measured reflections into diffuse, two-bounce specular, and other multi-bounce reflections. The diffuse surfaces in the scene are reconstructed using event-triangulation. Then, the reconstructed diffuse scene is leveraged as a large virtual "display" to evaluate the specular scene via a novel event Deflectometry approach. Our proposed concept integrates active 3D imaging with neuromorphic sensor, leveraging its advantages—such as low latency and high dynamic range—to develop a versatile, "one fits all" 3D imaging solution. The technique significantly advances the state-of-the-art and our fundamental understanding of limits.

Associated Publications: