Sam Van der Jeught tenure track asst. professor

Research Sam Van der Jeught

Research team

Expertise

- Biomedical and non-destructive optical imaging techniques - Artificial neural networks - GPU/parallel programming - Optical coherence tomography - The human eardrum

Towards Clinical Application: Enhancing and Validating 3D-otoscopic device. 01/05/2024 - 30/04/2025

Abstract

This proposal aims to improve and clinically validate our 3D-otoscopic device. Initially developed in POC project 38820, the device allows for real-time, in-vivo imaging of the eardrum surface. During preclinical trials at UZA, ENT physicians identified several issues that prevented accurate results. Firstly, physicians deemed color imaging necessary to navigate the device within the ear canal to quickly find the eardrum location. Secondly, the neural network responsible for converting the deformed fringe patterns to full-field height maps underperformed compared to lab settings because it was not trained on data representing the human eardrum's reflective properties. This project will resolve these issues so that the device can be used effectively in the clinical ENT setting. The goal is to elevate the device from TRL 4-5 to TRL 6 and prepare it for clinical validation and commercialization. This project leverages unique collaborations with ENT experts. It is protected by intellectual property, enabling us to publish our findings and establish the device's efficacy in clinical settings, thereby paving the way for future licensing opportunities. This phase is a critical step in positioning our technology as an essential tool for otoscopic examinations and middle ear pathology assessment.

Researcher(s)

Research team(s)

Project type(s)

  • Research Project

Lower limb instability: the missing link between knee and ankle. 01/01/2024 - 31/12/2027

Abstract

Sport injuries account for 10-20% of all acute injuries treated in the emergency room. From this, the most common injuries are knee and ankle injuries. Injury-prevention techniques rely on understanding the injury mechanisms. The focus in this project will be on anterior-cruciate ligament (ACL) rupture in the knee joint and high ankle sprains (syndesmosis injury) as they are difficult to diagnose and often are misdiagnosed potentially leading to chronic instability. To improve diagnosis, a novel imaging technique, standing CT, is used as knee and ankle joints can be imaged under standing conditions rather than the currently used supine position. A novel medical device is developed to extend the standing CT from static testing to dynamic testing. The prototype allows for internal/external rotation and varus/valgus rotation in the ankle joint to simulate different positions of the foot. Kinematic measurements allow for measurement of the joint laxity in the knee and ankle, which has been focus of the PI's previous research. ACL deficient knees will be tested in-vitro to define when ACL rupture occurs. Ankle syndesmosis conditions will be simulated in an in-vitro test validating the new prototype. The final step in this research is a first-in-human test in the standing CT to evaluate if the position of the foot is inducing ACL rupture or high ankle sprains. As follow up of this project, an IOF project will be taken on to bring the device on the market.

Researcher(s)

Research team(s)

Project type(s)

  • Research Project

3DEEP: ultrafast, deep learning-based single-shot 3D profilometry. 01/07/2023 - 30/06/2027

Abstract

Structured light profilometry is an established optical technique that measures the 3D shape of an object by projecting fringe patterns (usually lines) onto the object surface and by observing the deformed lines under a fixed angle. Today, state-of-the-art structured light profilometry requires three or more unique recordings to analytically determine the full-field height map of the object. This limits the 3D acquisition speed of the application, complicates the optical setup of the measurement system, and induces motion artifacts in the 3D scans when the target moves between subsequent recordings. In this project, we will train a custom neural network to convert a single deformed structured light pattern directly into its corresponding 3D surface map. By doing so, we will effectively solve the correspondence problem between deformed fringe pattern and 3D map using only a single input image. This will hugely increase the 3D measurement speed in real-time applications, with the frame rate of the camera now being the only limiting factor. In addition, the optical complexity and cost of current state-of-the-art optical scanning systems will be significantly reduced, which will create new possibilities in medical imaging, industrial inspection, machine vision, entertainment, and biometric access security applications. Furthermore, we will build on this new strategy to answer the question of whether neural networks can learn to extract high-resolution and absolute 3D information from a single 2D camera image of an object without using any projected lines, dots, or other fringe patterns – much like humans with monocular vision do. This will omit the need for a projection unit in a 3D scanner altogether and will effectively convert any smartphone camera, endoscope, or smart glasses into quantitative 3D scanning systems. This will result in an entirely new single-shot, ultrafast, and fully scalable 3D depth-sensing technique.

Researcher(s)

Research team(s)

Project type(s)

  • Research Project

Otoscopic profilometry: a new optical technique to quantitatively measure human eardrum deformation in-vivo, in 3D and in real-time. 01/01/2019 - 31/12/2020

Abstract

The 3D shape of the human eardrum plays a crucial role in the process of sound transmission and any structural change to its topography is an important indicator for existing or impending middle ear pathology and subsequent hearing loss. This POC-project includes the prototyping of a new non-invasive medical device, capable of measuring high-resolution eardrum deformation in 3D and in real-time.

Researcher(s)

Research team(s)

Project type(s)

  • Research Project

Otoscopic profilometry: a new optical technique to quantitatively measure human eardrum deformation in-vivo, in 3D and in real-time. 01/10/2018 - 30/09/2021

Abstract

The human eardrum is a conically shaped thin membrane which separates the outer ear from the middle ear. It conducts sound vibrations from the external ear canal to the ossicles and protects the middle ear from infections. The 3D shape of the eardrum plays a crucial role in this process and any structural change to its topography is an important indicator for existing or impending pathology or hearing impairment. In previous work, I have demonstrated that 3D shape data of a cadaveric human eardrum can be obtained by using a modified clinical otoscope that simultaneously projects structured light patterns onto the eardrum and records them with a digital camera, placed at a relative angle to the projection axis. By employing a high-speed camera and by using parallel programming techniques, the digital processing pipeline is sufficiently fast to extract full-field surface shape deformations of a dye-coated eardrum in real-time. In the proposed research project, I will redesign both the optical imaging engine and the hardware setup of the otoscopic device to increase its imaging resolution when applied to uncoated eardrums. This way, the non-invasive imaging technique can be employed in the clinical setup and dynamic 3D eardrum shape data of living patients can be gathered for the first time. I will validate tympano-topography as a diagnostic tool in the ENT-office in the detection of early-stage middle ear inflammation, cholesteatoma and Eustachian tube (dys)functioning.

Researcher(s)

Research team(s)

Project type(s)

  • Research Project

Development and validation of a handheld 3D-otoscope. 01/04/2018 - 31/03/2019

Abstract

The human eardrum is a conically shaped thin membrane that separates the outer ear from the middle ear. It conducts sound vibrations from the external ear canal to the ossicles and protects the middle ear from infections. The 3D shape of the eardrum plays a crucial role in this process and any structural change to its topography is an important indicator for existing or impending pathology or hearing impairment. An accurate, quantitative technique to measure 3D deformation of the membrane in-vivo is however still missing. Continuing on the research that I have conducted during my PhD and during the first two years of my post-doctoral postition, I will develop a new optical measurement technique to measure eardrum deformations in 3D, in real-time and with high resolution in living patients. Based on previously published results (see 2017 bibliography), we can show that in order to implement 'structured light profilometry' techniques in a miniaturised optical setup such as a handheld otoscopic device, we have to replace the 3-or 4-phase shifting technique with one that only requires a single pattern to be projected on the target surface, per 3D measurement. To facilitate this, we are developing a novel correspondence technique based on deep learning pattern recognition to link input fringe patterns to output surface models directly. By employing a highspeed camera and state-of-the-art parallel programming techniques, the digital processing pipeline will be sufficiently fast to enable real-time monitoring of eardrum surface shape deformations that are caused by (controlled) pressure changes in the middle ear cavity. Both fundamental properties of eardrum mechanics and practical applicability in the clinical setup will be investigated. The new otological device will be validated in the ENT office as a diagnostic tool in the detection of early-stage middle ear inflammation, retraction pockets, cholesteatoma and Eustachian tube (dys)functioning.

Researcher(s)

Research team(s)

Project type(s)

  • Research Project

Otoscopic profilometry: a new optical technique to quantitatively measure human eardrum deformation in 3D and in real-time. 01/01/2018 - 31/12/2020

Abstract

The human eardrum is a conically shaped thin membrane which separates the outer ear from the middle ear. It conducts sound vibrations from the external ear canal to the ossicles and protects the middle ear from infections. The 3D shape of the eardrum plays a crucial role in this process and any structural change to its topography is an important indicator for existing or impending pathology or hearing impairment. In the proposed research project, I will develop a new technique to measure 3D eardrum deformations in living patients. Using a modified clinical otoscope, structured light patterns will be projected onto the eardrum, after which the patterns are deformed by the eardrum's surface shape. When observed by a digital camera, placed at a relative angle to the projection axis, full-field depth data can be extracted from the deformation of the light patterns. By employing a high-speed camera and state-of-the-art parallel programming techniques, the digital processing pipeline will be sufficiently fast to enable real-time monitoring of eardrum surface shape deformations that are caused by (controlled) pressure changes in the middle ear cavity. Fundamental properties of eardrum mechanics and practical applicability in the clinical setup will be investigated. The new otological device will be validated in the ENT office as a diagnostic tool in the detection of early-stage middle ear inflammation, retraction pockets, cholesteatoma and Eustachian tube (dys)functioning.

Researcher(s)

Research team(s)

Project type(s)

  • Research Project

Optical methods for quantitative measurement of eardrum deformation as a new tool for evaluation of Eustachian tube function and eardrum elasticity 01/04/2016 - 31/03/2017

Abstract

The human eardrum is a conically shaped thin membrane that separates the outer ear from the middle ear. It conducts sound vibrations from the external ear canal to the ossicles and protects the middle ear from infections. The 3D shape of the eardrum plays a crucial role in this process and any structural change to its topography is an important indicator for existing or impending pathology or hearing impairment. In this research project, I will develop a new technique to measure 3D eardrum deformations in living patients. Using a modified clinical otoscope, structured light patterns will be projected onto the eardrum, after which the patterns are deformed by the eardrum's surface shape. When observed by a digital camera placed at a relative angle to the projection axis, fullfield depth data can be extracted from the deformation of the light patterns. By employing a highspeed camera and state-of-the-art parallel programming techniques, the digital processing pipeline will be sufficiently fast to enable real-time monitoring of eardrum surface shape deformations that are caused by (controlled) pressure changes in the middle ear cavity. Both fundamental properties of eardrum mechanics and practical applicability in the clinical setup will be investigated. The new otological device will be validated in the ENT office as a diagnostic tool in the detection of early-stage middle ear inflammation, retraction pockets, cholesteatoma and Eustachian tube (dys)functioning.

Researcher(s)

Research team(s)

Project type(s)

  • Research Project

Optical methods for quantitative measurement of eardrum deformation as a new tool for evaluation of Eustachian tube function and eardrum elasticity. 01/10/2015 - 30/09/2018

Abstract

The human eardrum is a conically shaped thin membrane which separates the outer ear from the middle ear. It conducts sound vibrations from the external ear canal to the ossicles and protects the middle ear from infections. The 3D shape of the eardrum plays a crucial role in this process and any structural change to its topography is an important indicator for existing or impending pathology or hearing impairment. In the proposed research project, I will develop a new technique to measure 3D eardrum deformations in living patients. Using a modified clinical otoscope, structured light patterns will be projected onto the eardrum, after which the patterns are deformed by the eardrum's surface shape. When observed by a digital camera placed at a relative angle to the projection axis, fullfield depth data can be extracted from the deformation of the light patterns. By employing a highspeed camera and state-of-the-art parallel programming techniques, the digital processing pipeline will be sufficiently fast to enable real-time monitoring of eardrum surface shape deformations that are caused by (controlled) pressure changes in the middle ear cavity. Both fundamental properties of eardrum mechanics and practical applicability in the clinical setup will be investigated. The new otological device will be validated in the ENT office as a diagnostic tool in the detection of early-stage middle ear inflammation, retraction pockets, cholesteatoma and Eustachian tube (dys)functioning.

Researcher(s)

Research team(s)

Project type(s)

  • Research Project

New diagnostic technique for measuring eardrum deformations based on endoscopic profilometry with realtime distortion correction using graphics processing units. 01/10/2013 - 30/09/2015

Abstract

In this project, we will develop a novel procedure to generate distortion corrected endoscope images and combine this technique with graphics card programming to implement a new diagnostic medical tool for measuring eardrum deformations in real-time and in vivo. As my endoscopic profilometry technique is fully non-invasive, it will be very easy to introduce the new technique in the clinical setting once its possibilities have been demonstrated.

Researcher(s)

Research team(s)

Project type(s)

  • Research Project

New diagnostic technique for measuring eardrum deformations based on endoscopic profilometry with real-time distortion correction using graphics processing units. 01/10/2011 - 30/09/2013

Abstract

In this project, we will develop a novel procedure to generate distortion corrected endoscope images and combine this technique with graphics card programming to implement a new diagnostic medical tool for measuring eardrum deformations in real-time and in vivo. As my endoscopic profilometry technique is fully non-invasive, it will be very easy to introduce the new technique in the clinical setting once its possibilities have been demonstrated.

Researcher(s)

Research team(s)

Project type(s)

  • Research Project