Dehazing Ultrasound using Diffusion Models

  ·   2 min read

Venue: IEEE Transactions on Medical Imaging

Authors: Tristan S.W. Stevens, Faik C. Meral, Junseob Shin, Jason Yu, Iason Z. Apostolakis, Jean-luc Robert, Ruud J.G. van Sloun


Echocardiography has been a prominent tool for the diagnosis of cardiac disease. However, these diagnoses can be heavily impeded by poor image quality. Acoustic clutter emerges due to multipath reflections imposed by layers of skin, subcutaneous fat, and intercostal muscle between the transducer and heart. As a result, haze and other noise artifacts pose a real challenge to cardiac ultrasound imaging. In many cases, especially with difficult-to-image patients such as patients with obesity, a diagnosis from B-Mode ultrasound imaging is effectively rendered unusable, forcing sonographers to resort to contrast-enhanced ultrasound examinations or refer patients to other imaging modalities. Tissue harmonic imaging has been a popular approach to combat haze, but in severe cases is still heavily impacted by haze. Alternatively, denoising algorithms are typically unable to remove highly structured and correlated noise, such as haze. It remains a challenge to accurately describe the statistical properties of structured haze, and develop an inference method to subsequently remove it. Diffusion models have emerged as powerful generative models and have shown their effectiveness in a variety of inverse problems. In this work, we present a joint posterior sampling framework that combines two separate diffusion models to model the distribution of both clean ultrasound and haze in an unsupervised manner. Furthermore, we demonstrate techniques for effectively training diffusion models on radio-frequency ultrasound data and highlight the advantages over image data. Experiments on both in-vitro and in-vivo cardiac datasets show that the proposed dehazing method effectively removes haze while preserving signals from weakly reflected tissue.

Qualitative results on in-vivo cardiac ultrasound data.

Try dragging the slider to compare the input and dehazed images.



Cardiac cine-loop

Comparison

Comparison on in-vivo data

Comparison

Comparison on phantom data

In-vitro results using the phantom data. The ground truth ultrasound x and haze signals h which are used to construct measurement y are shown on the left. RF-based dehazing results are on the right, for both the baseline methods (BM3D and NCSNv2) and the proposed diffusion method. For the latter, we show posterior solutions for both the ultrasound and haze signals (lower inset plot to the right). For all methods, we show error plots that highlight the difference between ground truth and dehazed images, with the proposed diffusion method notably dropping less signal.


Comparison

Overview of the algorithm

The dehazing diffusion process, where the reverse diffusion trajectory is displayed from left to right for both signal (top) and haze (bottom) in parallel. During each step of the posterior sampling process, data consistency is enforced through the measurement model.

Comparison


back to top