A Stable Diffusion Approach for RGB to Thermal Image Conversion for Leg Ulcer Assessment

• Main Author: Oliveira, Guilherme C. [UNESP]
• Publication Date: 2024
• Other Authors: Ngo, Quoc C., Papa, Joao P. [UNESP], Kumar, Dinesh
• Format: Conference object
• Language: eng
• Source: Repositório Institucional da UNESP
• Download full: http://dx.doi.org/10.1109/CBMS61543.2024.00034; https://hdl.handle.net/11449/305779
• topic: Image to Image; Leg Ulcer; Machine learning; Stable Diffusion; Thermal Image

Thermal imaging of venous leg ulcers has helped clinicians make informed wound management decisions. However, thermal cameras are not available in most clinics. To overcome this, we propose a pilot test using deep learning to estimate thermal images from RGB data of the ulcers. Our approach employs stable diffusion techniques, e.g., DreamBooth, LoRA, and ControlNet, to create thermal images from RGB data, addressing the limitations of cost and accessibility in conventional thermal imaging to assist clinicians in assessing the ulcers. While the images' visualization appears helpful, achieving an average structural similarity index measure (SSIM) score of 0.84, this study has yet to test their suitability for a computerized assessment of chronic wounds.