Image Severity Ranking in Ophthalmology

Expert-centric severity representation learning for medical images

Fundus photograph of the retina

Sep 2022 – Dec 2023 · USC, with collaborators in ophthalmology

Clinicians reason about disease as a matter of degree, not just presence or absence. This project learns representations of disease severity from medical images, with a focus on glaucoma. The goal is models that rank images the way experts do and can explain their rankings.

Highlights

  • ConPro: a severity representation learning framework combining contrastive learning and preference optimization. It outperforms state-of-the-art methods by 6% in F1 score (Nguyen et al., 2024).
  • SiameN and SEMISE: expert-centric severity ranking models, through explainable pairwise n-hidden comparison (Nguyen et al., 2025) and semi-supervised severity representation learning (Tran et al., 2025). Together they improve IoU explainability by 6% and ranking performance by 3% in F1 score.
  • Clinical evaluation: comparing deep learning and clinician performance for detecting referable glaucoma from fundus photographs in a safety-net population (Nguyen et al., 2025).

References

2025

  1. EMBC
    Explainable Severity Ranking via Pairwise n-Hidden Comparison: A Case Study of Glaucoma
    Hong Nguyen, Cuong V. Nguyen, Shrikanth Narayanan, and 2 more authors
    In 47th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 2025
  2. ISBI
    SEMISE: Semi-supervised Learning for Severity Representation in Medical Image
    Dung T. Tran, Hung Vu, Anh Tran, and 3 more authors
    In 2025 IEEE 22nd International Symposium on Biomedical Imaging (ISBI), 2025
  3. OphthSci
    Comparison of Deep Learning and Clinician Performance for Detecting Referable Glaucoma from Fundus Photographs in a Safety Net Population
    Van Nguyen, Sreenidhi Iyengar, Haroon Rasheed, and 21 more authors
    Ophthalmology Science, 2025

2024

  1. CVPRW
    ConPro: Learning Severity Representation for Medical Images using Contrastive Learning and Preference Optimization
    Hong Nguyen, Hoang Nguyen, Melinda Chang, and 3 more authors
    In 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2024