Validating retinal fundus image analysis algorithms: issues and a proposal

Emanuele Trucco; Alfredo Ruggeri; Thomas Karnowski; Luca Giancardo; Edward Chaum; Jean Pierre Hubschman; Bashir Al-Diri; Carol Y Cheung; Damon Wong; Michael Abràmoff; Gilbert Lim; Dinesh Kumar; Philippe Burlina; Neil M Bressler; Herbert F Jelinek; Fabrice Meriaudeau; Gwénolé Quellec; Tom Macgillivray; Bal Dhillon

doi:10.1167/iovs.12-10347

Back

Validating retinal fundus image analysis algorithms: issues and a proposal

Journal article

Open access

Peer reviewed

Validating retinal fundus image analysis algorithms: issues and a proposal

Emanuele Trucco, Alfredo Ruggeri, Thomas Karnowski, Luca Giancardo, Edward Chaum, Jean Pierre Hubschman, Bashir Al-Diri, Carol Y Cheung, Damon Wong, Michael Abràmoff, …

Investigative ophthalmology & visual science, Vol.54(5), pp.3546-3559

05/01/2013

DOI: 10.1167/iovs.12-10347

PMCID: PMC4597487

PMID: 23794433

Files and links (1)

url

https://doi.org/10.1167/iovs.12-10347View

Published (Version of record) Open Access

Abstract

This paper concerns the validation of automatic retinal image analysis (ARIA) algorithms. For reasons of space and consistency, we concentrate on the validation of algorithms processing color fundus camera images, currently the largest section of the ARIA literature. We sketch the context (imaging instruments and target tasks) of ARIA validation, summarizing the main image analysis and validation techniques. We then present a list of recommendations focusing on the creation of large repositories of test data created by international consortia, easily accessible via moderated Web sites, including multicenter annotations by multiple experts, specific to clinical tasks, and capable of running submitted software automatically on the data stored, with clear and widely agreed-on performance criteria, to provide a fair comparison.

Algorithms

Reference Standards

Reproducibility of Results

Ophthalmoscopy - standards

Image Processing, Computer-Assisted - standards

Humans

Retinal Diseases - pathology

Fundus Oculi

Software - standards

Details

Title: Subtitle: Validating retinal fundus image analysis algorithms: issues and a proposal
Creators: Emanuele Trucco - VAMPIRE project, School of Computing, University of Dundee, Dundee, United Kingdom. manueltrucco@computing.dundee.ac.uk
Alfredo Ruggeri
Thomas Karnowski
Luca Giancardo
Edward Chaum
Jean Pierre Hubschman
Bashir Al-Diri
Carol Y Cheung
Damon Wong
Michael Abràmoff
Gilbert Lim
Dinesh Kumar
Philippe Burlina
Neil M Bressler
Herbert F Jelinek
Fabrice Meriaudeau
Gwénolé Quellec
Tom Macgillivray
Bal Dhillon
Resource Type: Journal article
Publication Details: Investigative ophthalmology & visual science, Vol.54(5), pp.3546-3559
Publisher: Association for Research in Vision and Ophthalmology; United States
DOI: 10.1167/iovs.12-10347
PMID: 23794433
PMCID: PMC4597487
ISSN: 1552-5783
eISSN: 1552-5783
Grant note: R01 EY017065 / NEI NIH HHS R01 EY018853 / NEI NIH HHS R01 EY019112 / NEI NIH HHS I01 CX000119 / CSRD VA R01EY018853 / NEI NIH HHS
Language: English
Date published: 05/01/2013
Academic Unit: Roy J. Carver Department of Biomedical Engineering; Electrical and Computer Engineering; Ophthalmology and Visual Sciences
Record Identifier: 9983806381302771

Metrics

22 Record Views

124 Times Cited - Web of Science

See more details