Table Of ContentLuigi Manfredi · Seyed-Ahmad Ahmadi ·
Michael Bronstein · Anees Kazi ·
Davide Lomanto · Alwyn Mathew ·
Ludovic Magerand · Kamilia Mullakaeva ·
Bartlomiej Papiez · Russell H. Taylor ·
Emanuele Trucco (Eds.)
Imaging Systems for GI
4
5
7
3 Endoscopy, and Graphs in
1
S
C
Biomedical Image Analysis
N
L
First MICCAI Workshop, ISGIE 2022
and Fourth MICCAI Workshop, GRAIL 2022
Held in Conjunction with MICCAI 2022
Singapore, September 18, 2022, Proceedings
Lecture Notes in Computer Science 13754
FoundingEditors
GerhardGoos
KarlsruheInstituteofTechnology,Karlsruhe,Germany
JurisHartmanis
CornellUniversity,Ithaca,NY,USA
EditorialBoardMembers
ElisaBertino
PurdueUniversity,WestLafayette,IN,USA
WenGao
PekingUniversity,Beijing,China
BernhardSteffen
TUDortmundUniversity,Dortmund,Germany
MotiYung
ColumbiaUniversity,NewYork,NY,USA
Moreinformationaboutthisseriesathttps://link.springer.com/bookseries/558
· ·
Luigi Manfredi Seyed-Ahmad Ahmadi
· ·
Michael Bronstein Anees Kazi
· ·
Davide Lomanto Alwyn Mathew
· ·
Ludovic Magerand Kamilia Mullakaeva
· ·
Bartlomiej Papiez Russell H. Taylor
Emanuele Trucco (Eds.)
Imaging Systems for GI
Endoscopy, and Graphs in
Biomedical Image Analysis
First MICCAI Workshop, ISGIE 2022
and Fourth MICCAI Workshop, GRAIL 2022
Held in Conjunction with MICCAI 2022
Singapore, September 18, 2022
Proceedings
Editors
LuigiManfredi Seyed-AhmadAhmadi
UniversityofDundee Nvidia
Dundee,UK Munich,Germany
MichaelBronstein AneesKazi
UniversityofOxford HarvardUniversity
Oxford,UK Boston,USA
DavideLomanto AlwynMathew
NationalUniversityofSingapore UniversityofDundee
Singapore,Singapore Dundee,UK
LudovicMagerand KamiliaMullakaeva
UniversityofDundee TechnicalUniversityofMunich
Dundee,UK Munich,Germany
BartlomiejPapiez RussellH.Taylor
UniversityofOxford JohnsHopkinsUniversity
Oxford,UK Baltimore,USA
EmanueleTrucco
UniversityofDundee
Dundee,UK
ISSN 0302-9743 ISSN 1611-3349 (electronic)
LectureNotesinComputerScience
ISBN 978-3-031-21082-2 ISBN 978-3-031-21083-9 (eBook)
https://doi.org/10.1007/978-3-031-21083-9
©TheEditor(s)(ifapplicable)andTheAuthor(s),underexclusivelicense
toSpringerNatureSwitzerlandAG2022
Thisworkissubjecttocopyright.AllrightsarereservedbythePublisher,whetherthewholeorpartofthe
material is concerned, specifically the rights of translation, reprinting, reuse of illustrations, recitation,
broadcasting, reproduction on microfilms or in any other physical way, and transmission or information
storageandretrieval,electronicadaptation,computersoftware,orbysimilarordissimilarmethodologynow
knownorhereafterdeveloped.
Theuseofgeneraldescriptivenames,registerednames,trademarks,servicemarks,etc.inthispublication
doesnotimply,evenintheabsenceofaspecificstatement,thatsuchnamesareexemptfromtherelevant
protectivelawsandregulationsandthereforefreeforgeneraluse.
Thepublisher,theauthors,andtheeditorsaresafetoassumethattheadviceandinformationinthisbookare
believedtobetrueandaccurateatthedateofpublication.Neitherthepublishernortheauthorsortheeditors
give a warranty, expressed or implied, with respect to the material contained herein or for any errors or
omissionsthatmayhavebeenmade.Thepublisherremainsneutralwithregardtojurisdictionalclaimsin
publishedmapsandinstitutionalaffiliations.
ThisSpringerimprintispublishedbytheregisteredcompanySpringerNatureSwitzerlandAG
Theregisteredcompanyaddressis:Gewerbestrasse11,6330Cham,Switzerland
ISGIE Preface
The First International on Imaging Systems for GI Endoscopy (ISGIE 2022) was
organized as a satellite event of the 25th International Conference on Medical Image
ComputingandComputerAssistedIntervention(MICCAI2022)inSingapore,andheld
onSeptember18,2022,asahalf-dayevent.
This workshop was specific to the application of imaging systems in the
gastrointestinal (GI) tract. The objective of this event was to stimulate an interdisci-
plinarydiscussiononclinicalapplicationsfocusingonunmetclinicalneedsaswellas
onnewtechnologiesattheR&Dstage,aimingfortranslationintoclinicalpractice.Both
clinicalandengineeringcommunitiesbenefitfromthesediscussions,whichfitwiththe
MICCAImission.
Thisworkshopfocusedonnovelscientificcontributionsonvisionsystems,imaging
algorithms,andautonomoussystemsforendorobotsforGIendoscopy,includinglesion
andlumendetectionaswellas3DreconstructionoftheGItract.Localizinginteresting
featuressuchasthelumen,lesions,orpolypstoberemoved,requirestheirdetectionin
theimagesofthevideostream.Deeplearning-basedapproachesofthistaskhavebecome
verysuccessfulinrecentyears,withannotateddatasetspubliclyavailabletotrainthem.
Challengesremain,especiallyconcerningtherobustnessoftheilluminationbecauseof
thereflectivesurface.Potentialsolutionstotheseissueswerediscussedinthisworkshop.
Anotherimportantaspectinendoscopy,coveredinthisworkshop,wasthelevelofauton-
omyofamedicaldevicetosupporttheclinicalworkforceinperformingtheprocedure.
Thisautonomousbehaviorcanbenefitfrom3Dinformationsuchasthelocalizationof
thetarget,lumen,orlesion,andthepositionofadevicewithrespecttothewalloftheGI
tract.Traditionallythisinformationcouldbeobtainedfromamonocularvideosystem
byusingmethodssuchasSLAM,shape-from-template,andnon-rigidstructure-from-
motion. More recently, methods based on deep learning monocular depth estimation
alsohaveemerged.Thisworkshopaddressedprogressmadewiththoseapproachesand
limitationsremainingtosuccessfullymoveadeviceautonomouslyaswellasachieving
autonomoussurgicaltasks.
Theworkshopconsistedofthepresentationofsixselectedpapersandthreeinvited
keynote talks covering both clinical and technical aspects. A technical talk was given
byRussellTaylor,ProfessorofComputerSciencewithjointappointmentsinMechani-
calEngineering,OtolaryngologyHead-and-NeckSurgery,Radiology,andSurgeryand
Director of the Laboratory for Computational Sensing and Robotics (LCSR) at Johns
Hopkins University. He provided an overview of current research and technologies
togetherwithnewtrendsandfuturetechnologies,includingautonomyinmedicine.
Another technical talk was also given by José María Martínez Montiel, Full Pro-
fessor inthe Department of Computer Science Systems Engineering at the University
of Zaragoza, where he is in charge of perception and computer vision research grants
and courses. He presented EndoMapper, a dataset of complete calibrated endoscopy
procedures,whichresultsfromafundedEuropeanUnionproject,grantagreementNo.
863146.HecoveredtheimportantaspectsofvisualSLAMandthedatasetprovidedby
vi ISGIEPreface
thisprojecttosimulatethecolonenvironmentandtoprovidesyntheticdatafortraining
purposes.TheclinicaltalkwasgivenbyLawrenceHoKhek-Yu,FullProfessorinthe
DepartmentofSurgeryattheNationalUniversityofSingaporeandtheDirectorofthe
CentreforInnovationinHealthcare,NationalUniversityHealthSystem.Hepresented
current solutions available in clinical practice, providing an in-depth view of unmet
clinicalneeds.Histalkcoveredthepatientperspectiveandtheacceptanceofnewtech-
nologies, such as AI and robotics, as well as challenges on equality and diversity in
endoscopy.
TheISGIE2022proceedingscontainsixhigh-qualitypapers,selectedfrom9sub-
missionsthrougharigorousdouble-blindpeer-reviewprocess,withthreereviewersfor
eachpaper,allofthemexpertsonthetopic.Fullauthorshipanddomainconflictswere
disclosedinCMT,themanuscriptsubmissionsystem,inordertoavoidconflictofinter-
estbetweenauthorsandreviewersofthepapers.Theacceptedmanuscriptscoverlight
adaptationforclassificationoftheupperGIsites,criss-crossattentionforGImetaplasia
segmentation, landmark detection using vision transformers in colonoscopy, real-time
lumendetectionforautonomouscolonoscopy,SuperPointfeaturesincolonoscopy,and
estimating coverage in 3D reconstruction of the colon from colonoscopy videos. We
wouldliketothankalltheISGIE2022authorsfortheirsubmissionsandparticipation,
themembersoftheorganizingteam,thereviewers,andthekeynotespeakersfortheir
valuable contributions and commitment to the workshop. We would like to thank our
sponsorOlympusforitssupportbyfundinganawardof1,000USDforthebestpresen-
tation, which went to O. León Barbed fromDIIS-i3A, University of Zaragoza, Spain,
forhistalkon“SuperPointFeaturesinEndoscopy”.
TheproceedingsofourworkshoparepublishedasajointLNCSvolumealongside
theFourthInternationalWorkshoponGraphsinBiomedicalImageAnalysis(GRAIL
2022),organizedinconjunctionwithMICCAI.Inadditiontothepapers,abstractsand
slides presented during the workshop will be made publicly available on the ISGIE
website(https://miccai2022-isgie.github.io/).
September2022 LuigiManfredi
RussellTaylor
DavideLomanto
AlwynMathew
LudovicMagerand
EmanueleTrucco
Preface GRAIL 2022
TheFourthInternationalWorkshoponGRaphsinbiomedicAlImageanaLysis(GRAIL
2022)wasorganizedasasatelliteeventofthe25thInternationalConferenceonMedical
ImageComputingandComputerAssistedIntervention(MICCAI2022)inSingapore.
Following two years of entirely virtual conference events, we were excited to offer
our community a hybrid event, and finally meet some of our colleagues face-to-face
again.Afterthesuccessandpositivefeedbackobtainedinpreviousyears,GRAILhad
itsfourtheventatMICCAI2022,inthespiritofstrengtheningthelinksbetweengraphs
andbiomedicalimaging.
This workshop provides a unique opportunity to meet and discuss both theoreti-
cal advances in graphical methods and the practicality of such methods when applied
to complex biomedical imaging problems. Simultaneously, the workshop seeks to be
aninterfacetofosterfutureinterdisciplinaryresearch,includingsignalprocessingand
machinelearningongraphs.
Graphs and related graph-based modeling have attracted an exponentially grow-
ing research interest in recent years, as they enable us to represent complex data and
their interactions in a perceptually meaningful way. With the emergence of big data
in the medical imaging community, the relevance of graphs as a means to represent
datasampledfromirregularandnon-Euclideandomainsisincreasing,togetherwiththe
development of new inference and learning methods that operate on such structures.
Thereisawiderangeofwell-establishedandemergingbiomedicalimagingproblems
thatcanbenefitfromtheseadvances.Webelievethattheresearchpresentedatthiswork-
shopconstitutesaclearexampleofthat.ComparedtoourpreviousGRAILevents,we
specifically encouraged submissions in the areas of explainable GNNs, graph models
in computer-aided surgery/intervention, unstructured medical big data, and semantic
knowledge(scene/knowledgegraphs).
The GRAIL 2022 proceedings contain six high-quality papers of 9–10 pages that
werepre-selectedfrom10submissionsinarigorouspeer-reviewprocess.Allsubmis-
sions were peer-reviewed in a double-blind process by at least three members of the
reviewingboardandProgramCommittee,comprising20expertsongraphsinbiomed-
ical image analysis, with each member undertaking at least one review. The accepted
manuscriptscoverawidesetofgraph-basedmedicalimageanalysismethodsandappli-
cations. As in previous years, one of the primary domains of imaging-related graph
methods are brain connectomics. Papers this year proposed brain connectome encod-
ing methods for anomaly detection and disease diagnosis; generation of post-surgical
connectomes in tumor patients; multimodal brain connectome fusion methods; and
transforming connectomes to arbitrary brain parcellations via graph matching. Out-
sideofbrainimaging,wesawanapplicationofgraphsforlabelingofvasculaturetrees,
and improved annotation of whole slide images in digital pathology with hierarchical
cell-graphs.
InadditiontothepaperspresentedinthisLNCSvolume,theworkshopeventfea-
tured four outstanding keynote presentations from world-renowned experts: Marinka
viii PrefaceGRAIL2022
ZitnikfromHarvardMedicalSchoolon“TrustworthyAIwithGNNExplainers”,Mark
O’Donoghue from Astra Zeneca on “Knowledge Graphs for Drug Discovery”, Islem
Rekik from the Technical University of Istanbul on “Debunking the brain connectiv-
ityusingpredictivelearningfromlimiteddata”,andXavierBressonfromSeaAILab
(formerlyfromtheNationalUniversityofSingapore)on“GNNtrendsin2022”.
WewishtothankalltheGRAIL2022authorsfortheirsubmissionsandparticipation,
the members of the Program Committee, the numerous reviewers, and of course the
keynote speakers for their valuable contributions and commitment to the workshop.
Finally, we are very grateful to our sponsor NVIDIA for their generous support, by
awardingaGPUtothebestworkshoppresentation.
TheproceedingsofourworkshoparepublishedasajointLNCSvolumealongside
theFirstInternationalWorkshoponImagingSystemsforGIEndoscopy(ISGIE2022),
organizedinconjunctionwithMICCAI.Inadditiontothepapers,abstractsandslides
presentedduringtheworkshopwillbemadepubliclyavailableontheGRAILwebsite
(http://grail-miccai.github.io/).
September2022 Seyed-AhmadAhmadi
AneesKazi
BartlomiejPapiez
KamiliaMullakaeva
MichaelBronstein
Organization
GeneralChairsISGIE2022
LuigiManfredi UniversityofDundee,UK
DavideLomanto NationalUniversityofSingapore
RussellTaylor JohnsHopkinsUniversity,USA
ProgramCommitteeISGIE2022
AlwynMathew(Chair) UniversityofDundee,UK
LudovicMagerand(Chair) UniversityofDundee,UK
EmanueleTrucco(Chair) UniversityofDundee,UK
BaidaaAl-Bander KeeleUniversity,UK
AdrienBartoli ClermontUniversityHospital,France
ZhenLi ChineseUniversityofHongKong,Shenzhenand
ShenzhenResearchInstituteofBigData
(SRIBD),China
LiuLi ChineseUniversityofHongKong,Shenzhen,
China
AriannaMenciassi ScuolaSuperioreSant’AnnaofPisa,Italy
MathieuPioch CHUdeLyon,France
AdditionalReviewersISGIE2022
ZixunZhang JunWei
ZhuoLi JieYang
YunchengJiang
JacobCarse
YiwenHu
JoséMaríaMartínezMontiel
YeZhu
DanielPizarro
WeizhenDing
WeijieMa BehzadMirmahboub
MarianHimstedt AgnivaSengupta
SponsorsISGIE2022
We are very grateful to our sponsor Olympus for their valuable support and awarding
1,000USDtothebestpaper.
