Vortrag: Pixel-Based Tool Segmentation in Cataract Surgery Videos with Mask R-...
Stammdaten
Titel: | Pixel-Based Tool Segmentation in Cataract Surgery Videos with Mask R-CNN |
Beschreibung: | Automatically detecting surgical tools in recorded surgery videos is an important building block of further content-based video analysis. In ophthalmology, the results of such methods can support training and teaching of operation techniques and enable investigation of medical research questions on a dataset of recorded surgery videos. While previous methods used frame-based classification techniques to predict the presence of surgical tools — but did not localize them, we apply a recent deep-learning segmentation method (Mask R-CNN) to localize and segment surgical tools used in ophthalmic cataract surgery. We add ground-truth annotations for multi-class instance segmentation to two existing datasets of cataract surgery videos and make resulting datasets publicly available for research purposes. In the absence of comparable results from literature, we tune and evaluate the Mask R-CNN approach on these datasets for instrument segmentation/localization and achieve promising results (61\% mean average precision on 50\% intersection over union for instance segmentation, working even better for bounding box detection or binary segmentation), establishing a reasonable baseline for further research. Moreover, we experiment with common data augmentation techniques and analyze the achieved segmentation performance with respect to each class (instrument), providing evidence for future improvements of this approach. |
Schlagworte: |
Typ: | Angemeldeter Vortrag |
Homepage: | http://www.cbms2020.org/ |
Veranstaltung: | IEEE 33rd International Symposium on Computer Based Medical Systems (CBMS 2020) (Rochester, Minnesota) |
Datum: | 29.07.2020 |
Vortragsstatus: | stattgefunden (online) |
Beteiligte
Markus Fox (intern) |
|
Mario Taschwer (intern) |
|
Klaus Schöffmann (intern) |
|
Zuordnung
Organisation | Adresse | ||||
---|---|---|---|---|---|
Fakultät für Technische Wissenschaften
Institut für Informationstechnologie
|
AT - 9020 Klagenfurt am Wörthersee |
Kategorisierung
Sachgebiete | |
Forschungscluster | Kein Forschungscluster ausgewählt |
Vortragsfokus |
Klassifikationsraster der zugeordneten Organisationseinheiten:
|
TeilnehmerInnenkreis |
|
Publiziert? |
|
Arbeitsgruppen |
|
Kooperationen
Forschungsaktivitäten
(Achtung: Externe Aktivitäten werden im Suchergebnis nicht mitangezeigt)
Projekte |
|
Publikationen |
|
Veranstaltungen |
|
Vorträge | Keine verknüpften Vorträge vorhanden |