Publikation: Early and Late Fusion of Temporal Infor...
Stammdaten
Titel: | Early and Late Fusion of Temporal Information for Classification of Surgical Actions in Laparoscopic Gynecology |
Untertitel: | |
Kurzfassung: | The most essential step towards semiautomatic extraction of relevant surgery scenes is semantic understanding of surgical actions in surgery videos. Currently, Convolutional Neural Networks (CNNs) are a de-facto standard for automatic content classification in many domain, including medical imaging. We aim to include increase the predictive performance of surgical action recognition within gynecologic laparoscopy, a subfield of endoscopic surgery, by fusing temporal information to the input layer of CNNs (early fusion), as well as temporal aggregation of single-frame prediction results (late fusion). Our evaluation shows that the proposed early fusion approaches are able to outperform a single-frame baseline when using the GoogLeNet architecture. Moreover, early fusion of motion information benefits the classification performance regardless of late fusion strategy. Late fusion has a high impact on classification performance, and its increase is additive to the performance increase of early fusion. Eventually, we found that the CNN capacity influences these results drastically. We conclude that the proposed methods in combination with a sufficiently high CNN capacity allow for a substantial increase in predictive performance. |
Schlagworte: |
Publikationstyp: | Beitrag in Sammelwerk (Autorenschaft) |
Erscheinungsdatum: | 06.2018 (Online) |
Erschienen in: |
2018 IEEE 31st International Symposium on Computer-Based Medical Systems (CBMS)
2018 IEEE 31st International Symposium on Computer-Based Medical Systems (CBMS)
(
IEEE;
)
zur Publikation |
Titel der Serie: | - |
Bandnummer: | - |
Erstveröffentlichung: | Ja |
Version: | - |
Seite: | - |
Versionen
Keine Version vorhanden |
Erscheinungsdatum: | 06.2018 |
ISBN (e-book): |
|
eISSN: | - |
DOI: | http://dx.doi.org/10.1109/CBMS.2018.00071 |
Homepage: | https://ieeexplore.ieee.org/document/8417266 |
Open Access |
|
AutorInnen
Stefan Petscharnig (intern) | ||||
Klaus Schöffmann (intern) | ||||
Jenny Benois-Pineau
|
||||
Souad Chaabouni
|
||||
Jörg Keckstein
|
Zuordnung
Organisation | Adresse | ||||
---|---|---|---|---|---|
Fakultät für Sozialwissenschaften
Institut für Medien- und Kommunikationswissenschaft
|
AT - A-9020 Klagenfurt am Wörthersee |
||||
Fakultät für Technische Wissenschaften
Institut für Informationstechnologie
|
AT - 9020 Klagenfurt am Wörthersee |
Kategorisierung
Sachgebiete | |
Forschungscluster | Kein Forschungscluster ausgewählt |
Peer Reviewed |
|
Publikationsfokus |
Klassifikationsraster der zugeordneten Organisationseinheiten:
|
Arbeitsgruppen |
|
Kooperationen
Organisation | Adresse | ||||
---|---|---|---|---|---|
Landeskrankenhaus Villach
|
AT - 9500 Villach |
||||
Université de Bordeaux - Laboratoire Bordelais de Recherche en Informatique
|
FR - 33405 TALANCE |
Forschungsaktivitäten
(Achtung: Externe Aktivitäten werden im Suchergebnis nicht mitangezeigt)
Projekte: |
|
Publikationen: | Keine verknüpften Publikationen vorhanden |
Veranstaltungen: | Keine verknüpften Veranstaltung vorhanden |
Vorträge: |
|