Research | AAU Campus

Project: Relevance Detection of Ophthalmic Surge...

Master data

English

Title:	Relevance Detection of Ophthalmic Surgery Videos (OVID)
Description:	In an interdisciplinary research project, computer scientists and physicians collaborate to develop and evaluate methods for automatic detection of relevant temporal segments in ophthalmic surgery 1 videos (OSVs). The main objective is the creation of relevance models allowing to detect video segments that are relevant for educational, scientific, or documentary purposes in medicine. Relevance models are produced by machine learning algorithms, which are trained using OSVs that were annotated by surgeons. Important instances of relevant OSV segments are irregular operation (OP) phases, which deviate from the usual procedure used in quasi-standardized ophthalmic surgeries. The automatic detection and classification of irregularities that occur more frequently and hence allow training of machine learning algorithms, provide an additional benefit for the creation of OSV datasets targeted at medical education or research. The development and evaluation of automatic classifiers of irregularities therefore represents another research objective of this project. Relevance models can be used to compress and store OSVs efficiently. This project will develop and evaluate appropriate methods and algorithms to achieve this goal. Finally, we want to demonstrate that relevant OSV segments are useful for medical research by addressing three specific medical research questions related to a certain type of ophthalmic surgery (cataract) using video analysis.
Keywords:	Multimedia, Video content analysis, Machine learning, Biomedical engineering, Surgery videos, Computer vision

Short title:	OVID
Period:	01.10.2018 - 31.03.2023
Contact e-mail:	ks@itec.aau.at
Homepage:	http://ovid.itec.aau.at/

Employees

Role

Time period

(internal)

Project leader

01.10.2018 - 31.03.2023

(internal)

Project leader

01.10.2018 - 31.03.2023

(internal)

Research staff

01.10.2018 - 30.11.2021

(internal)

Student staff

01.10.2018 - 31.12.2020

(internal)

Research staff

01.06.2019 - 30.11.2021

(internal)

Research staff

01.11.2020 - 31.07.2021

(internal)

Student staff
Student staff

05.08.2019 - 05.02.2020
14.09.2020 - 31.07.2021

(internal)

Student staff

01.10.2021 - 31.05.2022

Assignment

Organisational unit

Fakultät für Technische Wissenschaften

Categorisation

Project type	Research funding (on request / by call for proposals)
Funding type	§26
Research type	Fundamental research
Subject areas	102020 - Medical informatics
Research Cluster	No research Research Cluster selected
Gender aspects	Genderrelevance not selected
Project focus	Science to Science (Quality indicator: I) Classification raster of the assigned organisational units: Institut für Informationstechnologie
working groups	Distributed Multimedia Systems

Funding

Funding program

Cooperations

Organisation

Address

Feschnigstraße 11
AT - 9020 Klagenfurt

Research activities

All related research activities to this project are shown here. With the link below, you can view them in the search view where you are also able to export them.

Projects	No related projects
Publications	Eye Movement-Based Analysis on Methodologies and Efficiency in the Process of Image Noise Evaluation Eye Movement-Based Analysis on Methodologies and Efficiency in the Process of Image Noise Evaluation (2019) C. Peng, Q. Xu, Y. Guo, K. Schöffmann Proceedings of the 28th International Conference on Artificial Neural Networks No Publisher selected to publication Deblurring Cataract Surgery Videos Using a Multi-Scale Deconvolutional Neural Network Deblurring Cataract Surgery Videos Using a Multi-Scale Deconvolutional Neural Network (2020) N. Ghamsarian, K. Schöffmann, M. Taschwer Proceedings of the IEEE 17th International Symposium on Biomedical Imaging (ISBI 2020) No Publisher selected to publication ECAT - Endoscopic Concept Annotation Tool ECAT - Endoscopic Concept Annotation Tool (2018) B. Münzer, A. Leibetseder, S. Kletz, K. Schöffmann Proceedings of the 25th International Conference on Multimedia Modeling 2019 (MMM2019) No Publisher selected to publication lifeXplore at the Lifelog Search Challenge 2019 lifeXplore at the Lifelog Search Challenge 2019 (2019) A. Leibetseder, B. Münzer, M. Primus, S. Kletz, K. Schöffmann, F. Berns, C. Beecks Proceedings of the ACM Workshop on Lifelog Search Challenge (LSC 19) No Publisher selected to publication Pixel-Based Iris and Pupil Segmentation in Cataract Surgery Videos Using Mask R-CNN Pixel-Based Iris and Pupil Segmentation in Cataract Surgery Videos Using Mask R-CNN (2020) N. Mathá, M. Taschwer, S. Sarny, D. Putzgruber-Adamitsch, K. Schöffmann 2020 IEEE 17th International Symposium on Biomedical Imaging Workshops (ISBI Workshops) No Publisher selected to publication Evaluating the Generalization Performance of Instrument Classification in Cataract Surgery Videos Evaluating the Generalization Performance of Instrument Classification in Cataract Surgery Videos (2019) N. Mathá, K. Schöffmann, M. Taschwer, D. Putzgruber-Adamitsch, Y. El-Shabrawi Proceedings of the 26th International Conference in MultiMedia Modeling (MMM 2020) (Part II) No Publisher selected to publication Dataset Column: Report from the MMM 2019 Special Session on Multimedia Datasets for Repeatable Experimentation (MDRE 2019) Dataset Column: Report from the MMM 2019 Special Session on Multimedia Datasets for Repeatable Experimentation (MDRE 2019) (2019) K. Schöffmann, B. Þór Jónsson, C. Gurrin ACM SIGMM Records No Publisher selected to publication Blind MV-based video steganalysis based on joint inter-frame and intra-frame statistics Blind MV-based video steganalysis based on joint inter-frame and intra-frame statistics (2020) N. Ghamsarian, K. Schöffmann, M. Khademi Multimedia Tools and Applications No Publisher selected to publication LensID: A CNN-RNN-Based Framework Towards Lens Irregularity Detection in Cataract Surgery Videos LensID: A CNN-RNN-Based Framework Towards Lens Irregularity Detection in Cataract Surgery Videos (2021) N. Ghamsarian, M. Taschwer, D. Putzgruber-Adamitsch, S. Sarny, Y. El-Shabrawi, K. Schöffmann MICCAI 21' Proceedings of the 24th International Conference on Medical Image Computing and Computer-Assisted Intervention No Publisher selected to publication V3C1 Dataset: An Evaluation of Content Characteristics V3C1 Dataset: An Evaluation of Content Characteristics (2019) F. Berns, L. Rossetto, K. Schöffmann, C. Beecks, G. Awad ICMR '20: Proceedings of the 2020 International Conference on Multimedia Retrieval No Publisher selected to publication Relevance Detection in Cataract Surgery Videos by Spatio- Temporal Action Localization Relevance Detection in Cataract Surgery Videos by Spatio- Temporal Action Localization (2021) N. Ghamsarian, M. Taschwer, D. Putzgruber-Adamitsch, S. Sarny, K. Schöffmann ICPR 2020 Proceedings of the 25th International Conference on Pattern Recognition (ICPR) No Publisher selected to publication Automatic detection of pupil reactions in cataract surgery videos Automatic detection of pupil reactions in cataract surgery videos (2021) N. Mathá, K. Schöffmann, M. Taschwer, S. Sarny, D. Putzgruber-Adamitsch, Y. El-Shabrawi PLOS ONE No Publisher selected to publication A Test Collection for Interactive Lifelog Retrieval A Test Collection for Interactive Lifelog Retrieval (2018) C. Gurrin, K. Schöffmann, H. Joho, B. Münzer, R. Albatal, F. Hopfgartner, L. Zhou, D. Dang-Nguyen Proceedings of the 25th International Conference on Multimedia Modeling 2019 (MMM2019) No Publisher selected to publication Interactive Video Retrieval in the Age of Deep Learning Interactive Video Retrieval in the Age of Deep Learning (2019) J. Lokoc, K. Schöffmann, W. Bailer, L. Rossetto, C. Gurrin ICMR '20: Proceedings of the 2020 International Conference on Multimedia Retrieval No Publisher selected to publication Autopiloting Feature Maps: The Deep Interactive Video Exploration (diveXplore) System at Video Browser Showdown 2019 Autopiloting Feature Maps: The Deep Interactive Video Exploration (diveXplore) System at Video Browser Showdown 2019 (2018) K. Schöffmann, B. Münzer, A. Leibetseder, M. Primus, S. Kletz Proceedings of the 25th International Conference on Multimedia Modeling 2019 (MMM2019) No Publisher selected to publication The V3C1 Dataset: Advancing the State of the Art in Video Retrieval The V3C1 Dataset: Advancing the State of the Art in Video Retrieval (2019) L. Rossetto, F. Berns, K. Schöffmann, G. Awad, C. Beecks ACM SIGMM Records No Publisher selected to publication lifeXplore at the Lifelog Search Challenge 2023 lifeXplore at the Lifelog Search Challenge 2023 (2023) K. Schöffmann LSC '23 Proceedings of the 6th Annual ACM Lifelog Search Challenge No Publisher selected to publication ReCal-Net: Joint Region-Channel-Wise Calibrated Network for Semantic Segmentation in Cataract Surgery Videos ReCal-Net: Joint Region-Channel-Wise Calibrated Network for Semantic Segmentation in Cataract Surgery Videos (2021) N. Ghamsarian, M. Taschwer, D. Putzgruber-Adamitsch, S. Sarny, Y. El-Shabrawi, K. Schöffmann ICONIP' 21 Proceedings of the 28th International Conference on Neural Information Processing No Publisher selected to publication Enabling Relevance-Based Exploration of Cataract Videos Enabling Relevance-Based Exploration of Cataract Videos (2020) N. Ghamsarian ICMR '20: Proceedings of the 2020 International Conference on Multimedia Retrieval No Publisher selected to publication Pixel-Based Tool Segmentation in Cataract Surgery Videos with Mask R-CNN Pixel-Based Tool Segmentation in Cataract Surgery Videos with Mask R-CNN (2020) M. Fox, M. Taschwer, K. Schöffmann Proceedings of the 2020 IEEE 33rd International Symposium on Computer-Based Medical Systems (CBMS) No Publisher selected to publication Relevance-Based Compression of Cataract Surgery Videos Using Convolutional Neural Networks Relevance-Based Compression of Cataract Surgery Videos Using Convolutional Neural Networks (2020) N. Ghamsarian, H. Amirpourazarian, C. Timmerer, M. Taschwer, K. Schöffmann Proceedings of the 28th ACM International Conference on Multimedia (MM '20) No Publisher selected to publication lifeXplore at the Lifelog Search Challenge 2021 lifeXplore at the Lifelog Search Challenge 2021 (2021) A. Leibetseder, K. Schöffmann LSC'21 Proceedings of the 4th Annual on Lifelog Search Challenge No Publisher selected to publication DeepPyramid: Enabling Pyramid View and Deformable Pyramid Reception for Semantic Segmentation in Cataract Surgery Videos DeepPyramid: Enabling Pyramid View and Deformable Pyramid Reception for Semantic Segmentation in Cataract Surgery Videos (2022) N. Ghamsarian, M. Taschwer, R. Sznitman, K. Schöffmann MICCAI'22 Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention No Publisher selected to publication lifeXplore at the Lifelog Search Challenge 2022 lifeXplore at the Lifelog Search Challenge 2022 (2022) A. Leibetseder, D. Stefanics, K. Schöffmann LSC '22: Proceedings of the 5th Annual on Lifelog Search Challenge No Publisher selected to publication Eye movement based information system indicates human behavior in virtual driving Eye movement based information system indicates human behavior in virtual driving (2022) Z. Peng, Q. Xu, R. Zhang, K. Schöffmann, S. Parkinson bioRxiv Cold Spring Harbor Laboratory to publication
Events	No related events
Lectures	Processing Cataract Surgery Videos with Deep Learning Processing Cataract Surgery Videos with Deep Learning K. Schöffmann Dublin , Irland since 25.10.2022 To Lecture Relevant Content Detection in Cataract Surgery Videos Relevant Content Detection in Cataract Surgery Videos K. Schöffmann since 19.04.2022 To Lecture lifeXplore at the Lifelog Search Challenge 2022 lifeXplore at the Lifelog Search Challenge 2022 A. Leibetseder, D. Stefanics, K. Schöffmann since 27.06.2022 To Lecture lifeXplore at the Lifelog Search Challenge 2023 lifeXplore at the Lifelog Search Challenge 2023 K. Schöffmann since 12.06.2023 To Lecture ReCal-Net: Joint Region-Channel-Wise Calibrated Network for Semantic Segmentation in Cataract Surgery Videos ReCal-Net: Joint Region-Channel-Wise Calibrated Network for Semantic Segmentation in Cataract Surgery Videos N. Ghamsarian, M. Taschwer, D. Putzgruber-Adamitsch, S. Sarny, Y. El-Shabrawi, K. Schöffmann since 11.12.2021 To Lecture LensID: A CNN-RNN-Based Framework Towards Lens Irregularity Detection in Cataract Surgery Videos LensID: A CNN-RNN-Based Framework Towards Lens Irregularity Detection in Cataract Surgery Videos N. Ghamsarian, M. Taschwer, D. Putzgruber-Adamitsch, S. Sarny, Y. El-Shabrawi, K. Schöffmann since 28.09.2021 To Lecture Relevance Detection in Cataract Surgery Videos by Spatio- Temporal Action Localization Relevance Detection in Cataract Surgery Videos by Spatio- Temporal Action Localization N. Ghamsarian, M. Taschwer, D. Putzgruber-Adamitsch, S. Sarny, K. Schöffmann since 14.01.2021 To Lecture Pixel-Based Iris and Pupil Segmentation in Cataract Surgery Videos Using Mask R-CNN Pixel-Based Iris and Pupil Segmentation in Cataract Surgery Videos Using Mask R-CNN N. Mathá, M. Taschwer, S. Sarny, D. Putzgruber-Adamitsch, K. Schöffmann since 06.04.2020 To Lecture Deblurring Cataract Surgery Videos Using a Multi-Scale Deconvolutional Neural Network Deblurring Cataract Surgery Videos Using a Multi-Scale Deconvolutional Neural Network N. Ghamsarian, K. Schöffmann, M. Taschwer since 04.04.2020 To Lecture Relevance-Based Compression of Cataract Surgery Videos Using Convolutional Neural Networks Relevance-Based Compression of Cataract Surgery Videos Using Convolutional Neural Networks N. Ghamsarian, H. Amirpourazarian, C. Timmerer, M. Taschwer, K. Schöffmann since 15.10.2020 To Lecture Enabling Relevance-Based Exploration of Cataract Videos Enabling Relevance-Based Exploration of Cataract Videos N. Ghamsarian since 29.10.2020 To Lecture Pixel-Based Tool Segmentation in Cataract Surgery Videos with Mask R-CNN Pixel-Based Tool Segmentation in Cataract Surgery Videos with Mask R-CNN M. Fox, M. Taschwer, K. Schöffmann since 29.07.2020 To Lecture Evaluating the Generalization Performance of Instrument Classification in Cataract Surgery Videos Evaluating the Generalization Performance of Instrument Classification in Cataract Surgery Videos N. Mathá, K. Schöffmann, M. Taschwer, D. Putzgruber-Adamitsch, Y. El-Shabrawi since 08.01.2020 To Lecture