Publikation: lifeXplore at the Lifelog Search Challe...
Stammdaten
Titel: | lifeXplore at the Lifelog Search Challenge 2023 |
Untertitel: | |
Kurzfassung: | Searching substantial data archives of lifeloggers is a challenging task. The Lifelog Search Challenge (LSC) is an annually held competition with the aim of encouraging international teams to develop interactive content retrieval systems capable of searching large lifelog databases. LSC takes place as a live event co-located with the ACM International Conference on Multimedia Retrieval (ICMR), where teams compete against each other by solving retrieval tasks issued by the lifelogger. This paper presents our newest version of lifeXplore, a lifelog retrieval system that has been participating in LSC since 2018. For this year, we significantly redesign the entire system (backend, middleware, and frontend) and integrate free text-search using embeddings from vision transformers trained with large sets of text-image pairs. We present a novel architecture for multi-source search, where results from image embeddings are used together with results from traditional content analysis (for objects, concepts, and recognized text). We also perform intensive analysis of vision transformer models in order to know which one fits best to the requirements of the LSC. |
Schlagworte: | lifelogging, interactive image retrieval, multimedia indexing |
Publikationstyp: | Beitrag in Proceedings (Autorenschaft) |
Erscheinungsdatum: | 12.06.2023 (Print) |
Erschienen in: |
LSC '23 Proceedings of the 6th Annual ACM Lifelog Search Challenge
LSC '23 Proceedings of the 6th Annual ACM Lifelog Search Challenge
(
)
zur Publikation |
Titel der Serie: | - |
Bandnummer: | - |
Erstveröffentlichung: | Ja |
Version: | - |
Seite: | S. 53 - 58 |
Versionen
Keine Version vorhanden |
Erscheinungsdatum: | 12.06.2023 |
ISBN: |
|
ISSN: | - |
Homepage: | https://dl.acm.org/doi/10.1145/3592573.3593105 |
Erscheinungsdatum: | 12.06.2023 |
ISBN (e-book): | - |
eISSN: | - |
DOI: | http://dx.doi.org/10.1145/3592573.3593105 |
Homepage: | https://dl.acm.org/doi/10.1145/3592573.3593105 |
Open Access |
|
Zuordnung
Organisation | Adresse | ||||
---|---|---|---|---|---|
Fakultät für Technische Wissenschaften
Institut für Informationstechnologie
|
AT - 9020 Klagenfurt am Wörthersee |
Kategorisierung
Sachgebiete | |
Forschungscluster | Kein Forschungscluster ausgewählt |
Peer Reviewed |
|
Publikationsfokus |
Klassifikationsraster der zugeordneten Organisationseinheiten:
|
Arbeitsgruppen |
|
Kooperationen
Forschungsaktivitäten
(Achtung: Externe Aktivitäten werden im Suchergebnis nicht mitangezeigt)
Projekte: |
|
Publikationen: | Keine verknüpften Publikationen vorhanden |
Veranstaltungen: |
|
Vorträge: |
|