Vortrag: Semantic-Aware View Prediction for 360-Degree Videos at the 5G Edge
Stammdaten
Titel: | Semantic-Aware View Prediction for 360-Degree Videos at the 5G Edge |
Beschreibung: | In a 5G testbed, we use 360° video streaming to test, measure, and demonstrate the 5G infrastructure, including the capabilities and challenges of edge computing support. Specifically, we use the SEAWARE (Semantic-Aware View Prediction) software system, originally described in [1], at the edge of the 5G network to support a 360° video player (handling tiled videos) by view prediction. Originally, SEAWARE performs semantic analysis of a 360° video on the media server, by extracting, e.g., important objects and events. This video semantic information is encoded in specific data structures and shared with the client in a DASH streaming framework. Making use of these data structures, the client/player can perform view prediction without in-depth, computationally expensive semantic video analysis. In this paper, the SEAWARE system was ported and adapted to run (partially) on the edge where it can be used to predict views and prefetch predicted segments/tiles in high quality in order to have them available close to the client when requested. The paper gives an overview of the 5G testbed, the overall architecture, and the implementation of SEAWARE at the edge server. Since an important goal of this work is to achieve low motion-to-glass latencies, we developed and describe "tile postloading", a technique that allows non-predicted tiles to be fetched in high quality into a segment already available in the player buffer. The performance of 360° tiled video playback on the 5G infrastructure is evaluated and presented. Current limitations of the 5G network in use and some challenges of DASH-based streaming and of edge-assisted viewport prediction under "real-world" constraints are pointed out; further, the performance benefits of tile postloading are disclosed. |
Schlagworte: | Tile-based 360° video streaming, viewport prediction, tile postloading, 5G networks, edge computing |
Typ: | Angemeldeter Vortrag |
Homepage: | https://semanticcomputing.wixsite.com/ism2022 |
Veranstaltung: | IEEE 24th International Symposium on Multimedia (IEEE ISM 2022) (Neapel) |
Datum: | 06.12.2022 |
Vortragsstatus: | stattgefunden (Präsenz) |
Beteiligte
Shivi Vats (intern) |
|
Jounsup Park (extern) |
|
Klara Nahrstedt (extern) |
|
Michael Zink (extern) |
|
Ramesh Sitaraman (extern) |
|
Hermann Hellwagner (intern) |
|
Zuordnung
Organisation | Adresse | ||||
---|---|---|---|---|---|
Fakultät für Technische Wissenschaften
Institut für Informationstechnologie
|
AT - 9020 Klagenfurt am Wörthersee |
Kategorisierung
Sachgebiete | |
Forschungscluster | Kein Forschungscluster ausgewählt |
Vortragsfokus |
Klassifikationsraster der zugeordneten Organisationseinheiten:
|
TeilnehmerInnenkreis |
|
Publiziert? |
|
Arbeitsgruppen |
|
Kooperationen
Organisation | Adresse | ||
---|---|---|---|
California Baptist University
|
US - CA 92504 Riverside |
||
University of Illinois
|
US
Chicago |
||
University of Massachusetts Amherst
|
US
- MA 01003
Amherst |
Forschungsaktivitäten
(Achtung: Externe Aktivitäten werden im Suchergebnis nicht mitangezeigt)
Projekte |
|
Publikationen |
|
Veranstaltungen |
|
Vorträge | Keine verknüpften Vorträge vorhanden |