=Paper=
{{Paper
|id=Vol-233/paper-26
|storemode=property
|title=EU-IST Project Live: Live Staging of Media Events
|pdfUrl=https://ceur-ws.org/Vol-233/p53.pdf
|volume=Vol-233
|dblpUrl=https://dblp.org/rec/conf/samt/KohlerWWF06
}}
==EU-IST Project Live: Live Staging of Media Events==
https://ceur-ws.org/Vol-233/p53.pdf
EU-IST Project Live: Live Staging of Media
Events
Joachim Köhler, Richard Wages, Carmen Mac Williams, and Heike Fischer
long as possible at the channel of the selected broadcaster.
Abstract— This paper gives an overview, the main objectives Further the consumer should be enabled to influence the
and the first results of the EU IST project Live. This integrated authoring of live content.
project will investigate new methods and formats for authoring To achieve this goal the IST project Live investigates new
and production of live sports events in a professional broadcast
environment. To achieve these new interactive TV formats the
methods to process the live sports content and invent novel
processing of different types of audio-visual (A/V) material must formats to produce several TV streams in parallel. In a first
be enhanced to allow for a more sophisticated selection and step interdisciplinary teams of TV broadcasters, artists and
advanced authoring of sports content. This live staging process researchers have to mutually combine methods and strategies
will generate several output streams which are interlinked with and set up experiments to develop new concepts and content
each other. The consumers have the benefit that they can select formats. Creating a non-linear multi-stream video show in
and receive video material in a more personalized manner.
real-time which is influenced by the consumers using
Index Terms— multimedia analysis, interactive TV format, feedback mechanism is in the central scope of the project.
personalization A. Role of the Partners
In the project 9 partners from the academic and industrial
I. INTRODUCTION area are involved. The co-ordination is performed by the
Fraunhofer Institute Intelligent Analysis and Information
A DVANCED technologies in the area of content analysis
and production lead to new possibilities to create new
interactive TV formats. Although several standards (e.g.
Systems (FhG IAIS). The ORF in Vienna participates with
several units and provides the main infrastructure to produce
the content. Since the sports department is involved, the
MHP) and applications (e.g. tele shopping) in the media project benefits from the experience of sports commentators
industry are introduced to enable interactive TV formats the and directors. The KHM and the University of Applied
acceptance by TV consumers as well as the market penetration Sciences in Cologne carry out research on new methods for
is still low. On the other hand the increased availability of live staging. The University of Ljubljana develops tools for
different TV channels (more than 100 TV channels can personalization, user profiling and feedback mechanism.
already be received in a typical German household) and
ATOS Origin investigates the market for interactive
different types of TV distribution networks (cable, internet,
broadcast solutions. FhG IAIS and the University of
IPTV, etc.) lead to a competitive market situation in the
Bradford investigate media analysis approaches to generate
broadcast world. Hence, the broadcasters pay high fees for
the metadata online and offline. The research work on
important sports events, like the Olympic Games, and offer
semantic analysis for content filtering is performed by
this important content to the TV consumers. Optimizing the
Salzburg research. Finally, Sony NetServices develops
exploitation of this expensive content is in the central interest
content visualization tools for the authoring environment.
of the broadcasters. The TV consumer should be able to
receive the content in a personal and interactive way to stay as B. Budget and Milestones
Live is an integrated project (IP) and has a duration of 45
months. It started on the 1st of January 2006 and the first
Manuscript received August 30, 2006. This work was supported in part by
the European Commission under Grant 027312, resulting from the 4th call of
phase has a duration of 18 month. The milestone of the first
FP6 in the area of the IST Strategic Objective 2.4.7 'Semantic Knowledge and phase is to provide a first integrated prototype which is able to
Content Systems'. All statements in this work reflect the personal ideas and generate 2 streams in parallel. In the second phase of the
opinions of the authors and not necessarily the opinions of the European
project a demonstrator for the Olympic Games 2008 will be
Commission.
J. Köhler and H. Fischer are with the Fraunhofer IAIS, 53754 Sankt developed to show the new interactive format to a defined
Augustin, Germany (+49-2241-14-1900; fax: +49-2241-14-2597; e-mail: group of TV consumers in Austria. The overall budget is 11.3
Joachim.koehler@iais.fraunhofer.de, Heike.Fischer@imk.fraunhofer.de). Mio. € and the amount of funding is 7.0 Mio. €.
R. Wages is with the Institute for Media and Imaging Technology at the
University of Applied Sciences Cologne, 50679 Cologne, Germany (e-mail:
richard.wages@fh-koeln.de).
C. Mac Williams is with Academy of Media Arts (KHM), 50676 Cologne,
Germany (e-mail: carmen@khm.de).
II. REQUIREMENTS FOR LIVE STAGING indexed and annotated in real-time to provide the required
As one of the first project results the requirement analysis metadata for content filtering and selection. Further, additional
for the live staging process was defined. The objective was to material from the archive will be made available directly for
evaluate the actual way of content production of live sports the conduction process. This means that all relevant broadcast
events at the ORF and to analyze available tools and material should be made available for the conducting process
infrastructures for live conduction. Therefore several live within a very short time span. Therefore it is necessary to
staging sessions were observed and analyzed at the ORF in connect the broadcaster's archive directly to the conducting
Austria as for example the 2006 Women's FIS Ski World Cup environment. Multiple streams/feeds of the live staging will be
in Bad Kleinkirchheim. For the first actual live staging distributed in parallel and will be interlinked with each other.
experiments and the investigation of new live staging Then the signal will be distributed over a TV network to the
approaches we decided to use recorded live material from the consumer. For transmission the available interactive
2006 UCI World Championship in Salzburg to produce two broadcasting technologies, like MHP or IPTV, can be used.
parallel streams with the available ORF infrastructure. The One important aspect of the project is the possibility of
experiments will be carried out with content stored on digital personalization of the content by the TV content consumer
storage systems, the live situation will be simulated. who can select a special feed of the live sports event. Beyond
Future directors and production teams – Live Video mere channel selection it is possible to give feedback to the
Conductors – will have the difficult task to produce several broadcast station and to influence the live conduction process.
output streams from incoming video feeds and additional Whether this approach will be accepted and means an
information sources in real-time which means a need for added value for the broadcasting world is one of the exciting
sophisticated concepts and tools to process, prepare and select questions in the project. Consumer feedback and influence
the incoming A/V content. Yet in encouraging the consumer during production leads to a situation where the consumer gets
to switch to a parallel stream we are deliberately endangering in to the role of the director. For the feedback mechanism
the 'guidance of interpretation' which we are used to in 'single approaches like explicit and implicit user feedback will be
stream TV productions' by the application of well-established investigated and techniques like collaborative filtering and the
and sophisticated editing methods. The Live project aims at development of a recommender system are foreseen. All
the development of a system that deals with the classification components and their relation to each other are modeled in
of meaning of A/V objects on different semantic levels and UML. In the further process of the project the modules and
methods to support producers in utilizing this meaning. the missing components must be implemented and adapted.
This will be done by creating an intelligent media
framework in which semantic information is extracted from
and assigned to A/V material. Rather than creating an agent IV. CONCLUSION AND OUTLOOK
system which autonomously decides on the selection of After the finalization of the requirement phase the design
certain content the project's focus is to create a system which and implementation of the first prototype for a live staging
makes multiple recommendations to both Live Video environment is on its way. The intensive interaction between
Conductors during TV production as well as to consumers. experts from the content research field, users in broadcast
domain and researchers on system and algorithm design will
lead to new chances to enable advanced interactive TV
III. REQUIREMENTS FOR THE GENERAL OVERALL SYSTEM applications. The mayor goal is to provide an integrated Live
ARCHITECTURE system for the 2008 Olympic Games.
As a second result of the first 6 months of the project an
overall system architecture was designed. A basic overview is REFERENCES
given in figure 1. [1] C. Mac Williams, R. Wages, S. Grünvogel, G. Trogemann, "Virtual
Personal Channels: Video Conducting of Future TV Broadcasting,"
Proc. EWIMT 2005, London, 2005, pp.381–382.
[2] P. Villegas, N. Sarris, J. Picault, I. Kompatsiaris, "Creating A Mesh of
Multimedia News Feeds," Proc. EWIMT 2005, London, 2005, pp.453–
454.
[3] J. Löffler, K. Biatov, J. Köhler, "Automatic Extraction of MPEG-7
Audio Metadata Using the Media Asset Management System IFinder,"
25th International AES Conference, London, June 2004.
[4] J. Köhler, "The iFinder audiovisual indexing framework for cross media
applications," Workshop on Cross Media Applications at LREC 2006,
Genoa, 2006.
[5] T. Bürger, G. Günther, "Smart Content Factory – Semantic Knowledge
Based Indexing of Audiovisual Content," Proc. EWIMT 2005, London,
Figure 1. Basic system architecture of the Live project
2005, pp.367– 372.
[6] L. Ardissono, A. Kobsa, M. Maybury, "Personalized Digital Television:
In the center of the whole system the live conducting tools Targeting Programs to Individual Viewers," Springer, 2004.
are situated. Incoming live content from sports events is