=Paper=
{{Paper
|id=Vol-95/paper-10
|storemode=property
|title=Multimedia Metadata Management and t-Learning Applications
|pdfUrl=https://ceur-ws.org/Vol-95/10-christodoulakis.pdf
|volume=Vol-95
|dblpUrl=https://dblp.org/rec/conf/mmgps/Christodoulakis03
}}
==Multimedia Metadata Management and t-Learning Applications==
https://ceur-ws.org/Vol-95/10-christodoulakis.pdf
Multimedia Metadata
Management and t-learning
Applications
Prof. Stavros Christodoulakis
stavros@ced.tuc.gr
Lab. Of Multimedia Information Systems and Applications,
Technical University of Crete, Greece
(TUC/MUSIC)
http://www.ced.tuc.gr
16/12/2003 Workshop on Metadata Management in Grid and P2P systems
TUC/MUSIC
Objectives and context
• Objectives of research: Metadata management for
audiovisual content to support intelligent video-
content retrieval and e-learning services in digital TV
(t-learning)
• Context: TV-Anytime framework, MPEG-7 and
SCORM
– Personal digital recorders
– TVA servers
– Mobile access
– Integration of educational and video metadata
• UPTV and KNOSOS projects
16/12/2003 Workshop on Metadata Management in Grid and P2P systems
TUC/MUSIC
Outline
• Ubiquitous Personalized TV Framework
• Metadata Management
• Semantic Metadata Management
• Support for t-learning
• Ongoing Work
16/12/2003 Workshop on Metadata Management in Grid and P2P systems
TUC/MUSIC
Ubiquitous Personalized TV Framework
16/12/2003 Workshop on Metadata Management in Grid and P2P systems
TUC/MUSIC
Metadata Management
Basic parts of TVA, MPEG7
• Programs – segments – summaries
• Filtering preferences – browsing
preferences – usage histories
• Semantic metadata & ontologies
• Integration of SCORM metadata on
program segments
16/12/2003 Workshop on Metadata Management in Grid and P2P systems
TUC/MUSIC
Metadata management
Program metadata handling XML doc with
TVA Management XSL Program
Tools Transformation Metadata from
heterogeneous
providers
TVA XML doc with
TVA XML
Program Metadata Schema
XML-DB middleware
Data
Parser/Validator Extended Java Class Hierarchy with Binder
DB Insert, Retrieve Methods
Java Object
Tree
Java Class Hierarchy
with
Marshall/Unmarshall
JDBC
Methods
Relational
DBMS
DB
16/12/2003 Workshop on Metadata Management in Grid and P2P systems
TUC/MUSIC
Metadata Management
Personalization TVA Management Tools Application Application
TV-A TV-A
XML doc with XML doc with
TV-A XML TV-A XML TV-A XML
usage history user preferences
doc doc doc
XML-DB middleware
Parser/Validator Extended Java Class Hierarchy with
DB Insert, Retrieve Methods Filtering and Retrieval services
Java Object
Tree(s)
Profile adaptation /
determination
Profile matching
Explicit search
JDBC Profile retrieval
Relational
DB DBMS
16/12/2003 Workshop on Metadata Management in Grid and P2P systems
TUC/MUSIC
Metadata Management
Mobility support
• Mobile user profile
(what, where, when,
how)
Use the arrow
Enter • Profile migration &
routing
buttons to de.nurenberg.astron
navigate: Enter
Up-Down to d m yy
select an item, 2 0 200
L ft Ri ht t
• Distributed filtering
Enter
d m yy
2 0 200
Traveling
Profiles Enter
• Mobile/PDA as a remote
Travel de.nurenberg.astron
gr.athens.home Î de.nurenberg.astron
Travel Path
Create New
Travel Record
de.nurenberg.astron Î
be.overpelt.center
be.overpelt.center_park Î gr.athens.
control & browsing tool
• Quality adaptation
mechanisms
16/12/2003 Workshop on Metadata Management in Grid and P2P systems
TUC/MUSIC
Semantic Metadata Management
An ontology driven framework
• TV-Anytime keywords are the only means to describe
program segments
• The MPEG-7 semantic model is used to build domain
specific ontologies. Transparent use by MPEG-7
applications.
• Coupling of OWL and MPEG-7 MDS for interoperability
has been implemented
• Ontologies are used for filtering and retrieval of MPEG-7
multimedia content
• Semantic annotations are transformed into TV-Anytime
segment keywords
16/12/2003 Workshop on Metadata Management in Grid and P2P systems
TUC/MUSIC
Segmentation & Semantic Indexing Tool
Semantic
Semantic Indexing Component
Domain-
specific OWL/XML Ontology Import Instance Description
ontologies Component Metadata Definition
Metadata Application-
Specific
Metadata
RDF/XMLApplication Specific
Metadata Import
Application Specific
Metadata Definition
Management
RDF / XML
Transformation Rules
RDF / XMLÙ RDF / XMLÙ
MPEG-7 / XML TVA / XML
MPEG-7 / XML TVA / XML
Overall
Semantic Indexing Keyword-based Indexing
Semantic Base
TVA Database
workflow Stored
Ontologies
Instance
Description
Application
Specific
Metadata
Programs &
Segments
Metadata
RELATIONAL DATABASE
XML XML
(MPEG-7) Semantic Search Interfaces (TVA) Keyword Search Interfaces
& User Profile Specifications & User Profile Specifications
USERS
16/12/2003 Workshop on Metadata Management in Grid and P2P systems
TUC/MUSIC
Support for t-learning
Issues
• t-learning refers to the offering of e-learning
services using digital TV technologies
• t-learning exploits the advantages of TV
technologies and leverages on the already
established TV infrastructure
• Objectives:
– Provide interoperability for educational applications in
different e-learning and digital TV environments
– Creation of metadata for digital TV for educational
purposes in order to offer educational experiences
exploiting usual TV programs
16/12/2003 Workshop on Metadata Management in Grid and P2P systems
TUC/MUSIC
Support for t-learning
Metadata Management
• Baseline:
– TV-Anytime
– SCORM
• TV-Anytime program segmentation descriptions
are integrated with SCORM descriptions
• TV-Anytime – SCORM mappings
• Additional educational metadata on TV-Anytime
segments (SCORM parts not mapped on TV-
Anytime)
16/12/2003 Workshop on Metadata Management in Grid and P2P systems
TUC/MUSIC
Support for t-learning
Overall Workflow
Segmentation Tool (TVA compatible)
TVA XML
document
(about
segments)
Extension- SCORM XML
Transformati SCORM XML Change of document(describes Creation of
on mechanism document educational SCOs with SCORM
(TVA video (describes metadata educational metadata courses
segments to SCOs) (describes extensions) according to
SCOs) produced user’s choices
SCOs)
Relational
Correspondence of TVA Relational Data
Database for
video segment metadata to Base for SCORM
educational
SCO metadata courses
metadata
Package Interchange File
(PIF)
LMS (SCORM compatible)
16/12/2003 Workshop on Metadata Management in Grid and P2P systems
TUC/MUSIC
Ongoing Work
• Mapping SCORM educational metadata to
the MPEG-7 semantic model (KNOSOS)
• Rich retrieval and personalization
mechanisms for audiovisual libraries
(DELOS NoE)
• Grid and P2P architectures for Digital
Business Ecosystems (DBE IP)
16/12/2003 Workshop on Metadata Management in Grid and P2P systems
TUC/MUSIC
References
• Tsinaraki C., Polydoros P., Kazasis F., Christodoulakis S., Ontology-based Semantic
Indexing for MPEG-7 and TV-Anytime Audiovisual Content, Special issue of
Multimedia Tools and Application Journal on Video Segmentation for Semantic
Annotation and Transcoding, 2003 (to appear)
• Tsinaraki C., Fatourou E., Christodoulakis S., An Ontology-Driven Framework for the
Management of Semantic Metadata describing Audiovisual Information, proceedings of
CAiSE 2003 pp 340-356, 16-20 June 2003, Klangefurt-Velden
• Pappas N., Kazasis F., Moumoutzis N., Tsinaraki C., Christodoulakis S., Personalized
and Ubiquitous Information Services for TV Programs, Workshop on Multimedia
Contents in Digital Libraries, 2-3 June 2003, Chania, Greece
• Kazasis F.G., Moumoutzis N., Pappas N., Karanastasi A., Christodoulakis S., Designing
Ubiquitous Personalized TV-Anytime Services, UMICS 2003, 16-17 June 2003,
Klangefurt-Velden
• Tsinaraki C., Polydoros P., Christodoulakis S., Integration of OWL ontologies in
MPEG-7 and TVAnytime compliant Semantic Indexing, submitted for publication
16/12/2003 Workshop on Metadata Management in Grid and P2P systems
TUC/MUSIC