Multimedia Metadata Management and t-learning Applications Prof. Stavros Christodoulakis stavros@ced.tuc.gr Lab. Of Multimedia Information Systems and Applications, Technical University of Crete, Greece (TUC/MUSIC) http://www.ced.tuc.gr 16/12/2003 Workshop on Metadata Management in Grid and P2P systems TUC/MUSIC Objectives and context • Objectives of research: Metadata management for audiovisual content to support intelligent video- content retrieval and e-learning services in digital TV (t-learning) • Context: TV-Anytime framework, MPEG-7 and SCORM – Personal digital recorders – TVA servers – Mobile access – Integration of educational and video metadata • UPTV and KNOSOS projects 16/12/2003 Workshop on Metadata Management in Grid and P2P systems TUC/MUSIC Outline • Ubiquitous Personalized TV Framework • Metadata Management • Semantic Metadata Management • Support for t-learning • Ongoing Work 16/12/2003 Workshop on Metadata Management in Grid and P2P systems TUC/MUSIC Ubiquitous Personalized TV Framework 16/12/2003 Workshop on Metadata Management in Grid and P2P systems TUC/MUSIC Metadata Management Basic parts of TVA, MPEG7 • Programs – segments – summaries • Filtering preferences – browsing preferences – usage histories • Semantic metadata & ontologies • Integration of SCORM metadata on program segments 16/12/2003 Workshop on Metadata Management in Grid and P2P systems TUC/MUSIC Metadata management Program metadata handling XML doc with TVA Management XSL Program Tools Transformation Metadata from heterogeneous providers TVA XML doc with TVA XML Program Metadata Schema XML-DB middleware Data Parser/Validator Extended Java Class Hierarchy with Binder DB Insert, Retrieve Methods Java Object Tree Java Class Hierarchy with Marshall/Unmarshall JDBC Methods Relational DBMS DB 16/12/2003 Workshop on Metadata Management in Grid and P2P systems TUC/MUSIC Metadata Management Personalization TVA Management Tools Application Application TV-A TV-A XML doc with XML doc with TV-A XML TV-A XML TV-A XML usage history user preferences doc doc doc XML-DB middleware Parser/Validator Extended Java Class Hierarchy with DB Insert, Retrieve Methods Filtering and Retrieval services Java Object Tree(s) Profile adaptation / determination Profile matching Explicit search JDBC Profile retrieval Relational DB DBMS 16/12/2003 Workshop on Metadata Management in Grid and P2P systems TUC/MUSIC Metadata Management Mobility support • Mobile user profile (what, where, when, how) Use the arrow Enter • Profile migration & routing buttons to de.nurenberg.astron navigate: Enter Up-Down to d m yy select an item, 2 0 200 L ft Ri ht t • Distributed filtering Enter d m yy 2 0 200 Traveling Profiles Enter • Mobile/PDA as a remote Travel de.nurenberg.astron gr.athens.home Î de.nurenberg.astron Travel Path Create New Travel Record de.nurenberg.astron Î be.overpelt.center be.overpelt.center_park Î gr.athens. control & browsing tool • Quality adaptation mechanisms 16/12/2003 Workshop on Metadata Management in Grid and P2P systems TUC/MUSIC Semantic Metadata Management An ontology driven framework • TV-Anytime keywords are the only means to describe program segments • The MPEG-7 semantic model is used to build domain specific ontologies. Transparent use by MPEG-7 applications. • Coupling of OWL and MPEG-7 MDS for interoperability has been implemented • Ontologies are used for filtering and retrieval of MPEG-7 multimedia content • Semantic annotations are transformed into TV-Anytime segment keywords 16/12/2003 Workshop on Metadata Management in Grid and P2P systems TUC/MUSIC Segmentation & Semantic Indexing Tool Semantic Semantic Indexing Component Domain- specific OWL/XML Ontology Import Instance Description ontologies Component Metadata Definition Metadata Application- Specific Metadata RDF/XMLApplication Specific Metadata Import Application Specific Metadata Definition Management RDF / XML Transformation Rules RDF / XMLÙ RDF / XMLÙ MPEG-7 / XML TVA / XML MPEG-7 / XML TVA / XML Overall Semantic Indexing Keyword-based Indexing Semantic Base TVA Database workflow Stored Ontologies Instance Description Application Specific Metadata Programs & Segments Metadata RELATIONAL DATABASE XML XML (MPEG-7) Semantic Search Interfaces (TVA) Keyword Search Interfaces & User Profile Specifications & User Profile Specifications USERS 16/12/2003 Workshop on Metadata Management in Grid and P2P systems TUC/MUSIC Support for t-learning Issues • t-learning refers to the offering of e-learning services using digital TV technologies • t-learning exploits the advantages of TV technologies and leverages on the already established TV infrastructure • Objectives: – Provide interoperability for educational applications in different e-learning and digital TV environments – Creation of metadata for digital TV for educational purposes in order to offer educational experiences exploiting usual TV programs 16/12/2003 Workshop on Metadata Management in Grid and P2P systems TUC/MUSIC Support for t-learning Metadata Management • Baseline: – TV-Anytime – SCORM • TV-Anytime program segmentation descriptions are integrated with SCORM descriptions • TV-Anytime – SCORM mappings • Additional educational metadata on TV-Anytime segments (SCORM parts not mapped on TV- Anytime) 16/12/2003 Workshop on Metadata Management in Grid and P2P systems TUC/MUSIC Support for t-learning Overall Workflow Segmentation Tool (TVA compatible) TVA XML document (about segments) Extension- SCORM XML Transformati SCORM XML Change of document(describes Creation of on mechanism document educational SCOs with SCORM (TVA video (describes metadata educational metadata courses segments to SCOs) (describes extensions) according to SCOs) produced user’s choices SCOs) Relational Correspondence of TVA Relational Data Database for video segment metadata to Base for SCORM educational SCO metadata courses metadata Package Interchange File (PIF) LMS (SCORM compatible) 16/12/2003 Workshop on Metadata Management in Grid and P2P systems TUC/MUSIC Ongoing Work • Mapping SCORM educational metadata to the MPEG-7 semantic model (KNOSOS) • Rich retrieval and personalization mechanisms for audiovisual libraries (DELOS NoE) • Grid and P2P architectures for Digital Business Ecosystems (DBE IP) 16/12/2003 Workshop on Metadata Management in Grid and P2P systems TUC/MUSIC References • Tsinaraki C., Polydoros P., Kazasis F., Christodoulakis S., Ontology-based Semantic Indexing for MPEG-7 and TV-Anytime Audiovisual Content, Special issue of Multimedia Tools and Application Journal on Video Segmentation for Semantic Annotation and Transcoding, 2003 (to appear) • Tsinaraki C., Fatourou E., Christodoulakis S., An Ontology-Driven Framework for the Management of Semantic Metadata describing Audiovisual Information, proceedings of CAiSE 2003 pp 340-356, 16-20 June 2003, Klangefurt-Velden • Pappas N., Kazasis F., Moumoutzis N., Tsinaraki C., Christodoulakis S., Personalized and Ubiquitous Information Services for TV Programs, Workshop on Multimedia Contents in Digital Libraries, 2-3 June 2003, Chania, Greece • Kazasis F.G., Moumoutzis N., Pappas N., Karanastasi A., Christodoulakis S., Designing Ubiquitous Personalized TV-Anytime Services, UMICS 2003, 16-17 June 2003, Klangefurt-Velden • Tsinaraki C., Polydoros P., Christodoulakis S., Integration of OWL ontologies in MPEG-7 and TVAnytime compliant Semantic Indexing, submitted for publication 16/12/2003 Workshop on Metadata Management in Grid and P2P systems TUC/MUSIC