Towards an Open System for Multimedia Mobile Phone Exchange: Adaptation Architecture Saighi Asma1, Nacira Ghoualmi-Zine2, Philipe Roose 3 1 pgasma_saighi@yahoo.fr, 2 ghoualmi@yahoo.fr, 3 Philippe.Roose@iutbayonne.univ-pau.fr 1,2 Univercité Badji Mokhtar, Computer sciences departement 3 Université Pau, IUT Bayonne, Computer sciences departement Abstract. Ubiquitous environment can include heterogeneous terminals that haven’t the same characteristics. Exchange multimedia data using heterogeneous terminals requires an adaptation of contents or other types of adaptation. In this paper we present a state of the art as: related work in term of approaches followed by a comparative study, comparative study of five existing adaptation architectures. On the second hand we present our architecture based on Client/Intermediary/Server model. So, we distinguish four main parts: multimedia client sender and multimedia client receiver, server with descriptors of environment, and proxy as a web services. This investigation aims to conceive an open system that integrates heterogeneous mobile phones. This open architecture aims to improve Qos between multimedia sender and multimedia receiver. Our proposed architecture allows multimedia clients to deliver multimedia content according to the mobile phone’s specification receiver. As study case, we present a specification of some mobile phones: Nokia 2610, Samsung X640, Sony Ericsson K320, Siemens CX65 and Nokia N93i with four illustrative adaptation scenarios. Key words: Open system, Multimedia content adaptation, proxy, mobile phone, multimedia client 1 Introduction Currently, a lot of different end multimedia client’s devices (mobile phones in our case) are heterogeneous. So, hardware and software capacities are heterogeneous and some times limited. End user devices features have different capabilities in terms of memory size, display size, or supported formats. However, rendering multimedia content in such an environment remains challenging, because the content itself is heterogeneous in terms of encoding. For instance, a video can be encoded in different formats such as 3gpp, MPEG-4, or WMV, using different encoder settings such as spatial and 54 Proceedings of CAiSE-DC 2008 temporal resolution, or bit rate. These limitations require an adaptation of contents or other type of adaptation. Therefore, a lot of research works where proposed in literature. Among the existing architectures, we find: ISIS [1] that follows the client/server model; NAC [2] is based in Client/Intermediary(s)/Server model. There are other architectures based on P2P model like PAAM [3]. DCAF [4] architecture is based on content adaptation services developed externally to make content transformations. The main objective of our research is to bring a solution for the multimedia client sender to deliver any multimedia document without getting an echo message due to the incapacity of the multimedia client receiver mobile phone to support the sent multimedia document. In other term, our proposed architecture aims to adapt multimedia document sent by a multimedia mobile phone before being delivered to the multimedia mobile phone receiver. Generally, the existing adaptation architectures treat multimedia data sent from a server machine to a client device but in our architecture the adaptation treatment is applied to the multimedia data sent from a multimedia client to other multimedia client and this is how our proposed architecture advances the state of the art. This paper is organized as follow, in section two we compare the existing adaptation multimedia approaches and we compare some existing multimedia adaptation architectures. Section three presents the proposed architecture, its aim and components. Section five presents studies cases using adaptation scenarios with mobile phone types. 2 Comparative studies We present in this section comparative study between adaptation approaches in Table.1 and a comparative study between five existing architectures in Table. 2. Table 1. Comparative study between the existing adaptation approaches. Approach Decision make and Advantages Disadvantages adaptation Centered In the level of the +The author formulates -The provider server [5] server advices or constrains in the integrates adaptation adaptation. mechanisms. +Implementation of dynamic -Calculation charge and static adaptation in the server. mechanisms. Centered In the client level by +For simple problematic. -Badly adapted to client [6] two methods: content the situations when selection or ad hoc network constrains transformation. are difficult. -Not practice. Centered In an intermediary +Put results in hide. -bad scalability proxy [7] nod: proxy +The calculation charge is in -Security problem. the le proxy. -adaptation tools are +Disposes of a global view brought to evaluate. about the environment. Proceedings of CAiSE-DC 2008 55 Table 2. Comparative study between five existing adaptation architectures. Architecture Goal Proxy Adaptation Profiles managements Adaptation Adaptation of a In the proxy site is -A video is transmitted from Not specified architecture distributed multimedia deployed an adaptation a web site to the client. of application by a mobile mobile agent. -The video passes by the multimedia code proxy. application -An adaptation agents are by mobile deployed in the proxy and code [8] modify the video flow. A generic Architecture that The proxy is a service -The supervision module Profile base Architecture antiques Simultaneously manager. detects the change. for the service logic -The manager determines providing adaptation using the adaptation actions. adaptable components and the - The service manager sends multimedia adaptation of the the downloading request of services [9] multimedia flow. the adapted version. Assures in Communication Proxy -ANM establishes an Profile NAC [2] heterogeneous oriented negotiation. adaptation graph. repository environment a - Static Adaptation. transmission of the -Parameter of dynamic adapted content with Adaptation. negotiation. -DynamicAdaptation during the execution. Every participant must There is no proxy -To recuperate information User context PAAM [3] be consummator, relative to the user and to manager. provider or adaptator. the composed document. PAAM Inspires largely -To decide the adaptation to from [9] apply and search the adaptators. -To instantiate adaptation graph. DCAF [4] Architecture oriented -Content proxy. -Based on tierce adaptation CPR (Context multimedia adaptation -Local proxy. services. Profile services in a pervasive -Adaptation service -Introduce a directory of the Repository) environment to resolve proxy. adaptation services (ASR). the le interoperability -Assures adaptation of the problem, the flexibility web services available and scalability implemented apart from of DCAF. -Ontology was developed for describing the adaptation service. 56 Proceedings of CAiSE-DC 2008 3 Proposed architecture The Architecture proposed in this paper is illustrated in the figure 1. This architecture is based upon the Client/Intermediary/Server model. This open architecture aims to improve the flexibility and the adaptability of service (Qos) between multimedia sender and multimedia receiver. Our proposed architecture allows multimedia clients to deliver multimedia content according to the mobile phone’s specification receiver. It integrates heterogeneous mobile phones and provides an adaptation service for them in transparent manner. Descriptors mobile/document Server machine Environment’s parameters Original content Adaptation plan generator Proxy Adapted content Sender mobile phones Receiver mobile phones Fig. 1. Open system architecture 3.1 Components of the architecture 3.1.1 Multimedia client There are two types of multimedia clients: multimedia client sender and multimedia client receiver. 3.1.2 Server The server has descriptors structured as data base. Each multimedia phone has different characteristics (identifier, etc). The descriptor of the multimedia document contains the original multimedia data received from the multimedia client sender. As known, the server supports all kinds of multimedia data. Therefore, we suppose that each sent message from the multimedia client sender will pass directly and transparently to the server. Then, server selects from this message all environment’s parameters: parameters of multimedia client receiver mobile phone characteristics such as screen display, supported contents and multimedia content parameters like format, size, image dimension etc. After collecting environment parameters, server checks them in the descriptors. If these descriptors don’t exist, it stores them. Proceedings of CAiSE-DC 2008 57 3.1.3 Proxy Proxy constitutes the core of our architecture, it assists the server as a web services with its two modules: decision module and adaptation module. Figure 2, presents the behavior of the proxy. Because the success of the adaptation depends to the quality and quantity of required knowledge about environment, the communication module in the proxy receives environment’s parameters representing an adaptation request (1) from the server. Then, communication module sends to the data base the new environment parameters (2), if the new environment parameter exists in the data base; this last sends the stored adaptation type according to these new environment parameters to the decision module (4). Else the decision module in the proxy selects adaptation type corresponding to the new environment parameters in adaptation type data base if it exists. Else, data base will send only the new environment parameters (5) witch represents a negative answer. In this case, decision module creates a new adaptation type(s), sent it (them) to the data base in order to update it (6). Then, decision module send the new environment parameters and the generated adaptation type to the adaptation plan generator (7) to get the optimal adaptation plan already stored (8). If the optimal adaptation plan doesn’t exist, the registry adaptation generates these set of actions according to the given parameters. Before sending the message to multimedia client receiver (9), adaptation module executes the optimal adaptation plan. (1) Communication module (6) (2) (7) Decision module Data Base (8) (4) OR Adaptation module (5) (9) Fig. 2. Functional Schema of the Proxy Upon receipt of the message, the server sends to the sender multimedia client’s mobile phone a confirmation (SMS) message if the message was well received. Otherwise, an error SMS message is sent back to the sender multimedia client’s mobile phone. 3.1.4 Adaptation plan generator The role of the adaptation plan generator is to generate the optimal adaptation plan of the given environment parameter and also to stores all types of adaptation and the set 58 Proceedings of CAiSE-DC 2008 of adaptation actions of every type. The optimal adaptation generator represents the minimum set of adaptation actions. 4 Study Case 4.1 Mobiles Each multimedia mobile phone has a specification or a device context. For this reason, we are not able to specify all existing multimedia mobile phones in the market. As study case, we choose to specify dimensions, type, display size, ringtones type, memory card slot, GPRS, HSCSD, EDGE, WLAN, Bluetooth, Infrared port, USB, Supported image format, Supported video format, Supported audio format, Messaging, battery etc of some multimedia mobile phones [10]. These specifications are represented in table 3. Table 3. Specification of four multimedia mobile phones Technical Nokia 2610 Samsung Sony Ericsson K320 Nokia N93i Siemens CX65 characteristics SGH-X640 Dimensions 104 x 43 x 18 87.4 x 47 x 23 108 x 58 x 25 mm, 132x176 101 x 44 x 18 mm mm mm 115 cc Type CSTN,65K UFB,65K UBC, 65K colors TFT, 16M colors TFT,65K colors colors colors Display size 128 x 128 pixels 128 x 160 128 x 160 pixels, 1.8 240 x 320 pixels 162x176 pixel pixels inches Ringtones type Polyphonic(64 Polyphonic (40 Polyphonic (24 Polyphonic Polyphonic (40 channels), MP3 (40 channels) channels), MP3, AAC channels), MP3 channels) Memory card No No miniSD, hot swap No No slot GPRS Yes Yes Yes Class 32, 107.2/64.2 Class10 kbps (4+1/3+2 slots), 32 - 48 kbps HSCSD No No Yes Yes (via PC dial-up) No EDGE No No No Class 32, 296 kbps; No DTM Class 11, 236.8 kbps WLAN No No No Wi-Fi 802.11b/g No Bluetooth No No Yes Yes No Infrared port No No Yes Yes Yes Camera to No Available Available Available Available capture image Supported GIF, JPEG, BMP, GIF, GIF, JPEG, WBMP, GIF, JPEG, JP2, JPG, BMP,GIF, image format PNG, BMP JPEG, PNG, BMP, PNG, VND.WAP, PNG, SVG+WMP, PNG,JPEG, X-NP-WPNG WBMP, CVG TIFF. SVG,+xml, VND.wap.WB Camera video No No Available Available Available Supported No No Mpeg, mp4, 3gpp, 3gpp, mp4, vnd.rn- 3gpp Proceedings of CAiSE-DC 2008 59 video format mpeg4, mp4v-es real video Supported Midi, mid, mp3, Melody, midi Amr, rhz, midi, x-midi, 3pgg, aac, amr,amr- Midi, wav, amr audio format x-mid, amr, sp-midi, midi melody, wb, au, basic, mid, amr-wb, mpeg, mpeg, mpeg3, mp3,wav, midi, mobile-xinf, x-amr 3gpp, mp4, x-wav, xmf mp3, mp4, mpeg, rmf, sp-midi, vn d.rm-real audio, wav, x-amr, x-au, x- beatnik-rmf, x-mid, x-midi, x-pn-real audio, x-pn-real audio plugin, x-rmf, x-wav Messaging SMS,MMS, SMS, EMS, SMS, MMS, Email, SMS, MMS, Email, SMS, MMS, Email, Instant MMS Instant Messaging Instant Messaging Email Messaging Browser WAP WAP WAP2.0/xHTML, WAP 2.0/xHTML, WAP 2.0/xHTML 2.0/xHTML HTML(NetFront) HTML 2.0/xHTML Battery Standardbattery Standard Standard battery, Li-Ion Standard battery, Li- Standard, Li- Li-Ion 970 mAh battery, Li-Ion 750 mAh (BST-36) Ion 950 mAh (BL- Ion 750 mAh (BL-5C) 800 mAh 5F) (EBA-660) Games 2 - Snowball Yes Yes Yes Coin Flipping + fighter, downloadable, Bubble smile downloadable Several adaptation techniques have been developed to deliver multimedia data to the multimedia client receiver in heterogeneous environment (heterogeneous mobile phones).Currently available techniques apply textual transformation, image transcoding, video and audio processing. A list of content adaptation technologies that can be applied to the basic media types: text, image, audio and video are presented in table 4. Table 4. Media types and content adaptation techniques [11, 12] Category Text Image Video Audio Transcoding -format -data size -frame rate -audio to stereo- conversion reduction reduction mono reduction -font size -dimension -spatial - format reduction reduction resolution conversion -color-depth reduction reduction -temporal -color-to- resolution grayscale reduction reduction -color-depth -format reduction conversion -format conversion Transmoding -text-to-audio Image to text -video-to-image -audio-to-text transformation transformation transformation -video-to-text transformation -video-to-audio transformation Summarization -text -key frame -audio highlight summarization extraction translation -language -language -language translation translation translation 60 Proceedings of CAiSE-DC 2008 In general sense, content adaptation techniques can be classified as semantic adaptation and physical adaptation. In our study, we are interested in physical adaptation (content level adaptation) techniques as illustrated in section 4.2. 4.2 Illustrative Scenarios for proposed architecture Scenario 1: Multimedia client sender is Nokia 93i mobile phone and has to transmit an image to another multimedia client receiver Nokia 2610 mobile phone. The image is stored in colored TIFF format. As specified in table 3, Nokia 2610 don’t use TIFF image format and in addition, dimension of the image is greater than the display screen Nokia 2610. So, two transformations are needed: adapt dimension adapt format. Scenario 2: Multimedia client sender is Sony Ericsson K320 has to send a video to another multimedia client receiver Samsung X640. Multimedia client receiver can’t receive this video In this case, it is necessary to get image from the video sequence, convert audio to a text and changing dimension. Scenario3: multimedia client sender Siemens CX65 can’t receive video stored in mpeg format sent from Sony Ericsson K320 mobile phone. Consequently, conversion of video format transformation is needed. Scenario4: The audio stored in .wav format sent by a multimedia client sender Nokia N93i needs an audio conversion format to be received by the multimedia client receiver Samsung SGHX640 multimedia mobile phone. 5 Conclusion In this article, we have presented the state of the art concerning approaches, multimedia adaptation architecture and a comparative study for each one. We have presented architecture to provide an open system for exchange multimedia data for multimedia mobile. The architecture is based upon the Client/Intermediary/server model, where proxy is as a web services. The aim of the open system is to improve the Qos in exchanging multimedia data over heterogeneous mobile type and to integrate several type of multimedia mobile phone. Our work is in progress, so we’ll model data bases essentially descriptors and adaptation type base with UML and implementation with Java language. References 1. Gioia P., Co DiGiacomo T., Joslin C., Thalmann N., ISIS : Intelligent Services, Acts of the 1 European Conference on Visual Media Production (CVMP), London, England, 15 et 16 Marsh, 2004, p. 295-304. 2. Lemlouma T., Cécile R., Layaida N.: Negotiation and Adaptation Architecture of Multimedia Services in an Heterogeneous Environments, thesis of doctorate, GRENOBLE POLYTECHNIC NATIONAL INSTITUT , France, June 2004. 3. Kazi-Aoul Z.,Dmeure I,Moissinac J C: Architecture for providing adaptable multimedia documents in a pair to pair logic , France, 06 12 2005. 4. Hagos B., Brunie L, Pierson J: Access and adaptation multimedia content for pervasive systems, thesis of doctorate, Lyon, France, 25 September 2006. 5. M.Margaridis and G.C. Poloyzos: Adaptation Technique for Ubiquitous Internet Multimedia. Wireless Communication and Mobile Computing, John Wiley & Sons, 2001, Vol. 1, No. 2, pp.141-164. Proceedings of CAiSE-DC 2008 61 6. K. Marriott, B. Meyer, and L. Tardif: Fast and Efficient client-Side Adaptivity for SVG. ACM press, 2002: In proc. Of WWW 20002, Honolulu, Hawaii, USA, May 2002,pp. 496-507. 7. A. Singh, A. Trivedi, K. Ramamritham et al. PTC: Proxies that Transcode and Cache in Heterogeneous Web Client Environments. World Wide Web Journal, 2004 Vol.7. No. 1.DD. 7-28. 8. Hagimont D., Layaïda N: Adaptation of a multimedia application by a mobile code, France, 2002. 9. Kazi-Aoul Z., Demeure I., Moissinac J C.: A generic Architecture for providing adaptable multimedia services - illustration by a scenario, First day’s of francophone acts: Mobility and ubiquity, Nice, 1-3 June, 2004. 10. http://www.mobilemultimedia.be/fr/index.php 11. Z. Lei. : Media transcoding for pervasive computing. ACM Press, Vol. 9. In Proceedings of the ninth ACM international conference on Multimedia, 2001, Ottawa, Canada, pp. 459-460. ISBN: 1-58113-394-4. 12. Shanableh T., M. Ghanbari: Heterogeneous video transcoding to lower spatio- temporal resolutions and different encoding formats, IEEE Trans. Multimedia, June 2000, Vol. 2, pp. 101-110.