=Paper=
{{Paper
|id=Vol-343/paper-5
|storemode=property
|title=Towards an Open System for Multimedia Phone Exchange: Adaptation Architecture
|pdfUrl=https://ceur-ws.org/Vol-343/paper5.pdf
|volume=Vol-343
|authors=Saighi Asma,Nacira Ghoualmi-Zine and Philipe Roose
}}
==Towards an Open System for Multimedia Phone Exchange: Adaptation Architecture==
https://ceur-ws.org/Vol-343/paper5.pdf
Towards an Open System for Multimedia Mobile Phone
Exchange: Adaptation Architecture
Saighi Asma1, Nacira Ghoualmi-Zine2, Philipe Roose 3
1
pgasma_saighi@yahoo.fr, 2 ghoualmi@yahoo.fr,
3
Philippe.Roose@iutbayonne.univ-pau.fr
1,2
Univercité Badji Mokhtar, Computer sciences departement
3
Université Pau, IUT Bayonne, Computer sciences departement
Abstract. Ubiquitous environment can include heterogeneous terminals that
haven’t the same characteristics. Exchange multimedia data using
heterogeneous terminals requires an adaptation of contents or other types of
adaptation. In this paper we present a state of the art as: related work in term of
approaches followed by a comparative study, comparative study of five existing
adaptation architectures. On the second hand we present our architecture based
on Client/Intermediary/Server model. So, we distinguish four main parts:
multimedia client sender and multimedia client receiver, server with descriptors
of environment, and proxy as a web services. This investigation aims to
conceive an open system that integrates heterogeneous mobile phones. This
open architecture aims to improve Qos between multimedia sender and
multimedia receiver. Our proposed architecture allows multimedia clients to
deliver multimedia content according to the mobile phone’s specification
receiver. As study case, we present a specification of some mobile phones:
Nokia 2610, Samsung X640, Sony Ericsson K320, Siemens CX65 and Nokia
N93i with four illustrative adaptation scenarios.
Key words: Open system, Multimedia content adaptation, proxy, mobile
phone, multimedia client
1 Introduction
Currently, a lot of different end multimedia client’s devices (mobile phones in our
case) are heterogeneous. So, hardware and software capacities are heterogeneous and some
times limited. End user devices features have different capabilities in terms of memory
size, display size, or supported formats. However, rendering multimedia content in
such an environment remains challenging, because the content itself is heterogeneous
in terms of encoding. For instance, a video can be encoded in different formats such
as 3gpp, MPEG-4, or WMV, using different encoder settings such as spatial and
54 Proceedings of CAiSE-DC 2008
temporal resolution, or bit rate. These limitations require an adaptation of contents or
other type of adaptation. Therefore, a lot of research works where proposed in
literature. Among the existing architectures, we find: ISIS [1] that follows the
client/server model; NAC [2] is based in Client/Intermediary(s)/Server model. There
are other architectures based on P2P model like PAAM [3]. DCAF [4] architecture is
based on content adaptation services developed externally to make content
transformations. The main objective of our research is to bring a solution for the
multimedia client sender to deliver any multimedia document without getting an echo
message due to the incapacity of the multimedia client receiver mobile phone to
support the sent multimedia document. In other term, our proposed architecture aims
to adapt multimedia document sent by a multimedia mobile phone before being
delivered to the multimedia mobile phone receiver. Generally, the existing adaptation
architectures treat multimedia data sent from a server machine to a client device but in
our architecture the adaptation treatment is applied to the multimedia data sent from a
multimedia client to other multimedia client and this is how our proposed architecture
advances the state of the art. This paper is organized as follow, in section two we
compare the existing adaptation multimedia approaches and we compare some
existing multimedia adaptation architectures. Section three presents the proposed
architecture, its aim and components. Section five presents studies cases using
adaptation scenarios with mobile phone types.
2 Comparative studies
We present in this section comparative study between adaptation approaches in
Table.1 and a comparative study between five existing architectures in Table. 2.
Table 1. Comparative study between the existing adaptation approaches.
Approach Decision make and Advantages Disadvantages
adaptation
Centered In the level of the +The author formulates -The provider
server [5] server advices or constrains in the integrates adaptation
adaptation. mechanisms.
+Implementation of dynamic -Calculation charge
and static adaptation in the server.
mechanisms.
Centered In the client level by +For simple problematic. -Badly adapted to
client [6] two methods: content the situations when
selection or ad hoc network constrains
transformation. are difficult.
-Not practice.
Centered In an intermediary +Put results in hide. -bad scalability
proxy [7] nod: proxy +The calculation charge is in -Security problem.
the le proxy. -adaptation tools are
+Disposes of a global view brought to evaluate.
about the environment.
Proceedings of CAiSE-DC 2008 55
Table 2. Comparative study between five existing adaptation architectures.
Architecture Goal Proxy Adaptation Profiles
managements
Adaptation Adaptation of a In the proxy site is -A video is transmitted from Not specified
architecture distributed multimedia deployed an adaptation a web site to the client.
of application by a mobile mobile agent. -The video passes by the
multimedia code proxy.
application -An adaptation agents are
by mobile deployed in the proxy and
code [8] modify the video flow.
A generic Architecture that The proxy is a service -The supervision module Profile base
Architecture antiques Simultaneously manager. detects the change.
for the service logic -The manager determines
providing adaptation using the adaptation actions.
adaptable components and the - The service manager sends
multimedia adaptation of the the downloading request of
services [9] multimedia flow. the adapted version.
Assures in Communication Proxy -ANM establishes an Profile
NAC [2] heterogeneous oriented negotiation. adaptation graph. repository
environment a - Static Adaptation.
transmission of the -Parameter of dynamic
adapted content with Adaptation.
negotiation. -DynamicAdaptation during
the execution.
Every participant must There is no proxy -To recuperate information User context
PAAM [3] be consummator, relative to the user and to manager.
provider or adaptator. the composed document.
PAAM Inspires largely -To decide the adaptation to
from [9] apply and search the
adaptators.
-To instantiate adaptation
graph.
DCAF [4] Architecture oriented -Content proxy. -Based on tierce adaptation CPR (Context
multimedia adaptation -Local proxy. services. Profile
services in a pervasive -Adaptation service -Introduce a directory of the Repository)
environment to resolve proxy. adaptation services (ASR).
the le interoperability -Assures adaptation of the
problem, the flexibility web services available
and scalability implemented apart from of
DCAF.
-Ontology was developed
for describing the adaptation
service.
56 Proceedings of CAiSE-DC 2008
3 Proposed architecture
The Architecture proposed in this paper is illustrated in the figure 1. This architecture
is based upon the Client/Intermediary/Server model. This open architecture aims to
improve the flexibility and the adaptability of service (Qos) between multimedia
sender and multimedia receiver. Our proposed architecture allows multimedia clients
to deliver multimedia content according to the mobile phone’s specification receiver.
It integrates heterogeneous mobile phones and provides an adaptation service for
them in transparent manner.
Descriptors mobile/document
Server machine Environment’s parameters
Original content Adaptation
plan generator
Proxy
Adapted content
Sender mobile phones
Receiver mobile phones
Fig. 1. Open system architecture
3.1 Components of the architecture
3.1.1 Multimedia client
There are two types of multimedia clients: multimedia client sender and multimedia
client receiver.
3.1.2 Server
The server has descriptors structured as data base. Each multimedia phone has
different characteristics (identifier, etc). The descriptor of the multimedia document
contains the original multimedia data received from the multimedia client sender. As
known, the server supports all kinds of multimedia data. Therefore, we suppose that
each sent message from the multimedia client sender will pass directly and
transparently to the server. Then, server selects from this message all environment’s
parameters: parameters of multimedia client receiver mobile phone characteristics
such as screen display, supported contents and multimedia content parameters like
format, size, image dimension etc. After collecting environment parameters, server
checks them in the descriptors. If these descriptors don’t exist, it stores them.
Proceedings of CAiSE-DC 2008 57
3.1.3 Proxy
Proxy constitutes the core of our architecture, it assists the server as a web services
with its two modules: decision module and adaptation module. Figure 2, presents the
behavior of the proxy. Because the success of the adaptation depends to the quality
and quantity of required knowledge about environment, the communication module in
the proxy receives environment’s parameters representing an adaptation request (1)
from the server. Then, communication module sends to the data base the new
environment parameters (2), if the new environment parameter exists in the data base;
this last sends the stored adaptation type according to these new environment
parameters to the decision module (4). Else the decision module in the proxy selects
adaptation type corresponding to the new environment parameters in adaptation type
data base if it exists. Else, data base will send only the new environment parameters
(5) witch represents a negative answer. In this case, decision module creates a new
adaptation type(s), sent it (them) to the data base in order to update it (6). Then,
decision module send the new environment parameters and the generated adaptation
type to the adaptation plan generator (7) to get the optimal adaptation plan already
stored (8). If the optimal adaptation plan doesn’t exist, the registry adaptation
generates these set of actions according to the given parameters. Before sending the
message to multimedia client receiver (9), adaptation module executes the optimal
adaptation plan.
(1)
Communication module
(6) (2)
(7)
Decision module
Data Base
(8) (4) OR
Adaptation module (5)
(9)
Fig. 2. Functional Schema of the Proxy
Upon receipt of the message, the server sends to the sender multimedia client’s
mobile phone a confirmation (SMS) message if the message was well received.
Otherwise, an error SMS message is sent back to the sender multimedia client’s
mobile phone.
3.1.4 Adaptation plan generator
The role of the adaptation plan generator is to generate the optimal adaptation plan of
the given environment parameter and also to stores all types of adaptation and the set
58 Proceedings of CAiSE-DC 2008
of adaptation actions of every type. The optimal adaptation generator represents the
minimum set of adaptation actions.
4 Study Case
4.1 Mobiles
Each multimedia mobile phone has a specification or a device context. For this
reason, we are not able to specify all existing multimedia mobile phones in the
market. As study case, we choose to specify dimensions, type, display size, ringtones
type, memory card slot, GPRS, HSCSD, EDGE, WLAN, Bluetooth, Infrared port,
USB, Supported image format, Supported video format, Supported audio format,
Messaging, battery etc of some multimedia mobile phones [10]. These specifications
are represented in table 3.
Table 3. Specification of four multimedia mobile phones
Technical Nokia 2610 Samsung Sony Ericsson K320 Nokia N93i Siemens CX65
characteristics SGH-X640
Dimensions 104 x 43 x 18 87.4 x 47 x 23 108 x 58 x 25 mm, 132x176
101 x 44 x 18 mm
mm mm 115 cc
Type CSTN,65K UFB,65K UBC, 65K colors TFT, 16M colors TFT,65K colors
colors colors
Display size 128 x 128 pixels 128 x 160 128 x 160 pixels, 1.8 240 x 320 pixels 162x176 pixel
pixels inches
Ringtones type Polyphonic(64 Polyphonic (40
Polyphonic (24 Polyphonic Polyphonic (40
channels), MP3 (40 channels) channels), MP3, AAC channels), MP3 channels)
Memory card No No miniSD, hot swap No
No
slot
GPRS Yes Yes Yes Class 32, 107.2/64.2 Class10
kbps (4+1/3+2 slots),
32 - 48 kbps
HSCSD No No Yes Yes (via PC dial-up) No
EDGE No No No Class 32, 296 kbps; No
DTM Class 11, 236.8
kbps
WLAN No No No Wi-Fi 802.11b/g No
Bluetooth No No Yes Yes No
Infrared port No No Yes Yes Yes
Camera to No Available Available Available Available
capture image
Supported GIF, JPEG, BMP, GIF, GIF, JPEG, WBMP, GIF, JPEG, JP2, JPG, BMP,GIF,
image format PNG, BMP JPEG, PNG, BMP, PNG, VND.WAP, PNG, SVG+WMP, PNG,JPEG,
X-NP-WPNG WBMP, CVG TIFF. SVG,+xml,
VND.wap.WB
Camera video No No Available Available Available
Supported No No Mpeg, mp4, 3gpp, 3gpp, mp4, vnd.rn- 3gpp
Proceedings of CAiSE-DC 2008 59
video format mpeg4, mp4v-es real video
Supported Midi, mid, mp3, Melody, midi Amr, rhz, midi, x-midi, 3pgg, aac, amr,amr- Midi, wav, amr
audio format x-mid, amr, sp-midi, midi melody, wb, au, basic, mid,
amr-wb, mpeg, mpeg, mpeg3, mp3,wav, midi, mobile-xinf,
x-amr 3gpp, mp4, x-wav, xmf mp3, mp4, mpeg,
rmf, sp-midi, vn
d.rm-real audio, wav,
x-amr, x-au, x-
beatnik-rmf, x-mid,
x-midi, x-pn-real
audio, x-pn-real
audio plugin, x-rmf,
x-wav
Messaging SMS,MMS, SMS, EMS, SMS, MMS, Email, SMS, MMS, Email, SMS, MMS,
Email, Instant MMS Instant Messaging Instant Messaging Email
Messaging
Browser WAP WAP WAP2.0/xHTML, WAP 2.0/xHTML, WAP
2.0/xHTML 2.0/xHTML HTML(NetFront) HTML 2.0/xHTML
Battery Standardbattery Standard Standard battery, Li-Ion Standard battery, Li- Standard, Li-
Li-Ion 970 mAh battery, Li-Ion 750 mAh (BST-36) Ion 950 mAh (BL- Ion 750 mAh
(BL-5C) 800 mAh 5F) (EBA-660)
Games 2 - Snowball Yes Yes Yes
Coin Flipping + fighter,
downloadable, Bubble smile
downloadable
Several adaptation techniques have been developed to deliver multimedia data to the
multimedia client receiver in heterogeneous environment (heterogeneous mobile
phones).Currently available techniques apply textual transformation, image
transcoding, video and audio processing. A list of content adaptation technologies that
can be applied to the basic media types: text, image, audio and video are presented in
table 4.
Table 4. Media types and content adaptation techniques [11, 12]
Category Text Image Video Audio
Transcoding -format -data size -frame rate -audio to stereo-
conversion reduction reduction mono reduction
-font size -dimension -spatial - format
reduction reduction resolution conversion
-color-depth reduction
reduction -temporal
-color-to- resolution
grayscale reduction
reduction -color-depth
-format reduction
conversion -format
conversion
Transmoding -text-to-audio Image to text -video-to-image -audio-to-text
transformation transformation transformation
-video-to-text
transformation
-video-to-audio
transformation
Summarization -text -key frame -audio highlight
summarization extraction
translation -language -language -language
translation translation translation
60 Proceedings of CAiSE-DC 2008
In general sense, content adaptation techniques can be classified as semantic
adaptation and physical adaptation. In our study, we are interested in physical
adaptation (content level adaptation) techniques as illustrated in section 4.2.
4.2 Illustrative Scenarios for proposed architecture
Scenario 1: Multimedia client sender is Nokia 93i mobile phone and has to transmit
an image to another multimedia client receiver Nokia 2610 mobile phone. The image
is stored in colored TIFF format. As specified in table 3, Nokia 2610 don’t use TIFF
image format and in addition, dimension of the image is greater than the display
screen Nokia 2610. So, two transformations are needed: adapt dimension adapt
format.
Scenario 2: Multimedia client sender is Sony Ericsson K320 has to send a video to
another multimedia client receiver Samsung X640. Multimedia client receiver can’t
receive this video In this case, it is necessary to get image from the video sequence,
convert audio to a text and changing dimension.
Scenario3: multimedia client sender Siemens CX65 can’t receive video stored in
mpeg format sent from Sony Ericsson K320 mobile phone. Consequently,
conversion of video format transformation is needed.
Scenario4: The audio stored in .wav format sent by a multimedia client sender Nokia
N93i needs an audio conversion format to be received by the multimedia client
receiver Samsung SGHX640 multimedia mobile phone.
5 Conclusion
In this article, we have presented the state of the art concerning approaches,
multimedia adaptation architecture and a comparative study for each one. We have
presented architecture to provide an open system for exchange multimedia data for
multimedia mobile. The architecture is based upon the Client/Intermediary/server
model, where proxy is as a web services. The aim of the open system is to improve
the Qos in exchanging multimedia data over heterogeneous mobile type and to
integrate several type of multimedia mobile phone. Our work is in progress, so we’ll
model data bases essentially descriptors and adaptation type base with UML and
implementation with Java language.
References
1. Gioia P., Co DiGiacomo T., Joslin C., Thalmann N., ISIS : Intelligent Services,
Acts of the 1 European Conference on Visual Media Production (CVMP),
London, England, 15 et 16 Marsh, 2004, p. 295-304.
2. Lemlouma T., Cécile R., Layaida N.: Negotiation and Adaptation Architecture of
Multimedia Services in an Heterogeneous Environments, thesis of doctorate,
GRENOBLE POLYTECHNIC NATIONAL INSTITUT , France, June 2004.
3. Kazi-Aoul Z.,Dmeure I,Moissinac J C: Architecture for providing adaptable
multimedia documents in a pair to pair logic , France, 06 12 2005.
4. Hagos B., Brunie L, Pierson J: Access and adaptation multimedia content for
pervasive systems, thesis of doctorate, Lyon, France, 25 September 2006.
5. M.Margaridis and G.C. Poloyzos: Adaptation Technique for Ubiquitous Internet
Multimedia. Wireless Communication and Mobile Computing, John Wiley &
Sons, 2001, Vol. 1, No. 2, pp.141-164.
Proceedings of CAiSE-DC 2008 61
6. K. Marriott, B. Meyer, and L. Tardif: Fast and Efficient client-Side Adaptivity for
SVG. ACM press, 2002: In proc. Of WWW 20002, Honolulu, Hawaii, USA, May
2002,pp. 496-507.
7. A. Singh, A. Trivedi, K. Ramamritham et al. PTC: Proxies that Transcode and
Cache in Heterogeneous Web Client Environments. World Wide Web Journal,
2004 Vol.7. No. 1.DD. 7-28.
8. Hagimont D., Layaïda N: Adaptation of a multimedia application by a mobile code,
France, 2002.
9. Kazi-Aoul Z., Demeure I., Moissinac J C.: A generic Architecture for providing
adaptable multimedia services - illustration by a scenario, First day’s of
francophone acts: Mobility and ubiquity, Nice, 1-3 June, 2004.
10. http://www.mobilemultimedia.be/fr/index.php
11. Z. Lei. : Media transcoding for pervasive computing. ACM Press, Vol. 9. In
Proceedings of the ninth ACM international conference on Multimedia, 2001,
Ottawa, Canada, pp. 459-460. ISBN: 1-58113-394-4.
12. Shanableh T., M. Ghanbari: Heterogeneous video transcoding to lower spatio-
temporal resolutions and different encoding formats, IEEE Trans. Multimedia,
June 2000, Vol. 2, pp. 101-110.