=Paper= {{Paper |id=Vol-260/paper-2 |storemode=property |title=Realization of u-Contents: u-Realism, u-Mobility and u-Intelligence |pdfUrl=https://ceur-ws.org/Vol-260/paper02.pdf |volume=Vol-260 |dblpUrl=https://dblp.org/rec/conf/isuvr/KimLHW07 }} ==Realization of u-Contents: u-Realism, u-Mobility and u-Intelligence== https://ceur-ws.org/Vol-260/paper02.pdf
International Symposium on Ubiquitous VR 2007                                                                                                1




                      Realization of u-Contents: u-Realism,
                         u-Mobility and u-Intelligence
                                Kiyoung Kim, Dongpyo Hong, Youngho Lee and Woontack Woo



Abstract—Recently the developments of Ubiquitous Computing                                          II.   U-CONTENTS
and Augmented Reality technologies have made many changes on
                                                                               u-Contents is a novel concept that describes realistic and
the existing applications. However, the contents used in the
applications have been not revised conceptually. Thus, an                   intelligent contents seamlessly shared in Ubiquitous Smart
expansive representation of the contents is required to adapt               Space (or Ubiquitous Computing enabled Space). It has three
resources to new computing environments, and to reflect new                 properties: u-Realism, u-Mobility, and u-Intelligence. Here, ‘u’
emerging features such as realism, mobility and intelligence. In            stands for ‘Ubiquitous Computing enabled’. If each property is
this paper, we address a noble concept: Ubiquitous Computing                represented as a set (Venn diagram), u-Contents is the
enabled Contents (u-Contents). Firstly, three key features,
                                                                            intersection of them as shown in Figure 1.
u-Realism, u-Mobility and u-Intelligence, are reviewed. Secondly,
the realization issues are explained based on the properties of                                                                         u-Contents
three key features. Lastly, u-Contents are discussed from the                        u-Realism                  u-Intelligence
viewpoint of possible applications.
   Index Terms—Ubiquitous Computing, Augmented Reality,                                                                  u-Mobility
                                                                                                  u-Contents
Ubiquitous Virtual Reality, Contents, and Mobility.

                         I. INTRODUCTION

I  n Ubiquitous Computing Environment, computing resources
   are distributed around users. The new environment enables
   users to carry out impossible tasks as they can do in Virtual
                                                                             u-Mobility     u-Intelligence
                                                                                                                                 u-Realism
                                                                                         (a)                           (b)
Reality (VR) space. Most attractive users’ ability in VR is that            Figure 1. Representation of u-Contents and its three
the contents in the space can be transformed according to users’            properties: u-Realism, u-Mobility and u-Intelligence (a)
intentions and emotions. Recently, various researches of                    Venn diagram (b) 3D Space
Augmented Reality (AR) have shown possibility to realize this
ability of VR in real environment [1]. However, the contents                y u-Realism is the property that contents are seamlessly
used in the applications have been not revised conceptually.                  registered into physical space by reflecting contexts. Contents
Thus, an expansive representation of the contents is required to              with u-Realism provide realism suitable for users’ contexts
adapt resources in new computing environments, and to reflect
                                                                              through multi-modal feedback based on users’ five senses.
new emerging features such as realism, mobility and
                                                                            y u-Mobility is the property that contents are selectively shared
intelligence.
   In this paper, we address a noble concept: Ubiquitous                      among heterogeneous or homogeneous devices. Contents
Computing enabled Contents (u-Contents). Unlike [2], the                      with u-Mobility are able to freely move themselves among
realization issues are focused. Firstly, three key features,                  devices such as large displays, PDA, and laptops.
u-Realism, u-Mobility and u-Intelligence are reviewed and                   y u-Intelligence is the property that contents respond
revised. Secondly, the realization issues are explained based on              intelligently by themselves or user’s intention, attention, and
the properties of three key features with examples. Lastly,                   emotion. Contents with u-Intelligence act as alive agents so
u-Contents is discussed from the viewpoint of possible                        that they provide more adaptive services to users.
applications.
                                                                                                 III. REALIZATION ISSUES
                                                                               In this chapter, the details of three key features in u-Contents
                                                                            are discussed with concrete examples. Since contents used in
   This research is funded by ETRI OCR and the CTI development project of   AR applications are most likely to be accepted as future
KOCCA, MCT in Korea.                                                        u-Contents, we deal the examples with AR contents.
   All are with GIST U-VR Lab., 500-712, S. Korea (e-mail: {kkim, ylee,        The main differences between conventional contents and
dhong, wwoo}@gist.ac.kr).
   Kiyoung Kim is with the Gwangju Institute of Science and Technology,
                                                                            u-Contents are caused from the contexts obtained from physical
Gwangju 500-712, S.Korea (corresponding author to provide phone:            space. Most AR applications already have used the camera
+82-62-970-2226; fax: +92-62-970-2204; e-mail: kkim@gist.ac.kr).            context, but their utilizations are limited in camera pose
International Symposium on Ubiquitous VR 2007                                                                                                     2

estimation. Various fusions can be generated to accelerate              These technologies enable contents to move freely among
existing algorithms by helps of context-awareness                       heterogeneous devices via network with predefined manners.
technologies.                                                           In addition, contents with u-Mobility can transform themselves
                                                                        or move to other devices according to user’s contexts. This
                             Camera Context        AR
                                                   AR
                                                                        property also includes the transfers among different spaces
                Contents
                Contents                         Contents
                                                 Contents               such as VR to AR. Thus, u-Mobility adaptively yields a path to
                                                                        the contents. Table 2 shows the examples where the user’s
                                  (a)                                   contexts are required.
                               User Context
                           Environment Context                                Table 2. Examples of contexts for u-Mobility
                Contents
                Contents                         u-Contents
                                                 u-Contents
                                                                        Context Source   Information             Example
                                                                                                User’s device         Levels of contents are
                                  (b)                                          User
                                                                                                specification        converted automatically.
Figure 2. u-Contents realization (a) 3D contents and images                                                           Network resources are
are converted to AR contents by applying camera contexts                                       Environmental
                                                                          Environment                             selected automatically to share
(b) u-Contents are obtained by using adequate user’s and                                         resources
                                                                                                                             contents.
environmental contexts
                                                                          C. u-Intelligence
  A. u-Realism
                                                                           The research on the intelligent contents was started with the
   The realism of contents is enhanced when all environmental           questions, ‘Which actions are regarded as proper conducts?’
contexts are mapped to parameters in a mixed space. For                 and ‘How the living subject can be imitated?’. The main
example, virtual shadows of the virtual objects as shown in             approach in u-Intelligence is to put ‘Personality’, ‘Emotion’
Figure 3 can be seen as realistic when the real light sources are       and ‘Sociality’ into contents with helps of context-awareness.
extracted from the environment correctly. In the existing AR            Figure 4 shows the low-level intelligence implemented with a
applications using only camera sensors, the generation of these         virtual robot character.
mapping is a challenging and has limitations due to a lack of
information.




                                                                                (a)                   (b)                (c)
                                                                        Figure 4. Example of a low-level intelligence: 3D running
                                                                        robot crashes with real blocks, this shows the simple
                                                                        reaction against the ‘crash’ event
            (a)                            (b)
                                                                           In u-Contents, u-Intelligence has an important role in
Figure 3. Realism enhanced by a virtual shadow: (a) flower
augmentation without a shadow (b) the augmented shadow                  generating reactions. Contents act by themselves with
based on the light source                                               self-motivations. However, the abundant sensor data is
                                                                        essential to let the contents decide their behaviors. To
   In u-Contents, from the viewpoint of the implementation, the         determine (or generate) responses, not only the user’s context,
meaningful contexts are collected from a hundred of sensors             but also the environmental context are combined and
distributed in the real space. Then, the contexts are transformed       parameterized.
to the existing parameters in AR space. Table 1 shows the
context examples and how the contexts assist in realizing                                           IV. DISCUSSION
u-Realism in the applications. Note that the five senses should            The proposed concept toward the realization of u-Contents is
be considered in the ideal cases.                                       going to be applied various AR applications. Especially,
      Table 1. Examples of contexts for u-Realism                       u-Mobility is deeply related to the design and development of
Context Source Information              Example                         the mobile AR services. And u-Realism can drastically reduce
                                          The seam can be reduced by    the computational burdens, also enhance reality in all domains.
                       Physical
    Camera                                  adding image noise to       In addition, u-Intelligence will bring the mechanism for
                     specifications
                                                    contents.           seamless interactions in AR applications.
                         Global           Realistic 3D sounds can be
      User
                        location                   generated.                                         REFERENCES
                       Air flows          Augmented virtual flags can   [1]   Y.Suh, K.Kim, J.Han, and W.Woo, "Virtual Reality in Ubiquitous
  Environment
                      Light source             flap in the wind.              Computing Environment", International Symposium on Ubiquitous VR
                                                                              (ISUVR07), pp. 000-000, 2007. (Submitted)
  B. u-Mobility                                                         [2]   SJ.Oh, W.Lee, Y.Park, and W.Woo, " u-Contents : New kinds of realistic
  The mobility of the multi-media contents has been                           contents in ubiquitous smart space”, International Symposium on
                                                                              Ubiquitous VR (ISUVR06), Vol. 191, pp. 13-16, 2006.
implemented with MPEG-I, II and transcoding technologies.