=Paper=
{{Paper
|id=Vol-2009/fmt-proceedings-2017-paper8
|storemode=property
|title=Innovative and Intuitive Hands-on Interaction with RFID to Enhance Digital Media Experience of Exhibits
|pdfUrl=https://ceur-ws.org/Vol-2009/fmt-proceedings-2017-paper8.pdf
|volume=Vol-2009
|authors=Sandra Schadenbauer,Robert Strohmaier,Gerhard Sprung
|dblpUrl=https://dblp.org/rec/conf/fmt/SchadenbauerSS17
}}
==Innovative and Intuitive Hands-on Interaction with RFID to Enhance Digital Media Experience of Exhibits==
https://ceur-ws.org/Vol-2009/fmt-proceedings-2017-paper8.pdf
Innovative and Intuitive Hands-on Interaction with
RFID to Enhance Digital Media Experience of
Exhibits
Sandra Schadenbauer, Alexander Nischelwitzer, Robert Strohmaier, Gerhard Sprung
Information Management
FH JOANNEUM
Graz, Austria
sandra.schadenbauer@fh-joanneum.at, alexander.nischelwitzer@fh-joanneum.at, robert.strohmaier@fh-joanneum.at,
gerhard.sprung@fh-joanneum.at
Abstract—RFID (Radio Frequency Identification System) Most of the approaches and projects, which aim to increase
technology is very popular today and is used in everyday life. the visitors’ experience by using RFID technology, provide
However, RFID hasn’t won much recognition in museums yet, additional content about an exhibit or the whole exhibition, but
especially not in the field of hands-on experience. This paper do not offer “hands-on” experience. Therefore, DMT uses
shows that RFID can be used for innovative and intuitive hands- RFID for interactive multimedia exhibits, where objects,
on interaction to enhance digital media experience of exhibits in equipped with RFID tags, are essential to use and understand
museums and presents several projects in museums, which uses the exhibit.
RFID for the exhibits’ interaction.
This paper is organized as follows: Section II introduces the
Keywords—RFID, digital media; tangible objects; invisible RFID technology and compares it to other methods of
tagging; exhibit; exhibition; museums; showrooms; hands-on identification in the context of hands-on exhibits. Section III
describes the software interface between RFID readers and
I. INTRODUCTION exhibition software. Finally, section IV gives an idea of
innovative and intuitive hands-on interaction with RFID by
The research field Digital Media Technologies (DMT) of
explaining some of our projects.
the Institute of Information Management at the University of
Applied Sciences FH JOANNEUM Graz develops multimedia
implementations for different fields of application. DMT is II. RFID
active in numerous projects with interactive multimedia
installations and stations for museums and exhibitions. A. General
RFID stands for Radio Frequency Identification System
The DMT team strives to choose the right technology for
and basically consists of a reader and several transponders (also
the right purpose. Over the years, we applied the RFID (Radio
called tags) [9]. Every RFID tag has a worldwide UID (Unique
Frequency Identification System) technology at various
ID).
multimedia projects.
RFID is contactless and uses radio frequency signals for
At the moment, museums use RFID mainly for security
communication [8]. Readers emit radio waves, which are
(protecting from theft) [1][12], artefact tracking (inventory)
received by the tags and in turn, they response with data, which
[1][2][10][12], ticketing[1] and tracking visitors’ flow [4][5] –
is read by the reader [9].
which is also a topic of our own research [13]. RFID is also
implemented for enhancing the visitors’ experience by
providing additional information in different languages about Chip
exhibits with a “personalized” museum guide
[1][5][6][7][11][13], which in some cases also collects data
during the visit, so that visitors can take a part of the Antenna
exhibitions home for the post-visit experience [1][7][11][13].
This is used for example in the travelling exhibitions “Heart
over Heals” or “Show Me the Money”, which we developed in
cooperation with the Graz Children’s Museum FRida & freD1. Fig. 1. RFID Tag2
2
Image Source: https://www.phidgets.com/SpecSensorSeries3/html/858x-
1
http://fridaundfred.at/ /25/rfid-label-phidgets-usb-sensing-and-control.jpg
58
Innovative and Intuitive Hands-on Interaction with RFID to Enhance Digital Media Experience of Exhibits
The RFID technology is very popular today and is used in
everyday life, for example:
• Cashless/wireless payment [1][8]
• Ticketing [1]
• Access control [1][8]
• Smart home controls [1]
• Medical purposes [8]
• Warehouse inventory [8]
• Sport events [8]
RFID readers and tags are available in many forms and can
be categorized by frequency (Low Frequency 9-135 KHz, High Fig. 3. Several RFID reader and antennas operating on 13.56 MHz
Frequency 13.56 MHz, Ultra High Frequency 0.3-1.2 GHz and
Microwaves 2.45-5.8 GHz), size, tag technology (Mifare, B. Differences to other technolgies like barcodes, QR codes
ICODE, etc.), interface (USB, Ethernet, Serial, Bluetooth, etc.) and fiducials
and active (transponders with own power supply) or passive
(transponders are powered by a reader’s inductive field) Barcodes, QR (Quick Response) codes and fiducials are
systems. The reading range depends on these characteristics, visual codes printed on paper or other material. They have one
and can cover a few millimeters to several meters [9]. characteristic in common, they all need a line of sight to be
identified. In many cases a conventional camera (webcam,
smartphone cam, etc.) is used to identify these optical 1D or
2D codes.
A line of sight is not necessary with RFID tags. They can
be directly built into different objects, for example in 3D
printed bones. Therefore, various tangible objects with an
invisible identification feature can be created.
Fig. 2. Variety of RFID Tags Fig. 4. 3D printed bone with RFID tag inside
The selection of the system depends on the requirements. In In contrast to RFID tags, barcodes, QR codes and fiducials
our projects, we have gained positive experience with passive are not unique; it is possible to print endless copies of them.
ICODE tags from NXP3, which operate on 13.56MHz (HF)
RFID tags can store more information than just the UID.
supporting ISO 15693 and ISO 18000-3 [14]. The reasons are
Readers are not only able to read this data, but can also save
that ICODE tags come in several dimensions and forms and
new data on a RFID tag. However, readers only know that one
can also be processed by many readers with different sizes of
or more RFID tags are near the antenna, but there is no
antennas. We develop multimedia applications that mostly run
information about the distance and so forth. Another challenge
on personal computers. The exhibition software communicates
dealing with RFID is that metal and power supply lines can
via an XML socket application with the reader, which is
interfere the signal.
connected to the USB interface of the PC. Wireless
communication would also be possible, but USB is more In contrary, fiducials additionally allow tracking the
reliable. position and the rotation of an object. The downside of this
technology is that the camera needs a stable light source to
Our RFID implementations can be classified by following
recognize the fiducials.
characteristics:
Our team uses all these technologies in different projects,
• Mobility: stationary or moving readers but the overall experience shows, that the RFID technology
• Quantity: one or more readers offers one of the most reliable identification methods.
• Range: from 2 mm to 50 cm
III. XML SOCKETS
• Usage: single user and multiuser applications We developed several XML socket applications to ensure
the communication between the exhibition software and the
3
https://www.nxp.com/ API of different RFID readers. The XML sockets deliver
59
Innovative and Intuitive Hands-on Interaction with RFID to Enhance Digital Media Experience of Exhibits
information about the reader and the identified tags with a 3) The History of Writing: For the traveling exhibition
certain XML declaration. This allows us to switch to a different “The Inventive Geniuses” we develop in cooperation with the
brand of RFID reader with no need to adapt the exhibition Graz Children’s Museum FRida & freD a book which tells
software. Furthermore, it is possible to connect multiple about the history of writing. The book’s pages are equipped
readers to a personal computer at the same time. This allows us
with RFID tags and two RFID readers are placed beneath the
to identify the position of the tags (for example near reader A
or reader B). bookshelf. With this information, the animated content of the
book is projected on the blank pages.
IV. PROJECTS
For more than 10 years, the DMT research group
implemented the RFID technology in several projects. This
section shows a selection of exhibits, which use RFID as a user
interface.
A. Projects with stationary readers
In the following exhibits, we integrated one or more fixed
readers and antennas, which cannot be displaced by the Fig. 7. “The History of Writing” with RFID tags inside the animated book
visitors. Users interact with the exhibit by moving the
transponders. In these examples, we mostly use one or more ID 4) Inventory: Children can recreate themselves with this
ISC.MR102 readers and ID ISC.ANT310/310 antennas from exhibit, which was developed in cooperation with the Graz
Feig4 which operate on 13.56 MHz (ISO15693). Children’s Museum FRida & freD for the exhibition “My
1) Paint Walls: At this exhibit, walls can be virtually Family”. RFID cards represent different body parts, clothes
painted with a selected color. Multiple RFID readers are hidden and colors.
in the paint buckets and walls, the brushes are equipped with
RFID tags. For the paint buckets, we used smaller readers and
antennas. The exhibit was developed in cooperation with the
Graz Children’s Museum FRida & freD for the travelling
exhibition “Archinature”.
Fig. 8. “Inventory” with RFID cards
5) Medical Doll: The goal of this project is to inform
visitors about different medical child diseases and their
treatments. A doll in the size of a child lies on an examining
table with a large display. The doll is equipped with RFID
Fig. 5. “Paint Walls” with RFID antennas behind the walls
antennas and responds to medical items (with build in RFID
2) Building A House: This exhibit is another development tags), like stethoscope, otoscope or magnifier. Feedback is
in cooperation with the Graz Children’s Museum FRida & freD given with a large LCD screen and also directly with a
for the travelling exhibition “Archinature”. Children get to projection on the doll itself. This exhibit was developed in
know the process of building a house by placing the required cooperation with the Graz Children’s Museum FRida & freD.
tools and machines (which are equipped with RFID tags) on a
property (with a RFID reader mounted beneath).
Fig. 6. “Building A House” with tangible objects Fig. 9. “Medical Doll” with build in RFID antennas
4
http://www.feig.de/
60
Innovative and Intuitive Hands-on Interaction with RFID to Enhance Digital Media Experience of Exhibits
6) Effective Nature Conservation: This exhibit explains in such a short time. The Graz Fairy Tale Train was realized in
various tools of nature conservation. Wodden objects, which cooperation with the Graz Children’s Museum FRida & freD.
represent the tools, are equipped with RFID tags. RFID
readers are mounted beneath the information- and the tool-
pad. Visitors not only receive information about the tools, but
they can also apply them in different scenarios. We developed
this multimedia application in cooperation with the Styrian
Nature Parks5 for the exhibtion “Nature in Human Hands”.
Fig. 12. “Graz Fairy Tale Train” (© GMB – Hannes Loske)
2) Chrismas All Around The World: Christmas is
celebrated different across the globe. RFID tags are hidden in
a globe behind every capitol city. By pointing on the city with
a pen-like RFID reader the visitors receive information about
Fig. 10. “Effective Nature Conservation” with two RFID readers the Christmas traditions in the chosen country. This exhibit is
current in development in cooperation with the cultural club
7) Boundaries of Mobility: Visitors play a board game,
“Blaues Fenster”. In this application, we can identify spots on
which is equipped with multiple RFID tags (inside the pieces)
the interactive globe within 2x2 mm2.
and readers (beneath the board). During the game, videoclips
are shown depending on the pieces’ position on the board.
Fig. 13. Christmas All Around The World (demonstrator)
3) Coin Magnifier: Visitors use magnifiers to receive
additional information about coins in the Coin Cabinet of the
Fig. 11. “Boundaries of Mobility” with multiple RFID readers
Universalmuseum Joanneum in the Eggenberg Palace in
Graz7. Magnifying glasses, which are common in coin
B. Projects with moving readers cabinets, are used to take a closer look at the coins, but they
In contrast to the projects above, in the following cases the also act as an interface with the invisible computer. RFID
RFID reader is moving, while the tags are static. antennas are built into the magnifiers and the RFID tags are
1) Graz Fairy Tale Train: While the Graz Fairy Tale6 train placed beneath the coins. Therefore, customized antennas have
is on its tracks, audio is automatically played and interactive been designed and built inside the magnifiers. This allows to
stations are switched on by default. The two locomotives are show visitors further information on the screens without an
equipped with RFID readers and RFID tags are mounted along additional interaction.
the trail. The whole timing can easily be changed by relocating
the RFID tags or adapting the configuration files. The installed
mid range readers have a antenna with the size of 30 x 30 cm
and the reading range covers about a 50 cm radius around the
antennas. The readers are mounted in a heigh of 20-30 cm
above the tags. In order to increase the accuracy of the
identification, we use 3-4 tags per station. However, if the
trains are going too fast, the tags cannot be identified by the
readers, because it is not possible to communicate with them
Fig. 14. Coin Magnifier with integrated antenna
5
http://www.naturparke-steiermark.at/
6 7
http://www.grazermaerchenbahn.at/ https://www.museum-joanneum.at/muenzkabinett
61
Innovative and Intuitive Hands-on Interaction with RFID to Enhance Digital Media Experience of Exhibits
V. CONCLUSION [6] A. Fevgas, N. Fraggogiannis, P. Tsompanopoulou, P. Bozanis, "The
iMuse Virtual Museum: towards a cultural education platform", 2014,
The presented projects show that RFID technology can be The 5th International Conference on Information, Intelligence, Systems
applied in various use cases. The users interact with objects, and Applications, Chania, 2014, 171-175
without the need to know anything about the technology [7] A. Fevgas, P. Tsompanopoulou, A. Tsiovoulos, G. Drasidis, P. Bozanis,
behind it. This allows an innovative and intuitive hands-on "Utilizing UHF RFIDs to Enhance Museum Visiting Experience", 2010
14th Panhellenic Conference on Informatics, Tripoli, 16-20
interaction to enhance digital media experience of exhibits in
museums. [8] M.A.Khan, M. Sharma, B. Prabhu, “A Survey of RFID Tags”, 2009,
International Journal of Recent Trends in Engineering, Vol 1, No. 4,
May 2009
REFERENCES [9] T. Hassan, S. Chatterjee, "A Taxonomy for RFID," 2006, Proceedings of
the 39th Annual Hawaii International Conference on System Sciences
(HICSS'06), 184b-184b.
[1] M. Patchett, A. Flack, “RFID in Museums and Galleries: A Review”,
[10] C. Xiao, N. Chen, D. Li, Y. Lv, J. Gong, “SCRMS: An RFID and Sensor
2014, http://old.react-hub.org.uk/objects-sandbox/projects/2014/
Web-Enabled Smart Cultural Relics Management System”, 2017,
curpanion/journal/rfid-in-museums-and-galleries-a-review/ (visited on
Sensors, Volume 17, Issue 1, doi:10.3390/s17010060
2017-09-14)
[11] S. Hsi, H. Fait, “RFID enhances visitors' museum experience at the
[2] Kinser, Owen, "Passive Radio Frequency Identification (RFID) and
Exploratorium”, 2005, Commun. ACM. 48. 60-65.
Museum Collections", 2016. Master's Projects,
10.1145/1081992.1082021.
http://repository.usfca.edu/capstone/463 (visited on 2017-09-14)
[12] M Buzzi, C. Senette, N. Masini, F. Soldovieri, „RFID Sensors and
[3] Wang, Hong-You & Liu, Gi-Zen & Hwang, Gwo-Jen, „Integrating
Artifact Tracking”, 2017, Sensing the Past: From artifact to historical
socio-cultural contexts and location-based systems for ubiquitous
site, Springer International Publishing, 435-451
language learning in museums: A state of the art review of 2009-2014” ,
2017. British Journal of Educational Technology. 48. 653-671. [13] R. Strohmaier, G. Sprung, A. Nischelwitzer, S. Schadenbauer. "Using
visitor-flow visualization to improve visitor experience in museums and
[4] T. Kälin, L. Müller, “Auswertung von Besucherbewegungen in Museen
exhibitions." MW2015: Museums and the Web 2015. Published January
mittels RFID”, 2009, Wireless Communication and Information, 217-
15, 2015. Consulted September 7, 2017.
230.
[5] S.H. Hashemi, J. Kamps, W. Hupperetz, “Busy versus Empty Museums: [14] NXP, “ICODE”, https://www.nxp.com/products/identification-and-
Effects of Visitors' Crowd on Users' Behaviors in Smart Museums”, security/smart-label-and-tag-ics/icode:MC_42024 (visited on 2017-09-
2017, Proceeding UMAP '17 Adjunct Publication of the 25th 14)
Conference on User Modeling, Adaptation and Personalization, 333-334
62