For the visually impaired it is important to learn about different kinds of spatial knowledge from non-visual maps, specifically while walking via mobile devices. In this article, we presented an augmented audio-haptic You-arehere map system based on a novel pin-matrix device. Through the proposed system, the users can acquire not only the basic geographic information and their location, but also augmented accessibility attributes of geographic features by user-contributed annotations. Furthermore, we at the first time discuss the annotation taxonomy on geographic accessibility, towards building a systemic methodology.
Apart from the geographic information, for the visually impaired they expect to know additional geographic accessibility information which is specific for them. For example, the blind prefers to know if there is a non-barrier sidewalk to the entrance of the nearby POI and where, or the types of doors (e.g., automatic or manual). However, it’s time-consuming and cost-consuming to collect those kinds of accessibility geographic data over the world by one or several organizations.
Besides, due to lack of accessible location-aware YAH maps for the visually impaired, it is hard for them to explore the surrounding environments while walking outside, despite the mainstream GPS-based navigation systems would announce where users are, e.g. the name of the street or the nearby point of interest. In this paper, in addition to acquiring basic geographic information, we focus on investigating which other kinds of information would be acquired from the location-based YAH maps for the visually impaired, such as location and augmented accessibility information. We presented a tactile You-are-here map system on a portable pin-matrix device (PMD), and proposed a collaborative approach to gather accessibility information of geographic features from users’ annotating. Furthermore, we discussed about users’ annotation taxonomy systematically from its definition to the data model. 2 2.1
The basic geographic knowledge contains the spatial layout of map elements, names
and categories of geographic features, and other map elements (e.g. scale, north
direction). Although the swell-paper based maps have great touch perception, they only
can represent a few of brief and static information, as well as related map legend in
Braille. To present much more map elements and with detailed descriptions, the
acoustic output has been employed in recent decades, from the auditory icons and
sonification to text-to-speech (TTS) synthesis, like in [
In addition to rendering basic geographic information, the location-aware maps state
users’ current position and the spatial relationship between them and the surrounding
environments. TP3 [
For people with special needs, the kind of geographic information stored in current
map database is not enough, because they have their own additional requirements. For
example, the online Wheelmap1 and Access Together2 collect the accessibility
features of POIs in cities for wheelchair users, through user-contributed annotations.
However, the visually impaired has much more special requirements than the disabled
people who are sighted. In addition to avoiding various unaware obstacles, they
expect to know accessibility information of geographic features while on the move. The
“Look-and-Listen-Map”3 is a project to prepare a free accessible geo-data for the
visually impaired, such as traffic signals with or without sound. But due to lack of an
accessible platform, the visually impaired is hard to benefit from the project currently.
As one possible benefit from those collaborative accessible geo-data, it can improve
the performance of involved applications, like a personalized route plan [
In this section, we described a tactile YAH maps on a mobile pin-matrix device. Through the proposed system, the users not only can explore maps and learn about their location context, but also can acquire knowledge on geographic accessibility in their cities by collaborative annotations. 3.1
As shown in Figure 1, the system is a typical C/S (Client/Server) based system. Its server stores map data, annotation data and user information, and responses the map client, like sending map data. The ubiquitous mobile internet enables the client to connect the server at anywhere, and to present a tactile map with current location context. Additionally, it’s convenient to read annotation on the go. The Figure 2 (left) illustrates the overview of the prototype, consisting of a portable PMD, a WiiCane, a smart phone, an earphone with a microphone and a portable computer. The WiiCane is made by mounting a Wii remote controller on the top of a normal white cane. The smart phone is mounted on one shoulder, which has involved sensors like GPS, digital compass and Bluetooth. Users can listen to related annotations by the earphone. The computer in a backpack, runs the main application, and connects all of the other devices through Bluetooth or USB interface.
Besides, we design a set of tactile map symbols and YAH symbols through raised pins, to represent the YAH maps, see Figure 2 (right). In particular, the set of YAH symbols has eight symbols which point at one direction respectively, e.g. south, southwest, etc. Therefore, the YAH symbols would present users’ location and heading orientation simultaneously on maps while walking or stopping.
While interacting with the YAH map, users can press the buttons on the WiiCane to panning or zooming. Due to the touch-sensitive feature of the PMD, users can obtain auditory descriptions by one finger contacting involved map symbols. To inquire “Where I AM”, the YAH symbol will present in the center of the display automatically. With the help of the YAH symbols, users would explore the surroundings and discover the spatial relationship between themselves and nearby geographic features, such as the orientation and distance to a bus stop or a building. Although there are a couple of systems to collect enhanced accessible geoinformation for the people with special needs via user-contributed annotation data, from the perspective of scientific research it is still lack of a comprehensive investigation of annotation taxonomy. Thus, in this section we focus on systematically discussing how to utilize collaborative annotated data to enhance accessibility of geographic features in real world, from its definition to data model and involved applications. methods, from text, audio media, videos and pictures to haptic/tactile feedback, which can help end users to learn about involved accessibility features.
Fourthly, towards a stricter range of the term of geographic feature in the definition, it contains various existing geographic referenced objects which can be digitalized and stored in digital world, rather than all of the components on the Earth. In addition, the annotations are made not only by the end users, but also from the volunteer community who concerns about accessibility. 4.2
Different to the ubiquitous annotation systems [
As illustrated in Figure 3, the visually impaired users would access the accessibility map information (e.g. bus stops, entrances) and annotations from others. Even if the 9 dimensions are described respectively, the relationship of them is correlative, and will impact each other in the practical applications.
Different to rendering color-enabled maps for the sighted through the visual channel, the 2D PMD doesn’t allow overlapping map symbols by the raising pins. Thus, it’s important to find a suitable strategy to rendering the YAH maps on a limited portable PMD. For the visually impaired the cognitive mental maps generated while reading location-aware maps on the move might be different from a desktop-based map for pre-journey. However, what are their differences exactly is not clear yet. Besides, excepting the above mentioned 9 dimensions, which dimensions else are useful for the visually impaired?
In order to let the visually impaired acquire much more spatial knowledge on the move, the paper introduces an overview proposal how to build an augmented nonvisual you-are-here maps through collaborative annotation via a portable PMD. For future work, the prototype should be evaluated with end users who are visually impaired.