<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>February</journal-title>
      </journal-title-group>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>Communication with Ambient Light using Digital Micromirror Devices</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Roy Blokker</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Talia Xu</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Marco A. Zúñiga Zamalloa</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Visible Light Communication, Passive Communication, Digital Mi-</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Delft University of Technology</institution>
          ,
          <addr-line>Delft</addr-line>
          ,
          <country country="NL">Netherlands</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>cromirror Device</institution>
          ,
          <addr-line>DMD</addr-line>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2021</year>
      </pub-date>
      <volume>17</volume>
      <issue>2021</issue>
      <abstract>
        <p>CCS CONCEPTS</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Passive visible light communication (VLC) takes advantage of the
pervasive nature of ambient light in our environment for wireless
transmissions. The design of transmitters in passive VLC
predominately uses liquid crystal displays (LCDs). While LCDs are an
economical choice with low power consumption, they lack some
key properties that are desirable for passive VLC. For example,
LCDs absorb more than half of the incident light, leaving only a
small portion to be used for communication. In addition, since the
direction of ambient can change over time, the relative positions of
the LCDs and receivers have to be changed constantly to maintain
the correct alignment.</p>
      <p>To overcome these shortcomings, we propose the use of a novel
transmitter with integrated optical fibres and digital micro-mirror
devices (DMDs). DMDs are able to reflect up to 97% of the incident
light, while the accompanying optical fibres aim to capture ambient
light from various angles and guide them to the DMDs in a fixed
direction. This design is a first step towards the goal of decoupling
the direction of ambient light from the direction of the optical link,
while achieving the same communication characteristics as LCDs
with a much smaller device. We also design an App to allow users
Copyright 2021 for this paper by its authors. Use permitted under Creative Commons
License Attribution 4.0 International (CC BY 4.0).
to easily interact with the system and our evaluation shows that
the link can achieve a data rate of 1bps at a distance of 30cm.
• Hardware → Wireless devices; • Computer systems
organization → Embedded systems.
Visible Light Communication (VLC) is an emerging technology
for wireless communication that has gained traction from both
academia and industry in recent years. Compared to traditional
radio frequency wireless communication, VLC has several
advantages such as an unregulated wide bandwidth and high security.
VLC can be further divided into two main areas: active and passive.
In both areas, the intensity of the light is modulated at a speed that
is invisible to the human eye, but can be received and decoded by
optical receivers. In active VLC, the driver circuitry is modified
to modulate message signals by varying the driving currents of
an LED. In passive VLC, an external surface is used to modulate
message signals by changing the characteristics of the light passing
through or reflecting from the surface. Compared to active VLC,
passive VLC has the advantage of exploiting the ambient light in
our environment, without having the need to directly control the
light source.</p>
      <p>
        The majority of passive VLC systems proposed in the literature
rely on the use of liquid crystal displays (LCDs) to modulate light
[
        <xref ref-type="bibr" rid="ref2">2</xref>
        ][
        <xref ref-type="bibr" rid="ref6">6</xref>
        ][
        <xref ref-type="bibr" rid="ref7">7</xref>
        ][
        <xref ref-type="bibr" rid="ref8">8</xref>
        ][
        <xref ref-type="bibr" rid="ref9">9</xref>
        ][
        <xref ref-type="bibr" rid="ref10">10</xref>
        ], as shown in Figure 2. A LCD modulates the
incoming light on its surface with two states: in the opaque state,
the LCD surface absorbs the incident light (logic zero), and in the
clear state, the LCD surface allows the incident light to pass through
(logic one). However, as LCDs are only able to realize these two
states in combination with polarizers, less than half of the incident
light can typically pass through the surface in the clear state due
to polarization mismatch. One device that is able to overcome this
disadvantage is the digital micromirror device (DMD). A DMD is
a small chip containing thousands of small mirrors with the size
of less than 10 microns. DMDs are widely used in video projection
technology (beamers), where every mirror represents a pixel. The
mirrors can be switched to two fixed angles with respect to the
surface normal, allowing two binary states to be sent by reflecting
light (or not) towards the intended receiver.
      </p>
      <p>
        In our work, we are trying to implement a communication link
between a DMD and a smartphone. Smartphones have been used
before as VLC receivers but mainly using active lights sources as
transmitters (LEDs) [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ][
        <xref ref-type="bibr" rid="ref3">3</xref>
        ][
        <xref ref-type="bibr" rid="ref4">4</xref>
        ][
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. In our design, the DMD reflects
the modulated ambient light towards the camera of a smartphone,
which is then decoded by an App and displayed on the screen.
2
      </p>
    </sec>
    <sec id="sec-2">
      <title>OPTICAL AND MECHANICAL STRUCTURE</title>
      <p>As the reflection of a DMD is primarily specular, the light source
and the receiver have to be precisely aligned to establish an
operational link. When sunlight is used as the light source in passive VLC,
as the position of the sun changes in the sky throughout the day,
its direction with respect to the DMD also changes. This causes the
reflected light to be misaligned to the receiver, as shown in Figure 4,
where the signal-to-noise ratio (SNR) can significantly deteriorate.
To overcome this problem, we propose the integration of optical
ifbers and lenses into a passive VLC system, as shown in Figure 5.
The sunlight is "collected" using a convex plano lens connected to
multiple optical fibers. In this manner, the collected light is guided
through the optical fibers and emitted directly onto the DMD. This
allows the incident angle of the light on the DMD to remain the
same regardless of the location of the sun. The design is shown in
Figure 6, and the other end of the optical fibers, illuminating the
DMD at a fixed angle, is shown in Figure 7.</p>
    </sec>
    <sec id="sec-3">
      <title>TRANSMITTER</title>
      <p>For a proof of concept design, we choose the DLP2000 DMD from
Texas Instrument. The DLP2000 DMD has an aperture size of
4.84mm by 3.26mm, as shown in figure Figure 8. In our design,
all pixels of the DMD have the same state, and the entire DMD
device acts as a single pixel with on and of states. A simple pulse
width modulation (PWM) was chosen to transmit the data. When a
logic one is sent, the light is reflected into the receiver for a certain
time period and then not reflected for the same amount of time.
When a logic zero is sent, the time that the light is not reflected
into the receiver is doubled. This modulation scheme allows ones
and zeros to be easily distinguish, in the expense of unequal
transmit times for diferent symbols. To demonstrate our design, ASCII
texts are sent over the optical link. The non-extended ASCII table
contains characters that are all 8-bit long and start with a zero.
Because there isn’t a character of all ones a preamble is chosen
containing eight ones and then a zero. Note that using mostly ones
in the preamble is faster because zeros require more transmission
time. The preamble is sent multiple times to make sure the receiver
will be able to see it. After the preambles, the ASCII characters are
sent. There is no limit to the number of characters that can be sent.
The format of the data frame is shown in Figure 9.
Images from the smartphone camera are captured and processed
using an Android App. After selecting a region of interest, every
captured frame is sent to an image processing pipeline, as shown
in Figure 10. The region of interest makes the processing easier,
as only a small part of the captured image needs to be used. An
OpenCV tracker is used to track the DMD, so when the user moves
the hand a little, the region of interest will still be on the DMD chip.</p>
      <p>To describe the decoding process, let us denote R as the region of
interest at time  (i.e. frame ). We calculate the average pixel value
of each region of interest , denoted as Rc . During the preamble
transmission, when the DMD is "on", the DMD will be reflecting
light and the average reaches its maximum value Rˆ . When the
DMD is "of", we obtain the lowest average value Rˆ . Later, when
ˆ ˆ ˆ ˆ
the ASCII characters are transmitted, if |R − R | &lt; |R − R |,
the DMD is decoded as "on", else as "of". Every time the state of
the DMD changes, from "on" to "of" or vice-versa, we calculate
the number of frames that the DMD spent in that state. If the "on"
state has approximately the same length as the subsequent "of"
state, a one is decoded, otherwise it is a zero. As soon as the bits are
decoded, they are converted back to ASCII characters and displayed
on the screen.
5</p>
    </sec>
    <sec id="sec-4">
      <title>EVALUATION</title>
      <p>Currently a bit rate of 1bps can be achieved. One of the main
reasons for the low bit rate is the tracker used in the app. There is
significant room for improvement. For example, putting the tracker
in a diferent thread, so the rest of the program doesn’t have to wait
for the tracker to finish. A communication distance of up to 30cm is
possible with our prototype. There are also some opportunities to
increase the range. The image recognition step can be improved to
look for smaller regions of interest. If we can capture only the DMD,
the noise introduced by the surrounding areas will be eliminated
and the range could increase significantly. At the moment the region
of interest is set to a fixed size.
6</p>
    </sec>
    <sec id="sec-5">
      <title>ACKNOWLEDGEMENTS</title>
      <p>This work has been funded in part by the European Union’s
Horizon 2020 research and innovation programme under the Marie
Skłodowska Curie grant agreement ENLIGHTEM No. 814215; and
by the LuxSenz project, a TOP-Grant, Module 1, Physical Sciences
with project number 612.001.854, which is financed by the Dutch
Research Council (NWO).</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>Karan</given-names>
            <surname>Ahuja</surname>
          </string-name>
          , Sujeath Pareddy, Robert Xiao, Mayank Goel, and
          <string-name>
            <given-names>Chris</given-names>
            <surname>Harrison</surname>
          </string-name>
          .
          <year>2019</year>
          .
          <article-title>LightAnchors: Appropriating Point Lights for Spatially-Anchored Augmented Reality Interfaces</article-title>
          .
          <source>In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans</source>
          , LA, USA) (
          <source>UIST '19)</source>
          .
          <article-title>Association for Computing Machinery</article-title>
          , New York, NY, USA,
          <fpage>189</fpage>
          -
          <lpage>196</lpage>
          . https://doi.org/10.1145/3332165.3347884
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>Rens</given-names>
            <surname>Bloom</surname>
          </string-name>
          , Marco Zúñiga Zamalloa, and
          <string-name>
            <given-names>Chaitra</given-names>
            <surname>Pai</surname>
          </string-name>
          .
          <year>2019</year>
          .
          <article-title>LuxLink: Creating a Wireless Link from Ambient Light</article-title>
          .
          <source>In Proceedings of the 17th Conference on Embedded Networked Sensor Systems</source>
          (New York, New York) (SenSys '19).
          <article-title>Association for Computing Machinery</article-title>
          , New York, NY, USA,
          <fpage>166</fpage>
          -
          <lpage>178</lpage>
          . https://doi.org/10.1145/3356250.3360021
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>R.</given-names>
            <surname>Boubezari</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Le Minh</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Z.</given-names>
            <surname>Ghassemlooy</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Bouridane</surname>
          </string-name>
          .
          <year>2016</year>
          .
          <article-title>Smartphone Camera Based Visible Light Communication</article-title>
          .
          <source>Journal of Lightwave Technology</source>
          <volume>34</volume>
          ,
          <issue>17</issue>
          (
          <year>2016</year>
          ),
          <fpage>4121</fpage>
          -
          <lpage>4127</lpage>
          . https://doi.org/10.1109/JLT.
          <year>2016</year>
          .2590880
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>Rupam</given-names>
            <surname>Kundu</surname>
          </string-name>
          , Gopi Krishna Tummala, and
          <string-name>
            <given-names>Prasun</given-names>
            <surname>Sinha</surname>
          </string-name>
          .
          <year>2017</year>
          .
          <article-title>Visualloc: Vision Based Localization Using a Single Smart-Bulb</article-title>
          .
          <source>In Proceedings of the 4th ACM International Conference on Systems for Energy-Eficient Built Environments (Delft</source>
          , Netherlands) (
          <source>BuildSys '17)</source>
          .
          <article-title>Association for Computing Machinery</article-title>
          , New York, NY, USA, Article
          <volume>38</volume>
          , 2 pages. https://doi.org/10.1145/3137133.3141435
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <surname>Ye-Sheng</surname>
            <given-names>Kuo</given-names>
          </string-name>
          , Pat Pannuto,
          <string-name>
            <surname>Ko-Jen Hsiao</surname>
            , and
            <given-names>Prabal</given-names>
          </string-name>
          <string-name>
            <surname>Dutta</surname>
          </string-name>
          .
          <year>2014</year>
          .
          <article-title>Luxapose: Indoor Positioning with Mobile Phones and Visible Light</article-title>
          .
          <source>In Proceedings of the 20th Annual International Conference on Mobile Computing and Networking (Maui</source>
          , Hawaii, USA) (
          <source>MobiCom '14)</source>
          .
          <article-title>Association for Computing Machinery</article-title>
          , New York, NY, USA,
          <fpage>447</fpage>
          -
          <lpage>458</lpage>
          . https://doi.org/10.1145/2639108.2639109
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>Jiangtao</given-names>
            <surname>Li</surname>
          </string-name>
          , Angli Liu, Guobin Shen,
          <string-name>
            <given-names>Liqun</given-names>
            <surname>Li</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Chao</given-names>
            <surname>Sun</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Feng</given-names>
            <surname>Zhao</surname>
          </string-name>
          .
          <year>2015</year>
          .
          <article-title>Retro-VLC: Enabling Battery-Free Duplex Visible Light Communication for Mobile and IoT Applications</article-title>
          .
          <source>In Proceedings of the 16th International Workshop on Mobile Computing Systems and Applications</source>
          (Santa Fe, New Mexico, USA) (
          <source>HotMobile '15)</source>
          .
          <article-title>Association for Computing Machinery</article-title>
          , New York, NY, USA,
          <fpage>21</fpage>
          -
          <lpage>26</lpage>
          . https://doi.org/10.1145/2699343.2699354
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>Purui</given-names>
            <surname>Wang</surname>
          </string-name>
          , Lilei Feng, Guojun Chen, Chenren Xu, Yue Wu, Kenuo Xu,
          <string-name>
            <given-names>Guobin</given-names>
            <surname>Shen</surname>
          </string-name>
          , Kuntai Du, Gang Huang, and Xuanzhe Liu.
          <year>2020</year>
          .
          <article-title>Renovating Road Signs for Infrastructure-to-Vehicle Networking: A Visible Light Backscatter Communication and Networking Approach</article-title>
          .
          <source>In Proceedings of the 26th Annual International Conference on Mobile Computing and Networking</source>
          (London, United Kingdom)
          <article-title>(MobiCom '20). Association for Computing Machinery</article-title>
          , New York, NY, USA, Article
          <volume>6</volume>
          , 13 pages. https://doi.org/10.1145/3372224.3380883
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>Yue</given-names>
            <surname>Wu</surname>
          </string-name>
          , Purui Wang, Kenuo Xu,
          <string-name>
            <given-names>Lilei</given-names>
            <surname>Feng</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Chenren</given-names>
            <surname>Xu</surname>
          </string-name>
          .
          <year>2020</year>
          .
          <article-title>Turboboosting Visible Light Backscatter Communication</article-title>
          .
          <source>In Proceedings of the Annual Conference of the ACM Special Interest Group on Data Communication on the Applications</source>
          , Technologies, Architectures, and
          <article-title>Protocols for Computer Communication (Virtual Event, USA) (SIGCOMM '20). Association for Computing Machinery</article-title>
          , New York, NY, USA,
          <fpage>186</fpage>
          -
          <lpage>197</lpage>
          . https://doi.org/10.1145/3387514.3406229
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <surname>Xieyang</surname>
            <given-names>Xu</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Yang</surname>
            <given-names>Shen</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Junrui</surname>
            <given-names>Yang</given-names>
          </string-name>
          , Chenren Xu,
          <string-name>
            <given-names>Guobin</given-names>
            <surname>Shen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Guojun</given-names>
            <surname>Chen</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Yunzhe</given-names>
            <surname>Ni</surname>
          </string-name>
          .
          <year>2017</year>
          .
          <article-title>PassiveVLC: Enabling Practical Visible Light Backscatter Communication for Battery-Free IoT Applications</article-title>
          .
          <source>In Proceedings of the 23rd Annual International Conference on Mobile Computing and Networking (Snowbird</source>
          , Utah, USA) (
          <source>MobiCom '17)</source>
          .
          <article-title>Association for Computing Machinery</article-title>
          , New York, NY, USA,
          <fpage>180</fpage>
          -
          <lpage>192</lpage>
          . https://doi.org/10.1145/3117811.3117843
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <surname>Zhice</surname>
            <given-names>Yang</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zeyu</surname>
            <given-names>Wang</given-names>
          </string-name>
          , Jiansong Zhang, Chenyu Huang,
          <string-name>
            <given-names>and Qian</given-names>
            <surname>Zhang</surname>
          </string-name>
          .
          <year>2015</year>
          .
          <article-title>Wearables Can Aford: Light-Weight Indoor Positioning with Visible Light</article-title>
          .
          <source>In Proceedings of the 13th Annual International Conference on Mobile Systems</source>
          , Applications, and
          <string-name>
            <surname>Services</surname>
          </string-name>
          (Florence, Italy) (
          <source>MobiSys '15)</source>
          .
          <article-title>Association for Computing Machinery</article-title>
          , New York, NY, USA,
          <fpage>317</fpage>
          -
          <lpage>330</lpage>
          . https://doi.org/10.1145/2742647.2742648
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>