<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Measuring digital transformation at the local level: Assessing the current state of Flemish municipalities</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Lieselot Danneels</string-name>
          <email>Lieselot.Danneels@Ugent.be</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Sarah Van Impe</string-name>
          <email>sjvimpe.vanimpe@ugent.be</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Ghent University, Faculty of Economics and Business Administration, Department of Public Governance</institution>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Management</institution>
          ,
          <addr-line>9000 Ghent</addr-line>
          ,
          <country country="BE">Belgium</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>The aim of this article is to provide a way to measure digital transformation (DT) at the local government level and to provide insight into the empirical situation of Flemish local governments. At the national level, several indexes exist to measure digital government performances, but an equivalent at the local level is missing. This research adapts the Digital Government Index, with six dimensions that characterize a digital government, for use at the local level. We conducted a survey of Flemish local governments to assess the current state of their DT. This article contributes to the literature by gaining a better understanding of DT and by developing an instrument to measure DT at the local government level. The results show which dimensions are more established and emphasized than others in practice and give local governments the opportunity to measure and also benchmark themselves regarding their DT.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Research.</p>
    </sec>
    <sec id="sec-2">
      <title>1. Introduction</title>
      <p>
        The public sector faces an ever-increasing demand to provide more efficient and effective public
service delivery and to generate more public value creation. The process of digital transformation (DT)
helps to achieve those outcomes. DT goes beyond the mere alteration of existing offline processes into
a more digital format. It is about managing cultural, organizational and relational changes. This term,
adopted from the private sector, is also profoundly changing the way public administrations operate [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
      </p>
      <p>
        For national public administrations, several indexes exist to measure DT, such as the Digital
Economy and Society Index (DESI), E-Government Development Index (EGDI) and the Digital
Government Index (DGI) [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. However, these indexes cannot readily be applied at the local
government level, and an equivalent specifically designed for local governments is lacking. Local
governments also need to undergo this process of DT, but there is no instrument available helping them
to assess and measure what a digitally transformed local government looks like as opposed to other
levels of government. Additionally, there is little empirical evidence about DT in local governments
      </p>
      <p>2020 Copyright for this paper by its authors.</p>
    </sec>
    <sec id="sec-3">
      <title>2. Digital transformation in local public administrations</title>
    </sec>
    <sec id="sec-4">
      <title>2.1. Definition and characteristics of digital transformation</title>
      <p>
        Digital transformation (DT) refers to “a process that aims to improve an entity by triggering
significant changes to its properties through combinations of information, computing, communication,
and connectivity technologies”[
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. This term, which originated in the private sector, is also highly
relevant in the public administration context [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. Governments are urged to consider DT as a way to
improve public service delivery [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] and create more public value [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ].
      </p>
      <p>
        Citizens and businesses expect more efficient and effective public services. Research shows that
public administrations who engage in DT are more productive and more effective than public
administrations who do not [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. Driving a successful DT entails actively pursuing more transparency,
striving for more interoperability, aiming to obtain higher levels of citizen satisfaction and managing
new ways to interact and collaborate with stakeholders [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. DT entails a change of functioning on an
organizational, cultural and relational level [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ], [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. It goes beyond the mere digitalization of
offline government processes and focuses on a more holistic approach [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
      </p>
      <p>
        Compared to other levels of government, local governments struggle with specific issues regarding
their DT journey. Some of these challenges exist of lacking (financial) resources, the need to provide
citizens with a high variability of public services, and missing a strategic approach to tackle their DT
journey [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. On account of the specific conditions they face, measuring and assessing DT in local
public administrations is rather difficult and signifies the need for increased attention.
2.2.
      </p>
    </sec>
    <sec id="sec-5">
      <title>Measuring DT</title>
      <p>
        There is a lack of existing indexes to assess local governments regarding their DT journey.
Therefore, the purpose of this research is to provide local public administrations with an instrument to
measure and evaluate their DT. Indexes to benchmark governments in terms of DT predominantly focus
on the national level, including the DESI, the EGDI and the DGI. The DESI, issued by the European
Commission, measures and compares the digital competitiveness of European member states by means
of digital performance indicators. The DESI focuses on four fundamental dimensions of the 2030
Digital Compass policy: human capital (focus on digital skills), connectivity (matters involving
broadband), integration of digital technology (digital intensity, technology and e-commerce) and digital
public services (e-government) [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. These dimensions target "a comprehensive and sustainable digital
transformation across all sectors of the economy" [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. The EGDI, issued by the UN, on the other hand,
measures the provision of public services by means of information and communication technologies
(ICT) [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] and entails three crucial components: Online Service Index, Human Capital Index and
Telecommunication Index [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. Lastly, the DGI, issued by the OECD, discusses six dimensions of a
digital government: digital by design, data-driven, government as a platform, open by default,
userdriven and proactiveness. These six dimensions "measure the level of maturity in digital government
strategies" [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. Each of these six dimensions are divided into several indicators by which OECD
member and partner countries can verify where they stand concerning the maturity of their digital
government strategies.
      </p>
      <p>
        When analyzing the different indexes, it is crucial to underscore that there exists a substantial
difference between digitalization and DT. Digitalization primarily concerns alterations in processes that
extend beyond the mere transition from analog to digital services, and thus surpass the mere digitization
of pre-existing processes and forms. Whereas digital transformation prominently accentuates cultural,
organizational, and relational changes within organizations, exceeding the scope of digitalization [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
Certain indexes better fit this definition of digitalization, whereas others demonstrate a stronger fit with
the definition of DT.
      </p>
      <p>
        Comparing the three indexes to the definition and characteristics of DT, the DGI covers the aspects
of DT more holistically. While the focus of the DESI and the EGDI is more limited to digitalization
[
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ], the DGI is better at capturing changes at the organizational, cultural and relational level [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].
The dimensions 'government as a platform', 'open by default' and 'user-driven' capture the need for
governments to show a more open culture and collaborate with other government organizations, citizens
and businesses. The dimensions 'user-driven' and 'proactiveness' point to the importance of an agile
culture [15]. As a result, this article will build further on the DGI for measuring DT.
      </p>
      <p>
        Maturity models have been criticized in previous research. Originally, the concept of e-maturity in
public administrations merely focused on the perspective of using Information and Communication
Technologies (ICT) when delivering public services, and providing citizens with a one-stop-shop [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ].
The main point of criticism states that e-maturity models operate under the assumption of a linear
progression leading to a conclusive stage. However, every (local) public administration evolves at a
different pace regarding their e-maturity, so a refocus of this concept was needed [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. Maturity should
be approached as a concept that is relative and dynamic in nature, influenced by both contextual factors
and time [14]. As opposed to being an absolute measurement, e-maturity has to be looked at as a
continuous and ongoing process of adaptation to an always changing digital government environment
[14]. In this article, we approach the DGI as a dynamic way to measure and assess the concept of DT.
What is mature today will change, but being aware of how far you have progressed as a (local) public
administration concerning your DT journey is important to take into account, and to make further
improvements to digitally transform.
2.3.
      </p>
    </sec>
    <sec id="sec-6">
      <title>Local public administration context</title>
      <p>
        Local governments play a very important role when it comes to providing effective and qualitative
public services [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. As the level closest to the citizens, they are often considered to be the most-trusted
level of public administration [16]. Nevertheless, local governments are frequently confronted with
many complex (digital) challenges, such as assuring service continuity during the COVID-crisis and
working towards interoperability while quickly designing new services that take into account the
changing needs of citizens.
      </p>
      <p>
        There is little empirical evidence about DT in local governments [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. Research has been
conducted on the current state of digitalization in German local authorities with a particular focus on
the implementation, impact and constraints arising from digitally transforming as a local government
[
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. Other research identifies priorities and critical success factors in the DT of local governments in
Greece [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. Different driving and impeding factors that are influencing DT in different local authorities
(Italy, China, Belgium and the Netherlands) have also been examined by different scholars [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ], [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ],
[16]. In addition, other research explores the main drivers and challenges Australian local authorities
come in contact with during their DT [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. Furthermore, the little empirical evidence about DT in local
governments mainly discusses the barriers, hurdles, challenges, priorities, success factors and drivers
of DT at the local level [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ], [18].
      </p>
      <p>In sum, existing research mainly focuses on drivers and challenges associated with DT at the local
level, but it does not engage in a measurement of DT. Hence, this paper wants to help fill this gap in
academic literature and provides local governments with an instrument to assess and measure their DT
process.</p>
    </sec>
    <sec id="sec-7">
      <title>3. Methodology</title>
      <p>The goal of this research is to contribute to the literature by providing an instrument to measure DT
at the local level and to gain valuable insight into the empirical situation of Flemish local governments.
In order to empirically assess and measure the current state of their DT, and also give them the
opportunity to benchmark themselves against other local governments in Flanders, we adapted the
OECD’s DGI to the local government level and identified indicators to assess Flemish municipalities.</p>
      <p>Local governments in Belgium, as well as in other countries, are increasingly urged to embark on
their DT journey, but they mostly face the same challenges. They often struggle to obtain sufficient
(financial) resources.</p>
      <p>
        Besides that, they are the government level that offers the highest variability of public services in direct
contact with their citizens, and often lack strategic orientation when it comes to their DT [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ].
Therefore, local governments in Belgium, and the scope this research is focusing on in Flanders, form
a representative and interesting context to conduct research on. There is a wide variety in size among
Flemish local governments. There are 300 municipalities who are all digitally transforming at an uneven
pace due to this difference in size, and additionally their difference in resources.
      </p>
      <p>Based on the OECD’s DGI, one of the researchers adapted the indicators for each of the six
dimensions of a digital government into indicators suited for the local government context [19]. The
researchers first verified if the dimensions of the OECD’s DGI were also applicable at the local
government level. After this verification, the three most important indicators per dimension were
selected by one of the researchers. The researchers translated the original questions to Dutch and made
sure they were comprehendible and applicable in a Flemish local government context. The applicability
of the dimensions and indicators was also discussed with three experts with at least fifteen years of
experience in the digitalization of local public administrations (a Smart Region Coordinator at the
Provincial level, a former General Director at a Flemish municipality, and one person working at a
professional service organization to local public administrations) on their accuracy and feasibility.</p>
      <p>A survey was carried out to examine the presence of the six dimensions [19] and test the translation
of the indicators in Flemish local governments. Survey methodology is an appropriate research method
“to gather information from (a sample) of entities for the purposes of constructing quantitative
descriptors of the attributes of the larger population of which the entities are members”[20]. To
examine to what extent the six dimensions of the DGI are present in Flemish local governments, we
used a Likert scale to question the respondents about the indicators. The scale varied from ‘this does
not apply to our local government’ (1) to ‘this is an essential part of our functioning’ (5). Local
governments also had the option to indicate they ‘did not know’.</p>
      <p>The survey was conducted between the 10th of December 2021 and the 5th of January 2022 and was
addressed to 386 managing directors and assistant managing directors of local governments in Flanders.
Managing (assistant) directors have extensive knowledge of how their local governments function, and
have the organizational overview that is required for answering questions related to DT. If managing
(assistant) directors would not be familiar with every aspect of their municipality’s DT journey, that
also shows how far their DT is institutionalized. This survey was sent out to a mailing list available at
a private sector corporation who specializes in helping governments reach more efficient and innovative
software solutions on the 15th of December 2021, and they received an email reminder on the 30th of
December 2021. In addition to the emails, personalized letters were also sent out to the same target
group. To ensure that the size of the survey would remain manageable for respondents, we decided to
only select three indicators per dimension. Out of the target group of 386 managing directors and
assistant managing directors of local governments in Flanders, 172 have responded providing our
survey with a 44% response rate [21].</p>
    </sec>
    <sec id="sec-8">
      <title>4. Results and analysis</title>
      <p>Figure 1 gives an overview of the results we derived from our survey. In this section, we take a
closer look at the current state of DT in Flemish municipalities, compare the results to those of the
federal government in Belgium, and summarize the findings per dimension. In general, there were no
significant differences between municipalities with a medium size and those with a smaller size (less
than 70.000 inhabitants). Bigger cities with more than 100.000 inhabitants did score significantly higher
on all dimensions. Municipalities with less than 3 people in the ICT department scored lower, but the
differences with municipalities with IT departments of a larger size were limited.</p>
      <p>‘Digital by design’ is defined by the OECD (2020) as “the extent to which a government leverages
digital technologies to rethink and reengineer public processes, simplify or encapsulate procedures and
create new channels of communication and engagement with public stakeholders for a more efficient,
sustainable and citizen-driven public sector. A digital by design approach refers to deploying digital
technologies from the start into government’s efforts to modernize service delivery and adopt strategic
mechanisms to ensure their coherent design, implementation and monitoring, no matter the channel
services are offered.” For the context of local public administrations, we translated this into the
following three indicators: (1) our local government has a clear vision and tangible goals to achieve
digital transformation, (2) our local government features standards and guidelines when designing
digital services and (3) our local government stands for an inclusive digital transformation, and we
accompany our employees in the (further) development of digital skills. The results of our survey show
that the scores of the local governments are distributed, with only a few municipalities receiving
extremely low or extremely high scores. Remarkably, there are still a number of municipalities that do
not follow standards and guidelines when designing digital services. Some of them do not invest in
developing the digital skills of their employees. For this dimension, the scores of Flemish municipalities
largely align with those of the federal government [19], [21].</p>
      <p>‘Data-driven’ is defined by the OECD (2020) as “the extent to which a government generates public
value through the reuse of data in planning, delivering and monitoring public policies, and adopts
ethical principles for trustworthy and safe reuse of data. In a data-driven public sector, data are
understood as enablers for designing policies and services. Data-driven governments ensure that public
sector data are shared inside and/or outside the public sector in a trustworthy fashion, and under clear
protection, privacy, security rules and ethical principles for national and public interest.” For the
context of local public administrations, we translated this into the following three indicators: (1) our
local government shares and analyses data to improve our productivity and efficiency, (2) as a local
government, we train our employees to advance their data (collecting, analyzing and reporting) skills
and (3) our local government possesses an adequate information security strategy that identifies and
manages the risks of the storage and use of data. Our results show that municipalities score much lower
on ‘data-driven’ than on ‘digital by design’. Especially when it comes to sharing and analyzing data
and training their employees in these matters, the majority rates themselves as beginners. On the other
hand, a lot of municipalities do indicate that they have an information security strategy in place. The
use of data is a fundamental aspect on which many other dimensions build further, so local governments
should invest in reaching a data-driven government. Both Flemish municipalities and the federal
government score themselves rather low on ‘data-driven’ [19], [21].</p>
      <p>‘Government as a platform’ is defined by the OECD (2020) as “the extent to which a government
provides clear and transparent sources or guidelines, tools, data and software that equip teams to
deliver user-driven, consistent, integrated and cross-sectoral service delivery standards. Government
as a platform approach calls for the deployment of a wide range of platforms, standards and service
assisting teams to focus on user needs in public service design and delivery rather than on technological
solutions.” For the context of local public administrations, we translated this into the following three
indicators: (1) Our local government is connected to an intergovernmental platform called ‘My Citizen
Profile’, (2) our local government engages stakeholders (businesses, citizens, academics…) when
(co)designing new services and (3) as a local government, we actively seek expertise and support from
other external parties (public as well as private) to test our digital vision and help shape and implement
our policies. Our survey shows that the majority of local governments are connected to the
intergovernmental platform ‘My Citizen Profile’. This does not automatically mean that they
incorporate all the principles of this dimension in their functioning. For instance, establishing
sustainable partnerships remains a challenge. In general, the scores of Flemish municipalities on this
dimension largely align with those of the federal government [19], [21]. However, it is necessary to
highlight that the definition of this dimension, along with the first indicator concerning the
intergovernmental platform, should be critically reviewed. Local governments do not have the resources
to build platforms themselves, so the authors chose to focus on the use of digital platforms developed
by other government levels. The choice of the use of one such digital platform which is extremely well
used by municipalities, ‘My Citizen Profile’, gives an overestimation regarding their platform
capability.</p>
      <p>‘Open by default’ is defined by the OECD (2020) as “the extent to which a government unites
technology and data within the limits of available legislation and in balance with public interest. An
open by default approach describes the extent to which data, information, systems and processes are
open unless there is a compelling reason for them not to be, helping build bridges between all actors
in order to collect insights towards a more knowledge-based public sector.” For the context of local
public administrations, we translated this into the following three indicators: (1) our local government
has a strategy for open data, (2) our local government has a policy that considers data, information and
processes to be open by default and (3) we use standards for the publication of open data (e.g., OSLO
standards). This dimension is underexplored by 30% of the Flemish local governments. Depending on
which of the three indicators we consulted, 10-20% of our target group did not even know whether this
is being targeted at all in their organization. Concerning ‘open by default’, we notice a difference
between how Flemish local governments scored themselves as opposed to the federal government [19],
[21].</p>
      <p>‘User-driven’ is defined by the OECD (2020) as “the extent to which a government becomes more
user-driven by awarding to people a central role thus placing their needs at the core of the shaping of
processes, services and policies; and the right inclusive mechanisms for this to happen are adopted.
Through engagement and collaborative mechanisms, policy processes, their outputs and outcomes are
not just informed but shaped by the decisions, preferences and needs of citizens.” For the context of
local public administrations, we translated this into the following three indicators: (1) as a local
government, we are inclusive, responsible and transparent when developing a strategy or policy, (2)
when our local government develops new digital services, we have guidelines and tools to engage end
users from the early stages on, and (3) our local government measures user satisfaction of digital
services we provide and uses it to further optimize services. The three indicators associated with this
dimension measure an increasing degree of maturity. This explains why more municipalities invest in
being inclusive, responsible and transparent when developing strategies and policies, and why they
invest less in measuring user satisfaction to optimize services. Both Flemish municipalities and the
federal government score themselves rather low on the dimension ‘user-driven’ [19], [21].</p>
      <p>‘Proactiveness’ is defined by the OECD (2020) as “the extent to which a government has the ability
to anticipate people’s needs and to rapidly respond to them so they do not even notice that services are
delivered.” For the context of local public administrations, we translated this into the following three
indicators: (1) our local government informs citizens about the possibility of contributing to the
development of new digital services, e.g. via the newsletter or (social) media, (2) as a local government,
we provide training courses for our employees on the use of digital tools to engage the public (such as
social media, website design, data analytics, data mining, open data), and (3) as a local government, we
apply the ‘once only principle’ (citizens are only asked once to provide the same data). The results
regarding this dimension show that only a minority of Flemish local governments indicate
‘proactiveness’ as an essential part of their functioning. For this dimension, we also notice that the
scores of Flemish municipalities largely align with those of the federal government [19], [21].</p>
      <p>
        This article contributes to both the literature and practice. It contributes to the literature by gaining
a better understanding of DT at the local government level. Whereas existing literature is mostly focused
on the hurdles, challenges, priorities, success factors, drivers, impact, implementation and constraints
of DT [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ], [18], this article developed an instrument to assess and measure DT at the local
level, and helps to fill the associated research gap. In addition, it also contributes to practice in different
ways. This article gives a first overview of the current state of DT in Flemish municipalities, and shows
which dimensions of a digital government are more established than others, and which are most
emphasized in practice. Our results display that there is still a lot of room for improvement with regards
to the digital government dimensions ‘data-driven’, ‘openness’, ‘proactiveness’ and ‘user-driven’. In
addition, we also compared our results to previously conducted research regarding digitalization at the
Flemish local government level [22]. Our results show that, many years later, the same obstacles remain.
Although public service provision has definitely improved since then, we recommend to give additional
attention to the use of data in policy and service delivery. Also working together in ecosystems still
requires a considerable effort. Flemish local governments should take these recommendations into
account since they help shape the foundation of the most successful DT projects [16], [21].
      </p>
      <p>Further research can build on this first attempt to develop an instrument to measure DT at the local
level. Factor analysis showed a lot of consistency between all the indicators, and did not confirm the
underlying structure of six dimensions as fundamentally different concepts. This indicates that more
research is needed to develop a rigorous instrument for measuring DT at the local government level.</p>
    </sec>
    <sec id="sec-9">
      <title>5. Conclusion</title>
      <p>This research developed an instrument for Flemish local governments to assess and measure the
current state of their DT. The results presented in this study were derived from a survey the authors
conducted questioning managing directors and assistant managing directors of Flemish local
governments. It shows which dimensions of a digital government are more established than others, and
which are most emphasized in practice. Although most Flemish municipalities already engage in these
different dimensions, we found that there is still a lot of potential for Flemish local governments to
boost their digital maturity and advance in their DT journey.</p>
      <p>This research is however not without limitations. Context is important, and there will be different
bottlenecks between sizes of local public administrations. This research provides a general overview of
what the current state of DT is in Flemish local governments and provides an initial impetus that helps
to measure and evaluate local public administrations regarding their DT. The choice for a limited
number of indicators was to maximize the response rate, and to give a more complete view of the
Flemish local government landscape, but additional research is necessary. We encourage other
researchers to expand these indicators and to develop a more comprehensive insight into the DT of local
public administrations.</p>
    </sec>
    <sec id="sec-10">
      <title>6. References</title>
      <p>[14] K. N. Andersen, J. Lee, T. Mettler, and M. J. Moon, Ten Misunderstandings about Maturity
Models. In The 21st Annual International Conference on Digital Government Research (dg.o ’20),
June 15–19, 2020, Seoul, Republic of Korea. ACM, New York, NY, USA, 6 pages.
https://doi.org/10.1145/3396956.3396980
[15] I. Mergel, S. Ganapati &amp; A. B. Whitford, Agile: A New Way of Governing. Public Administration</p>
      <p>Review, Vol. 81, Iss. 1, 2020, pp. 161–165.
[16] J. Lindman, M. Lindquis, S. Mahula &amp; L. Norström, Digital transformation in local government
organisations: empirical evidence from blockchain initiatives. In DG.O 2022: The 23rd Annual
International Conference on Digital Government Research (dg.o 2022), June 15–17, 2022, Virtual
Event, Republic of Korea. ACM, New York, NY, USA, 10 pages.
https://doi.org/10.1145/3543434.3543474.
[17] L. Tangi et al., Digital government transformation: A structural equation modelling analysis of
driving and impeding factors. International Journal of Information Management. 60, (Oct. 2021).</p>
      <p>DOI:https://doi.org/10.1016/J.IJINFOMGT. 2021.102356.
[18] S. Kuhlmann, &amp; J. Bogumil, The digitalization of local public services: evidence from the German
case. In J. Franzke, S. Kuhlmann, T. Bergström, &amp; E. Wayenberg (Eds.), The future of local
selfgovernment. Challenges for local democracy and administration (pp. 101–114), 2021, Palgrave
Macmillan.
[19] European Commission, Digital Economy and Society Index: Methodological Note, 2022,
https://digital-strategy.ec.europa.eu/en/policies/desi.
[20] R. M., Groves et al., Survey Methodology. (2nd edition), 2011, John Wiley &amp; Sons, Inc.,</p>
      <p>Hoboken, New Jersey.
[21] L. Danneels, Digitale transformatie in lokale besturen: zes belangrijke dimensies in theorie en
praktijk. In Impuls (Brugge), 2022, (pp. 6-14).
[22] VVSG, I-monitor 2016. Digitale maturiteit van de gemeenten en OCMW's in Vlaanderen, 2016,
https://publicaties.vlaanderen.be/view-file/19890.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>I.</given-names>
            <surname>Mergel</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N. Edelmann &amp; N.</given-names>
            <surname>Haug</surname>
          </string-name>
          , Defining Digital Transformation:
          <article-title>Results from Expert Interviews</article-title>
          .
          <source>Government Information Quarterly</source>
          (
          <volume>36</volume>
          , 4),
          <year>2019</year>
          , p.
          <fpage>101385</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>A.</given-names>
            <surname>Bousdekis</surname>
          </string-name>
          &amp;
          <string-name>
            <surname>D. Kardaras</surname>
          </string-name>
          ,
          <article-title>Digital transformation of local government: A case study from Greece</article-title>
          .
          <source>In Proceedings of the 2020 IEEE 22nd Conference on Business Informatics</source>
          , Antwerp, Belgium,
          <fpage>22</fpage>
          -
          <lpage>24</lpage>
          June 2020; Volume
          <volume>2</volume>
          , pp.
          <fpage>131</fpage>
          -
          <lpage>140</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>European</given-names>
            <surname>Commission</surname>
          </string-name>
          ,
          <source>Digital Economy and Society Index: Thematic Chapters</source>
          ,
          <year>2022</year>
          , https://digital-strategy.ec.europa.eu/en/policies/desi.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>B.</given-names>
            <surname>Ubaldi</surname>
          </string-name>
          &amp;
          <string-name>
            <surname>T. Okubo</surname>
          </string-name>
          ,
          <article-title>"OECD Digital Government Index (DGI): Methodology and 2019 results"</article-title>
          ,
          <source>OECD Working Papers on Public Governance, No. 41</source>
          ,
          <string-name>
            <given-names>OECD</given-names>
            <surname>Publishing</surname>
          </string-name>
          , Paris,
          <year>2020</year>
          , https://doi.org/10.1787/b00142a4-en.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>S.</given-names>
            <surname>Kuhlmann &amp; M. Heuberger</surname>
          </string-name>
          ,
          <article-title>Digital transformation going local: implementation, impacts and constraints from a German perspective</article-title>
          .
          <source>Public Money &amp; Management</source>
          ,
          <year>2021</year>
          , DOI: 10.1080/09540962.
          <year>2021</year>
          .1939584
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>M.</given-names>
            <surname>Danial</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Evans</surname>
          </string-name>
          &amp;
          <string-name>
            <surname>D. Velasquez</surname>
          </string-name>
          ,
          <article-title>Digital Transformation in Australian Local Government: A Systematic Literature Review</article-title>
          .
          <source>Association for Information Systems 2022 proceedings, 41</source>
          , June,
          <year>2022</year>
          . https://aisel.aisnet.org/acis2022/41.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>G.</given-names>
            <surname>Vial</surname>
          </string-name>
          ,
          <article-title>Understanding digital transformation: A review and a research agenda</article-title>
          .
          <source>The Journal of Strategic Information Systems</source>
          .
          <volume>28</volume>
          ,
          <issue>2</issue>
          (Jun.
          <year>2019</year>
          ),
          <fpage>118</fpage>
          -
          <lpage>144</lpage>
          . DOI: https://doi.org/10.1016/J.JSIS.
          <year>2019</year>
          .
          <volume>01</volume>
          .003.
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>J.</given-names>
            <surname>Xiao</surname>
          </string-name>
          , L. Han &amp; H. Zhang,
          <article-title>Exploring Driving Factors of Digital Transformation among Local Governments: Foundations for Smart City Construction in China</article-title>
          . Sustainability, (
          <volume>14</volume>
          ),
          <year>2022</year>
          ,
          <volume>14980</volume>
          . https://doi.org/10.3390/ su142214980.
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>A. R.</given-names>
            <surname>Montazemi</surname>
          </string-name>
          &amp;
          <string-name>
            <surname>J. J. Pittaway</surname>
          </string-name>
          , Know-How to Lead
          <source>Digital Transformation: The Case of Local Governments. Government information quarterly (37, 4)</source>
          ,
          <year>2020</year>
          p.
          <fpage>101474</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>L.</given-names>
            <surname>Danneels</surname>
          </string-name>
          &amp; S. Viaene,
          <article-title>Simple rules strategy to transform government: An ADR approach</article-title>
          .
          <source>Government Information Quarterly</source>
          ,
          <volume>32</volume>
          (
          <issue>4</issue>
          ),
          <year>2015</year>
          ,
          <fpage>516</fpage>
          -
          <lpage>525</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>L.</given-names>
            <surname>Danneels</surname>
          </string-name>
          &amp; S. Viaene, Identifying Digital Transformation Paradoxes:
          <string-name>
            <given-names>A Design</given-names>
            <surname>Perspective</surname>
          </string-name>
          .
          <source>Business &amp; Information Systems Engineering</source>
          ,
          <year>2022</year>
          ,
          <fpage>1</fpage>
          -
          <lpage>18</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>United</given-names>
            <surname>Nations</surname>
          </string-name>
          ,
          <string-name>
            <surname>E-Government Development Index (EGDI). UN E-Government</surname>
            <given-names>Knowledgebase</given-names>
          </string-name>
          ,
          <year>2023</year>
          , https://publicadministration.un.org/egovkb/en-us/About/Overview/-E-GovernmentDevelopment-Index.
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>L.</given-names>
            <surname>Tangi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Gaeta</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Benedetti</surname>
          </string-name>
          ,
          <string-name>
            <surname>L. Gastaldi &amp; G.</surname>
          </string-name>
          <article-title>Noci, Assessing the effect of organisational factors and ICT expenditures on e-maturity: empirical results in Italian municipalities</article-title>
          ,
          <source>Local Government Studies</source>
          ,
          <year>2022</year>
          , DOI: 10.1080/03003930.
          <year>2022</year>
          .2078807
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>