<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Structural Characteristics in Historical Networks Reveal Changes in Political Culture: An Example From Northern Song China (960-1127 C.E.)</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Wenyi Shang</string-name>
          <email>wenyis3@illinois.edu</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Song Chen</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Yuqi Chen</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Jana Diesner</string-name>
          <email>jdiesner@illinois.ed</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Department of East Asian Studies, Bucknell University</institution>
          ,
          <country country="US">USA</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Department of History, Peking University</institution>
          ,
          <country country="CN">China</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>School of Information Sciences, University of Illinois Urbana-Champaign</institution>
          ,
          <country country="US">USA</country>
        </aff>
      </contrib-group>
      <fpage>263</fpage>
      <lpage>273</lpage>
      <abstract>
        <p>The mass digitization and data昀椀cation of historical records brings about new possibilities to study or re-assess a broad range of individual events. By evaluating microlevel events in a social context simultaneously, insights into the macrolevel dynamics of society can be gained. This paper presents an innovative framework for historical network research that allows the comparison of structural characteristics in networks across di昀erent time periods, and illustrates it with an example of the political networks of Northern Song China. By using machine learning models for valence prediction and tracking the changes of structural characteristics related to structural balance, clustering, and connectivity in temporal networks, we reveal that the mid-to-late 11th century, during which political reforms took place, was characterized by political pluralism and even political tolerance, compared to earlier or later periods. The replicable framework proposed in this paper is capable of revealing signi昀椀cant historical changes that would otherwise be obscured, shedding light on the underlying historical dynamics of such changes.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;social network analysis</kwd>
        <kwd>structural balance</kwd>
        <kwd>valence prediction</kwd>
        <kwd>cultural evolution</kwd>
        <kwd>Chinese history</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        The analysis of structural characteristics of relational data is a widely used approach in network
analysis for understanding the dynamics of social relationships and advancing established
sociological theories. These theories and characteristics include structural bala1n7]c[e6[],
structural holes5[], and clustering coe昀케cient [
        <xref ref-type="bibr" rid="ref30">32</xref>
        ], among others. With the exponential growth of
digital data and computing power, researchers can now explore data with an “unprecedented
breadth and depth and scale”2[0, p. 722]. Consequently, recent research e昀orts have
capitalized on the digital traces of online user activities, providing valuable insights into the study of
structural network characteristics. For example, Lerner and Lomi used relational event models
(REMs) to examine the structural balance in a network based on the activities of Wikipedia
editors [
        <xref ref-type="bibr" rid="ref19">21</xref>
        ], while Aref et al. proposed a framework that accounts for various levels of structural
balance by analyzing multiple networks constructed from online platforms such as Red1]d.it [
      </p>
      <p>
        The born-digital data is not the sole resource that social network analysis can take advantage
of. The digitization and data昀椀cation of historical records and literary texts has also opened
possibilities for researchers to investigate signi昀椀cant macrolevel questions. As stated in the editors’
introduction of theJournal of Historical Network Research, the last two decades have witnessed
a development of network analysis “from a fringe theory into an established methodology in
historical research”2[
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. Historical network analysis has been applied to a broad range of
objects, ranging from 昀椀rst-century Roman 昀椀ction [
        <xref ref-type="bibr" rid="ref16">18</xref>
        ] to sixteenth-century German religious
writing [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]
      </p>
      <p>
        Particularly, premodern Chinese culture attached great importance to historiography and
had a long-standing tradition of recording historical events. Recent e昀orts to transform these
sources into structured data present researchers with an unprecedented opportunity to employ
computational approaches to analyze them. Examples of such e昀orts include digital libraries
such as the Chinese Text Project [
        <xref ref-type="bibr" rid="ref29">31</xref>
        ], which o昀ers full-text access to historical sources, and
databases such as the China Biographical Database (CBDB)1[
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], which provides relational data
on historical 昀椀gures. In this paper, we examine structural characteristics of a network we built
from association data in the CBDB to study the changes in political culture, and the Northern
Song period (960–1127, all dates cited in this paper are C.E.) is selected as an example.
      </p>
      <p>
        The Northern Song (960–1127) marked a signi昀椀cant transition in Chinese history, a time
when the aristocracy dissipated and the new ruling elite de昀椀ned themselves by learning
instead of pedigree [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ][
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]. Historians have recently observed that the political culture was
increasingly radicalized and polarized around the mid-eleventh centu1r9y]. [In consequence,
reconciliations and amicable working relationships between rivals, which were not
uncommon in the 1040s, became “politically and ideologically inconceivable” a昀琀er the 1070s in the
Northern Song court3[4, p. 210]. To date, many historians have discussed this change by
presenting a close reading of historical writings that shed light on topics such as the politics of
commemoration [
        <xref ref-type="bibr" rid="ref32">34</xref>
        ], the discourses of politics2[
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], and ritual debates 1[
        <xref ref-type="bibr" rid="ref9">9</xref>
        ].
      </p>
      <p>
        In contrast, this paper employs quantitative social network analysis methods to reexamine
the change in the political culture in the Northern Song. Previous researchers have already
studied the social networks in this period9][[
        <xref ref-type="bibr" rid="ref27">29</xref>
        ], but our work takes a distinct approach by
delving into the structural characteristics of these networks. Furthermore, while we are
informed by the triadic balance theory17[][
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] widely used in network analysis, this paper also
aims to transcend the conventional interpretations of triadic structures that focus mainly on
balanced and imbalanced triads. A recent study that employs a similar approach, for example,
interprets a higher proportion of imbalanced triads as an indication of political instab3il3i]t.y [
However, it is known that the eleventh-century intellectual landscape was extraordinarily
pluralistic, leading to the formation of multiple contending visions in court debates that must not
be obscured by the dichotomized language employed by court o昀케cials4[].
      </p>
      <p>Therefore, we posit that the four types of triads are all meaningful but indicate di昀erent
proclivities in the Northern Song political culture. We interpret the four types of triads in the
Northern Song political network as follows: “+++” triads stand for “political collegiality” (two
actors who have a common friend are also friends with each other), “++–” triads stand for
“political tolerance” (two enemies nevertheless are both friends with the same third party), “+–
–” triads stand for “political polarization” (two actors who have a common enemy are friends
with each other), and “–––” triads stand for “political plurality” (two actors who have a common
enemy also 昀椀ght between themselves).</p>
      <p>The research objective of this interdisciplinary paper is to apply network analysis methods
from the 昀椀eld of information science to examine the changes in political culture during the
Northern Song period in the 昀椀eld of Chinese history. Speci昀椀cally, our research aims to address
two research questions:
1. How did structural characteristics of these networks—especially in relation to structural
balance, clustering, and connectivity—vary over time?
2. What do these variations reveal about the changes in Northern Song political culture?</p>
    </sec>
    <sec id="sec-2">
      <title>2. Methods</title>
      <p>The research framework of this paper includes a data collection stage, a network construction
stage, and three data analysis experiments.</p>
      <sec id="sec-2-1">
        <title>2.1. Data Collection and Network Construction</title>
        <p>We initially extracted all explicit political associations (including all associations under the
categories of “supportive political association”, “recommendation and sponsorship”, and
“oppositional political association”) from the CBDB. The CBDB is a renowned relational database
with biographical information about over 500,000 individuals. It provides the largest structured
dataset on historical 昀椀gures and their relationships in premodern China and is professionally
curated for research purposes, by “systematically harvest[ing] data from biographical indexes,
literary collections, and local gazetteers, which document these social interactions using
formulaic expressions conducive to semi-automated data extraction1”2[, p. 263]. Notably, the data in
the CBDB is most comprehensive and well-represented for the Song dynasty (960–127196)][.</p>
        <p>As the majority of association data in the CBDB are not dated (of the 11,393 explicit political
associations, only 2,478 or 22% are dated), we utilized o昀케ceholding records for reconstructing
the political networks in di昀erent periods of the Northern Song. We extracted all o昀케ceholding
records from pertinent tables in the CBDB, generating a list of 5,114 Northern Song o昀케cials
with an o昀케ceholding record between 960 and 1127. We then selected political associations that
involve at least one person in this list, resulting in 2,383 political associations of the Northern
Song o昀케cials.</p>
        <p>Treating the Northern Song o昀케cials as nodes and their relationships as edges, we then
constructed a Northern Song political network based on these 2,383 political associations. We
de昀椀ned “supportive political association” and “recommendation and sponsorship” as positive
associations, and “oppositional political association” as negative ones, so that an edge contains
either only positive associations (marked as “+”), only negative associations (marked as “–”),
or both positive and negative associations (marked as “D”, for “duality”). This
“o昀케ceholdingbased” network consists of 1,567 nodes and 1,936 edges. For comparative purposes, we also
constructed a “date-based” network consisting of 504 nodes and 538 edges using political
associations dated between 960 and 1127. Since most people with a dated association in the
Northern Song also have o昀케ceholding records, there is signi昀椀cant overlap between the two
networks: only 28 nodes (5.6%) and 33 edges (6.1%) in the “date-based” network are not in the
“o昀케ceholding-based” network.</p>
        <p>To track the changes in the Northern Song political culture, we also created 149 temporal
networks as the subnetworks of the “o昀케ceholding-based” network. These temporal networks
are based on political associations involving o昀케cials who had an appointment record between
960 and 979 (1st temporal network), between 961 and 980 (2nd temporal network), and all the
way up to the period between 1108 and 1127 (149th temporal network). The associations in each
network did not necessarily occur within the speci昀椀ed 20-year time window (as there is o昀琀en
no data indicating when the associations took place). Thus, these temporal networks should be
interpreted as networks of di昀erent cohorts of o昀케cials. For instance, the 1st temporal network
represents the political network of the 960–979 cohort of o昀케cials. The 20-year window is used
as it reasonably re昀氀ects the span of a cohort of o昀케cials.</p>
      </sec>
      <sec id="sec-2-2">
        <title>2.2. Data Analysis</title>
        <p>Next, we conducted three data analysis experiments. First, we trained and evaluated machine
learning models to classify edge valence. Edge valence, also referred to as edge sign or edge
label, signi昀椀es whether the relationship between two linked entities is positive (“+”), negative
(“–”), or a duality (“D”). We used 13 features identi昀椀ed by the Python library NetworkX13[]
for this classi昀椀cation task. These features included 昀椀ve node-level features for each of the two
connected vertices, resulting in a total of ten features: local clustering coe昀케cien3t2[], two
measures of structural holes (constraint and e昀ective size)5[], a measure of structural
cohesion (k-component with the largest k the vertex belongs to)26[], as well as the size of the
component the vertex belongs to. Additionally, we used three edge-level features: a measure
of structural holes (local constrain5t]),[two measures of connectivity (local node connectivity
and local edge connectivity). Notably, these features reveal structural characteristics of
unsigned networks. That is, they take into account only the presence or absence of an edge and
do not consider edge valence. Thus, they are, by de昀椀nition, independent of edge valence.</p>
        <p>
          Next, we utilized seven classical machine learning models available in the Python module
Scikit-learn 2[
          <xref ref-type="bibr" rid="ref7">7</xref>
          ], namely decision tree, random forest, SVM, logistic regression, perceptron,
Naïve Bayes, and LDA. Each model was trained and tested using a 10-fold strati昀椀ed
crossvalidation approach on the “o昀케ceholding-based” network for both three-class (“+”, “–”, or “D”)
and binary (“+” and “–”, since the number of instances of “D” is much smaller than the other
two classes) classi昀椀cations. For both tasks, we undersampled the larger classes to balance the
size of each class. We repeated the process for the “date-based” network to validate the results.
However, due to the small size of the test sets in the temporal networks, we did not use them
in the experiment.
        </p>
        <p>
          For the second and third experiments, we used the 149 temporal networks to monitor how
the di昀erent structural characteristics of these networks changed over time, instead of
relying solely on the static networks. In the second experiment, we scrutinized the overall
network structure, and tracked the changes in 昀椀ve network-level structural characteristics over
the course of the Northern Song: network density, proportion of the nodes in the largest
component, transitivity, average clustering coe昀케cient [
          <xref ref-type="bibr" rid="ref30">32</xref>
          ], and average node connectivity 2[].
        </p>
        <p>
          In the third experiment, we analyzed closed triads (i.e., three nodes connected by three edges)
[
          <xref ref-type="bibr" rid="ref6">6</xref>
          ]. For each temporal network, we computed the proportion of all four types of closed triads
de昀椀ned by varying combinations of edge valence: “+++”, “++–”, “+––”, and “–––”. In contrast
to a previous study that excluded edges where both positive and negative associations exist due
to the “lack of de昀椀nitive information to determine valence”1[1, p. 345], we calculated the “D”
edges twice in our analysis, once as “+”, and again as “–”. We took this approach in the belief
that positive and negative associations between historical 昀椀gures did not cancel each other out.
Building upon these four types of closed triads, we calculated the triadic balance rate for each
network, that is, the proportion of “+++” triads and “+––” triads out of all closed triads.
        </p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>3. Results and Discussions</title>
      <p>In this section, we will report the results from each experiment and o昀er brief historical
interpretations of the results.</p>
      <sec id="sec-3-1">
        <title>3.1. Experiment 1</title>
        <p>
          For the “o昀케ceholding-based” network, the SVM model performs best in the three-class
classi椀昀cation task, achieving an accuracy of 0.47 and a Cohen’s kappa score [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ] of 0.21, while the
random forest model performs best in the binary classi昀椀cation task, achieving an accuracy of
0.64 and a Cohen’s kappa score of 0.29. Given that all classes have an equal number of cases
after undersampling in both tasks, a completely random classi昀椀cation would yield an accuracy of
0.33 and a Cohen’s kappa of 0 for the three-class classi昀椀cation task, and an accuracy of 0.5 and
a Cohen’s kappa of 0 for the binary classi昀椀cation task. Therefore, although the performance of
the machine learning models is not exceptional, they clearly outperform random classi昀椀cation.
This also holds true for the comparison experiment on the “date-based” network, where the
three-class classi昀椀cation task achieves an accuracy of 0.57 and a Cohen’s kappa of 0.34, while
the binary classi昀椀cation task achieves an accuracy of 0.71 and a Cohen’s kappa of 0.43.
        </p>
        <p>Because the structural characteristics that are used to train the models are entirely
independent of valence, it can thus be concluded that the structural characteristics of the vertices of an
edge and of the edge itself in the Northern Song political networks provide meaningful
information about the valence of this edge. It is plausible that the structural position of individuals in
the Northern Song political networks in昀氀uenced their decision whether to develop positive or
negative relationships with each other. This implies that as a general attribute of the Northern
Song political networks, actors were constrained by the structure of their relationships.</p>
      </sec>
      <sec id="sec-3-2">
        <title>3.2. Experiment 2</title>
        <p>nectivity, and the average clustering coe昀케cient all increased in the 昀椀rst half of the period,
remained relatively stable in the 11th century, and decreased slightly in the beginning of the
12th century. The transitivity shows a trend that is similar to the aforementioned features a昀琀er
signi昀椀cant oscillations in the beginning of the Northern Song (the oscillations are likely due
to the small size of the networks). Moreover, the density of the networks gradually decreased
throughout the entire period.</p>
        <p>
          We added three vertical lines to facilitate the interpretation of the results. The lines A (1009–
1028 cohort) and B (1023–1042 cohort) denote the 昀椀rst networks in which two in昀氀uential
of椀昀cials, Fan Zhongyan and Wang Anshi, respectively, emerged as actors in the networks. Fan
and Wang were leaders of highly controversial reforms, the Qingli reform (1043–1045) and
the Xining reform (1069–1085) respectively, and political factions formed around th2e5m, p[p.
316–327][
          <xref ref-type="bibr" rid="ref28">30</xref>
          ]. Their inclusion introduced intensive political alliances and struggles that
significantly increased the degree of network clustering and connectivity. On the contrary, line C
(1102–1121 cohort) represents the 昀椀rst network that Zhang Dun’s career in government ended.
A plausible interpretation is that Zhang’s downfall paved the way for the rise of Cai Jing, who
“established an unchallenged power, inaugurating an era of political stability at cou23r,t”p.[
571], leading to fewer cases of political alliances and struggles and thereby reducing the degree
of network clustering and connectivity.
        </p>
      </sec>
      <sec id="sec-3-3">
        <title>3.3. Experiment 3</title>
        <p>Besides, despite the sustained low levels of “political plurality” (“–––”), line B notably exhibits
a relative increase in its value, which should be closely related to the increasing diversity of the
intellectual landscape that formed around Wang Anshi, Sima Guang, Su Shi, Cheng Yi, among
others [3, pp. 161–163], as well as a somewhat unexpected increase in “political tolerance”
(“++–”). “Political tolerance” remained at a relatively high level until line C, when “political
polarization” increased due to the failure of “factional conciliatio23n,”p[. 566].</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>4. Conclusion</title>
      <p>Our 昀椀ndings from Experiment 1 indicate that the structural characteristics of a network
correlated with the behavior of the actors in the Northern Song political networks. In Experiments
2 and 3, we explored the changes in the degree of network clustering and connectivity, and the
triadic balance rate. Our results show that they all increased in the 昀椀rst half of the 11th century
and slightly decreased in the beginning of the 12th century. These 昀椀ndings challenge the
traditional view of Northern Song politics as a dichotomy between reformers and conservati2v4e]s [
and reinforce the more recent view that highlights a pluralistic political cul4tu],rbeu[t from a
macro-level perspective. Our data suggest that, while the political reforms in the 11th century
generated intensive political struggles, they did not result in political polarization. Rather, the
period was characterized by strong political pluralism and even a degree of political tolerance.</p>
      <p>The future research will go into three directions. First, we intend to examine the speci昀椀c
associations that caused the changes in the structural characteristics of the political network,
especially the unexpected political tolerance observed during the 11th century when political
reforms took place. Through a close reading of the historical sources, we aim to gain deeper
understanding of the underlying dynamics that contributed to the changes in Northern Song
political culture. Second, we plan to enhance our machine learning approach by incorporating
additional features, encompassing both characteristics associated with personal traits external
to the network and supplementary network attributes that are independent of edge valence.
By assessing which attributes exhibit the highest explanatory power in our models, we aim
to gain a deeper understanding of actor behavior in the Northern Song political networks and
the underlying political culture of the period. Third, we aim to conduct further time series
analysis, using statistical approaches to scrutinize signi昀椀cant changes in the curves on both
Figure 2 and Figure 3. This will enable us to compile a comprehensive list of rapid changes in
network measures in supplement to the three changes marked by the vertical lines.</p>
      <p>In conclusion, this interdisciplinary paper contributes to three 昀椀elds. First, to the 昀椀eld of
Chinese history, it provides a quantitative assessment that helps historians better understand
changes in the Northern Song political culture. Second, to the 昀椀eld of social network analysis,
it extends the application of quantitative analysis of network structures to historical data.
Finally, to digital humanities and information science, it demonstrates the interpretative power
of computational methods on important domain-speci昀椀c questions, such as cultural evolution.
[15] Harvard University and Academia Sinica and Peking UniversitCy.hina Biographical</p>
      <p>Database. Database. 2023. url: https://projects.iq.harvard.edu/cbd.b
[16] Harvard University and Academia Sinica and Peking UniversitHy.angai fanwei
[Coverage of CBDB]. Webpage. 2015. url: https://projects.iq.harvard.edu/chinesecbdb/%5C%E6
%5C%B6%5C%B5%5C%E8%5C%93%5C%8B%5C%E7%5C%AF%5C%84%5C%E5%5C%9C%5
C%8D.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>S.</given-names>
            <surname>Aref</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Dinh</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Rezapour</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J.</given-names>
            <surname>Diesner</surname>
          </string-name>
          . “
          <article-title>Multilevel Structural Evaluation of Signed Directed Social Networks Based on Balance Theory”</article-title>
          .
          <source>ISnc:ienti昀椀c Reports</source>
          <volume>10</volume>
          (
          <year>2020</year>
          ), p.
          <fpage>15228</fpage>
          . doi:
          <volume>10</volume>
          .1038/s41598-020-71838-6.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>L. W.</given-names>
            <surname>Beineke</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O. R.</given-names>
            <surname>Oellermann</surname>
          </string-name>
          , and
          <string-name>
            <surname>R. E. Pippert.</surname>
          </string-name>
          “
          <article-title>The Average Connectivity of a Graph”</article-title>
          .
          <source>In: Discrete Mathematics 252.1-3</source>
          .
          <fpage>1</fpage>
          -
          <lpage>3</lpage>
          (
          <year>2002</year>
          ), pp.
          <fpage>31</fpage>
          -
          <lpage>45</lpage>
          . doi:
          <volume>10</volume>
          .1016/s0012-365x (
          <issue>01</issue>
          )
          <fpage>00180</fpage>
          -
          <lpage>7</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>P. K.</given-names>
            <surname>Bol.</surname>
          </string-name>
          Neo-Confucianism in History. Cambridge, MA, USA: Harvard University Asia Center,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>P. K.</given-names>
            <surname>Bol</surname>
          </string-name>
          . “
          <article-title>Reconceptualizing the Order of Things in Northern and Southern Sung”</article-title>
          . In: The Cambridge History of China. Ed. by
          <string-name>
            <given-names>J. W.</given-names>
            <surname>Cha昀ee</surname>
          </string-name>
          and
          <string-name>
            <given-names>D.</given-names>
            <surname>Twitchett</surname>
          </string-name>
          . Vol.
          <volume>5</volume>
          ,
          <string-name>
            <surname>Sung</surname>
            <given-names>China</given-names>
          </string-name>
          ,
          <fpage>960</fpage>
          -
          <lpage>1279</lpage>
          , Part 2. Cambridge, UK: Cambridge University Press,
          <year>2015</year>
          , pp.
          <fpage>665</fpage>
          -
          <lpage>726</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>R. S.</given-names>
            <surname>Burt</surname>
          </string-name>
          .
          <source>Structural Holes: The Social Structure of Competition</source>
          . Cambridge, MA, USA: Harvard University Press,
          <year>1992</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>D.</given-names>
            <surname>Cartwright</surname>
          </string-name>
          and
          <string-name>
            <given-names>F.</given-names>
            <surname>Harary</surname>
          </string-name>
          . “
          <article-title>Structural Balance: A Generalization of Heider's Theory”</article-title>
          .
          <source>In: Psychological Review 63.5</source>
          .
          <issue>5</issue>
          (
          <issue>1956</issue>
          ), pp.
          <fpage>277</fpage>
          -
          <lpage>293</lpage>
          . doi:
          <volume>10</volume>
          .1037/h0046049.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <surname>J. W. Cha昀ee.</surname>
          </string-name>
          <article-title>The Thorny Gates of Learning in Sung China</article-title>
          . Albany,
          <string-name>
            <surname>NY</surname>
          </string-name>
          , USA: State University of New York Press,
          <year>1995</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>J.</given-names>
            <surname>Cohen</surname>
          </string-name>
          .
          <article-title>“A Coe昀케cient of Agreement for Nominal Scales”</article-title>
          .
          <source>In: Educational and Psychological Measurement 20.1</source>
          .
          <issue>1</issue>
          (
          <issue>1960</issue>
          ), pp.
          <fpage>37</fpage>
          -
          <lpage>46</lpage>
          . doi:
          <volume>10</volume>
          .1177/001316446002000104.
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>H.</given-names>
            <surname>De Weerdt</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Ho</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Wagner</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Q.</given-names>
            <surname>Jiyan</surname>
          </string-name>
          , and
          <string-name>
            <given-names>C.</given-names>
            <surname>Mingkin</surname>
          </string-name>
          . “
          <article-title>Is There a Faction in This List?”</article-title>
          <source>In: Journal of Chinese History 4.2.2</source>
          (
          <issue>2020</issue>
          ), pp.
          <fpage>347</fpage>
          -
          <lpage>389</lpage>
          . doi:
          <volume>10</volume>
          .1017/jch.
          <year>2020</year>
          .
          <volume>16</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>A.</given-names>
            <surname>Deicke</surname>
          </string-name>
          . “
          <article-title>Networks of Con昀氀ict: Analyzing the “Culture of Controversy” of Polemical Pamphlets of Intra-Protestant Disputes (1548-1580)”</article-title>
          .
          <source>InJ:ournal of Historical Network Research 1.1.1</source>
          (
          <issue>2017</issue>
          ), pp.
          <fpage>71</fpage>
          -
          <lpage>105</lpage>
          . doi:
          <volume>10</volume>
          .25517/jhnr.v1i1.8.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>J.</given-names>
            <surname>Diesner</surname>
          </string-name>
          and
          <string-name>
            <given-names>C. S.</given-names>
            <surname>Evans</surname>
          </string-name>
          . “
          <article-title>Little Bad Concerns: Using Sentiment Analysis to Assess Structural Balance in Communication Networks”</article-title>
          .
          <source>IAn:SONAM '15: Proceedings of the 2015 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining</source>
          <year>2015</year>
          . New York, NY, USA,
          <year>2015</year>
          , pp.
          <fpage>342</fpage>
          -
          <lpage>348</lpage>
          . doi:
          <volume>10</volume>
          .1145/2808797.2809403.
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>M.</given-names>
            <surname>Fuller</surname>
          </string-name>
          and
          <string-name>
            <given-names>H.</given-names>
            <surname>Wang</surname>
          </string-name>
          . “Structuring, Recording, and
          <article-title>Analyzing Historical Networks in the China Biographical Database”</article-title>
          .
          <source>InJ:ournal of Historical Network Research 5.1.1</source>
          (
          <issue>2022</issue>
          ), pp.
          <fpage>248</fpage>
          -
          <lpage>270</lpage>
          . doi:
          <volume>10</volume>
          .25517/jhnr.v5i1.
          <fpage>123</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>A. A.</given-names>
            <surname>Hagberg</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D. A.</given-names>
            <surname>Schult</surname>
          </string-name>
          , and
          <string-name>
            <given-names>P. J.</given-names>
            <surname>Swart</surname>
          </string-name>
          . “
          <article-title>Exploring Network Structure, Dynamics,</article-title>
          and
          <article-title>Function Using NetworkX”</article-title>
          .
          <source>In:Proceedings of the 7th Python in Science Conference (SciPy2008)</source>
          . Pasadena, CA, USA,
          <year>2008</year>
          , pp.
          <fpage>11</fpage>
          -
          <lpage>15</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>C.</given-names>
            <surname>Hartman</surname>
          </string-name>
          . “
          <article-title>Sung Government and Politics”</article-title>
          .
          <source>InT:</source>
          he Cambridge History of China. Ed. by
          <string-name>
            <given-names>J. W.</given-names>
            <surname>Cha昀ee</surname>
          </string-name>
          and
          <string-name>
            <given-names>D.</given-names>
            <surname>Twitchett</surname>
          </string-name>
          . Vol.
          <volume>5</volume>
          :
          <string-name>
            <given-names>Sung</given-names>
            <surname>China</surname>
          </string-name>
          ,
          <fpage>960</fpage>
          -
          <lpage>1279</lpage>
          , Part 2. Cambridge, UK: Cambridge University Press,
          <year>2015</year>
          , pp.
          <fpage>19</fpage>
          -
          <lpage>138</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>F.</given-names>
            <surname>Heider</surname>
          </string-name>
          . “
          <article-title>Attitudes and Cognitive Organization”</article-title>
          .
          <source>InT:he Journal of Psychology 21.1</source>
          .
          <issue>1</issue>
          (
          <issue>1946</issue>
          ), pp.
          <fpage>107</fpage>
          -
          <lpage>112</lpage>
          . doi:
          <volume>10</volume>
          .1080/00223980.
          <year>1946</year>
          .
          <volume>9917275</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [18]
          <string-name>
            <surname>E. Köstner.</surname>
          </string-name>
          “
          <article-title>Trimalchio's Last Will: Shi昀琀ing Interactions Between Seeming and Being”</article-title>
          .
          <source>In: Journal of Historical Network Research 3.1.1</source>
          (
          <issue>2019</issue>
          ), pp.
          <fpage>1</fpage>
          -
          <lpage>29</lpage>
          . doi:
          <volume>10</volume>
          .25517/jhnr.v3i1 .
          <fpage>53</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>M. J.</given-names>
            <surname>Kroher</surname>
          </string-name>
          . “
          <article-title>“With Malice Toward None” to “A House Divided”: The Impact of Changing Perceptions of Ritual and Sincerity on Elite Social Cohesion and Political Culture in Northern Song China</article-title>
          ,
          <fpage>1027</fpage>
          -
          <lpage>1067</lpage>
          ”.
          <source>PhD thesis</source>
          . Cambridge, MA, USA: Harvard University,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [20]
          <string-name>
            <given-names>D.</given-names>
            <surname>Lazer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Pentland</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Adamic</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Aral</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. L.</given-names>
            <surname>Barabasi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Brewer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Christakis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Contractor</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Fowler</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Gutmann</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Jebara</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>King</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Macy</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Roy</surname>
          </string-name>
          , and
          <string-name>
            <surname>M. Van Alstyne.</surname>
          </string-name>
          “Computational Social Science”.
          <source>InS:cience 323.5915.5915</source>
          (
          <year>2009</year>
          ), pp.
          <fpage>721</fpage>
          -
          <lpage>723</lpage>
          . doi:
          <volume>10</volume>
          .1126/science.1167742.
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [21]
          <string-name>
            <given-names>J.</given-names>
            <surname>Lerner</surname>
          </string-name>
          and
          <string-name>
            <given-names>A.</given-names>
            <surname>Lomi</surname>
          </string-name>
          . “
          <article-title>The Free Encyclopedia That Anyone Can Dispute: An Analysis of the Micro-Structural Dynamics of Positive and Negative Relations in the Production of Contentious Wikipedia Articles”</article-title>
          .
          <source>InS:ocial Networks</source>
          <volume>60</volume>
          (
          <year>2020</year>
          ), pp.
          <fpage>11</fpage>
          -
          <lpage>25</lpage>
          . doi:
          <volume>10</volume>
          .101 6/j.socnet.
          <year>2018</year>
          .
          <volume>12</volume>
          .003.
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [22]
          <string-name>
            <given-names>A. D.</given-names>
            <surname>Levine</surname>
          </string-name>
          .
          <article-title>Divided by a Common Language: Factional Con昀氀ict in Late Northern Song China</article-title>
          . Honolulu,
          <string-name>
            <surname>HI</surname>
          </string-name>
          , USA: University of Hawai'i Press,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [23]
          <string-name>
            <given-names>A. D.</given-names>
            <surname>Levine</surname>
          </string-name>
          . “
          <article-title>The Reigns of Hui-tsung (1100-1126) and Ch'in-tsung (1126-1127) and the Fall of the Northern Sung”</article-title>
          .
          <source>InT:</source>
          he Cambridge History of China. Ed. by
          <string-name>
            <given-names>D.</given-names>
            <surname>Twitchett</surname>
          </string-name>
          and
          <string-name>
            <given-names>P. J.</given-names>
            <surname>Smith</surname>
          </string-name>
          . Vol.
          <volume>5</volume>
          ,
          <string-name>
            <given-names>The</given-names>
            <surname>Sung</surname>
          </string-name>
          Dynasty and Its Precursors,
          <fpage>907</fpage>
          -
          <lpage>1279</lpage>
          , Part 1. Cambridge, UK: Cambridge University Press,
          <year>2009</year>
          , pp.
          <fpage>556</fpage>
          -
          <lpage>643</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [24]
          <string-name>
            <surname>J. T. C.</surname>
          </string-name>
          <article-title>Liu. Reform in Sung China: Wang An-shih (1021-1086) and His New Policies</article-title>
          . Cambridge, MA, USA: Harvard University Press,
          <year>1959</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [25]
          <string-name>
            <surname>M. McGrath.</surname>
          </string-name>
          “
          <article-title>The Reigns of Jen-tsung (1022-1063) and Ying-tsung (1063-1067)”</article-title>
          . In:The Cambridge History of China. Ed. by
          <string-name>
            <given-names>D.</given-names>
            <surname>Twitchett</surname>
          </string-name>
          and
          <string-name>
            <given-names>P. J.</given-names>
            <surname>Smith</surname>
          </string-name>
          . Vol.
          <volume>5</volume>
          ,
          <string-name>
            <given-names>The</given-names>
            <surname>Sung</surname>
          </string-name>
          Dynasty and Its Precursors,
          <fpage>907</fpage>
          -
          <lpage>1279</lpage>
          , Part 1. Cambridge, UK: Cambridge University Press,
          <year>2009</year>
          , pp.
          <fpage>279</fpage>
          -
          <lpage>346</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [26]
          <string-name>
            <given-names>J.</given-names>
            <surname>Moody</surname>
          </string-name>
          and
          <string-name>
            <surname>D. R. White.</surname>
          </string-name>
          “
          <article-title>Structural Cohesion and Embeddedness: A Hierarchical Concept of Social Groups”</article-title>
          .
          <source>InA:merican Sociological Review 68.1</source>
          .
          <issue>1</issue>
          (
          <issue>2003</issue>
          ), pp.
          <fpage>103</fpage>
          -
          <lpage>127</lpage>
          . doi:
          <volume>10</volume>
          .2307/3088904.
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          [27]
          <string-name>
            <given-names>F.</given-names>
            <surname>Pedregosa</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Varoquaux</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Gramfort</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Michel</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Thirion</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O.</given-names>
            <surname>Grisel</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Blondel</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Prettenhofer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Weiss</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Dubourg</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Vanderplas</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Passos</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Cournapeau</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Brucher</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Perrot</surname>
          </string-name>
          , and
          <string-name>
            <given-names>E. Duchesnay.</given-names>
            “
            <surname>Scikit-Learn</surname>
          </string-name>
          :
          <article-title>Machine Learning in Python”</article-title>
          .
          <source>InJo:urnal of Machine Learning Research</source>
          <volume>12</volume>
          (
          <year>2011</year>
          ), pp.
          <fpage>2825</fpage>
          -
          <lpage>2830</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          [28]
          <string-name>
            <given-names>C.</given-names>
            <surname>Rollinger</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Düring</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Gramsch-Stehfest</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M.</given-names>
            <surname>Stark</surname>
          </string-name>
          . “Editors'
          <article-title>Introduction”</article-title>
          .
          <source>In: Journal of Historical Network Research 1.1.1</source>
          (
          <issue>2017</issue>
          ), pp.
          <fpage>i</fpage>
          -vii.
          <source>doi: 10</source>
          .25517/jhnr.v1i1.
          <fpage>19</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          [29]
          <string-name>
            <given-names>W.</given-names>
            <surname>Shang</surname>
          </string-name>
          and
          <string-name>
            <given-names>W.</given-names>
            <surname>Huang</surname>
          </string-name>
          . “
          <article-title>Rediscussing the Political Struggle in the Light of Reform in Late 11th Century China under the View of Digital Humanities”</article-title>
          .
          <source>InD:igital Humanities Quarterly 16.2</source>
          .
          <issue>2</issue>
          (
          <year>2022</year>
          ). url: http://www.digitalhumanities.org/dhq/vol/16/2/000613/00 0613.html.
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          [30]
          <string-name>
            <given-names>P. J.</given-names>
            <surname>Smith</surname>
          </string-name>
          . “
          <article-title>Shen-tsung's Reign and the New Policies of Wang An-shih</article-title>
          ,
          <fpage>1067</fpage>
          -
          <lpage>1085</lpage>
          ”. In: The Cambridge History of China. Ed. by
          <string-name>
            <given-names>D.</given-names>
            <surname>Twitchett</surname>
          </string-name>
          and
          <string-name>
            <given-names>P. J.</given-names>
            <surname>Smith</surname>
          </string-name>
          . Vol.
          <volume>5</volume>
          ,
          <string-name>
            <given-names>The</given-names>
            <surname>Sung</surname>
          </string-name>
          Dynasty and Its Precursors,
          <fpage>907</fpage>
          -
          <lpage>1279</lpage>
          , Part 1. Cambridge, UK: Cambridge University Press,
          <year>2009</year>
          , pp.
          <fpage>347</fpage>
          -
          <lpage>483</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          [31]
          <string-name>
            <given-names>D.</given-names>
            <surname>Sturgeon</surname>
          </string-name>
          . “
          <article-title>Digitizing Premodern Text with the Chinese Text Project”</article-title>
          .
          <source>IJno:urnal of Chinese History 4.2.2</source>
          (
          <issue>2020</issue>
          ), pp.
          <fpage>486</fpage>
          -
          <lpage>498</lpage>
          . doi:
          <volume>10</volume>
          .1017/jch.
          <year>2020</year>
          .
          <volume>19</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          [32]
          <string-name>
            <given-names>D. J.</given-names>
            <surname>Watts</surname>
          </string-name>
          and
          <string-name>
            <given-names>S. H.</given-names>
            <surname>Strogatz</surname>
          </string-name>
          . “Collective Dynamics of 'Small-World'
          <article-title>Networks”</article-title>
          .
          <source>In: Nature</source>
          <volume>393</volume>
          (
          <year>1998</year>
          ), pp.
          <fpage>440</fpage>
          -
          <lpage>442</lpage>
          . doi:
          <volume>10</volume>
          .1038/30918.
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          [33]
          <string-name>
            <given-names>C.</given-names>
            <surname>Yan</surname>
          </string-name>
          and
          <string-name>
            <given-names>J.</given-names>
            <surname>Wang</surname>
          </string-name>
          . “
          <article-title>Shuzi renwen shijiao: jiyu fuhao fenxi fa de songdai zhengzhi wangluo keshihua yanjiu [Digital Humanistic Perspective: A Study on the Visualization of Political Network in Song Dynasty Based on Symbolic Analysis]”</article-title>
          .
          <source>ZInh:ongguo tushuguan xuebao 44.5</source>
          .
          <issue>5</issue>
          (
          <issue>2018</issue>
          ), pp.
          <fpage>87</fpage>
          -
          <lpage>103</lpage>
          . doi:
          <volume>10</volume>
          .13530/j.cnki.jlis.
          <volume>180015</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          [34]
          <string-name>
            <surname>C. E. Zhang.</surname>
          </string-name>
          “
          <article-title>Bureaucratic Politics and Commemorative Biography: The Epitaphs of Fan Zhongyan”</article-title>
          . In: State Power in China,
          <volume>900</volume>
          -
          <fpage>1325</fpage>
          . Ed. by
          <string-name>
            <given-names>P. B.</given-names>
            <surname>Ebrey</surname>
          </string-name>
          and
          <string-name>
            <given-names>P. J.</given-names>
            <surname>Smith</surname>
          </string-name>
          . Seattle, WA, USA: University of Washington Press,
          <year>2016</year>
          , pp.
          <fpage>192</fpage>
          -
          <lpage>216</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>