Data are a fundamental asset in the current world of research. Data citation is becoming more common and supported by research databases, but it still presents many research challenges. This paper describes Data Credit, a new measure of value for data derived from data citation, that enables us to annotate databases with real values representing their importance. Credit, computed through the citations, can be used alongside them to better understand the importance of data. We introduce the task of Data Credit Distribution, the process by which credit produced by a citation is and assigned to the data in a database responsible for producing the output information being cited. We describe how this process can be performed and, through experiments, we show that credit can serve, among other things, to highlight “hotspots” in the database.
It is widely accepted that citations are the “currency” of the scientific world, a
fundamental method to perform dissemination of knowledge and foster scientific
development [22]. Scientific databases, “populated and updated with a great deal
of human effort” [
Data citations should be, among other things, counted alongside traditional
citations and contribute to bibliometrics indicators to reward scientific database
curators for their effort [
How to handle and count the credit generated by data citations and how it
contributes to traditional and new bibliometrics are long-standing research
issues [
To overcome this limitation, in recent years, the idea of crediting data emerged in the academic discussion through the concept of data credit, a real positive value describing the importance of data in a given context. We argue that credit can be used to address some of the limitations highlighted above. Credit is not atomic like a citation. Once computed, it can be divided into portions and assigned to all the data used by a query. Credit can be used as an annotation set at different granularity levels within a database to describe their importance.
In this work, we discuss the problem of data credit distribution, the issuance
of credit generated by some query Q on a relational database instance I to the
data in I responsible for the generation of Q(I). In particular, we discuss how
the distribution is possible in relational databases through lineage, a form of
data provenance [
Kats in [17] suggests the need for a modified citation system that includes the idea of transient and fractional credit. Credit is defined as a “quantity” representing the importance of a research entity (a paper, software or data) mentioned in a citation, but these ideas are proposed without any formalism.
Fang in [13] presents a framework to distribute credit generated by a paper to its authors and to the papers in its reference list in a transitive way. Each cited paper’s quantity of credit depends on its impact/role in the citing paper. This theoretical framework works for a graph composed of only papers, but it can be extended to another graph model that includes data.
Zeng et al. in [21] proposed the first method designed to compute credit within a network of papers citing data. This is the first step towards an automatic credit computation procedure. However, it is limited to assigning credit to the whole dataset without considering variable data granularity. Therefore, this is not a way to assign credit to a single research entity within a dataset. 3
Methods. Data Credit is a non-negative real value representing the importance of data in a specific context. It can be computed with different strategies and rationales. In this paper’s context, we consider credit as the product of a data citation; therefore, it is a quantity representing the importance of the data being cited in the citing paper. Ideally, the higher the impact of the cited data in the citing paper, the bigger the credit.
The task of Data Credit Distribution (DCD) consists of dividing this credit
into portions and assigning it to the recipients in a database responsible for
generating the cited data. Formally:
Definition 1. Data Credit Distribution at tuple level (DCD) [
f is the Distribution Strategy (DS), it aims to annotate each tuple (thus we speak of DCD at tuple level) in I with a portion of the credit. Its only requirement is that it has to be conservative: no credit is generated or lost during the distribution. A DS can be defined in many different ways, but what we may prefer is a function that distributes credit coherently with the role of the input tuples as defined by Q. That is, only tuples that had some role in generating Q(I) should receive credit.
To do so, we propose one definition of DS that exploits the concept of
lineage [
Definition 2. Lineage-based Distribution Strategy [
As we see, this DS equally rewards the tuples of the lineage of a tuple. To perform the whole distribution on Q(I), it is simply necessary to apply this DS to each tuple o ∈ Q(I). 0 0 8 0 0 6 0 0 4 0 0 2 0 webpages of GtoPdb report the URL of the referenced page. It is possible from these URLs to reverse-engineer the SQL queries that compute the data contained in the webpages. A webpage is composed by different parts, each part created with data extracted from the GtoPdb through SQL queries. We use these queries to perform DCD. We focused only on queries referring to the so-called target families1.
Without any loss of generality, we assumed that each tuple present in the output of these queries contains credit equal to 1, and we performed credit distribution through lineage using these queries that we inferred from the BJP papers. We used the ∼900 BJP papers citing [16] as of October 2020, and we extracted from them more than 1200 SQL queries to families of receptors.
The results of the distribution on the family table of GtoPdb, that contain information about the target families, are shown in the heat-map of Figure 1. Each cell in the map is a tuple, and the intensity of the color represents the assigned quantity of credit. Interestingly, few tuples receive almost all the credit, following a Pareto distribution. This shows how credit distribution can highlight “hotspots”, elements in the database that receive high values of credit. These are tuples that are used frequently by queries. Interestingly, these may also be tuples that are used but not visualized in the final output. This means that credit allows to rewards parts of the database that are used but not visualized, overcoming a limitation of traditional citations.
To better see how credit differs from traditional citations, consider Figure 2. We reported two radar plots, presenting the top 10 authors citation-wise and 1 https://www.guidetopharmacology.org/targets.jsp a b credit-wise (values normalized between 0 and 1, and the authors were substituted with numbers for privacy reasons). To compute the citations, we proceeded as follows: each time a query identifies data curated by an author, that author receives one citation and equally shares the credit assigned to that data with the other co-authors of that data. As we see from Figure 2.a, the top 10 authors, citation-wise, do not have the highest values of credit. Similarly, in Figure 2.b, the authors with the higher values of credit do not also have the highest citation count.
This shows that credit can reward authors whose data have a high impact in the research community, i.e., those data generated the highest quantity of credit, even if they received fewer citations than other authors. That is, specific citations are “more valuable”, credit-wise. Since we assumed that each output tuple carries credit 1, the queries that return outputs with more tuples also generate more credit. In more complex scenarios, where different and more sophisticated techniques may be used to decide how to generate quantities of credit, credit distribution can help to understand how data and their corresponding authors impact the scientific environment. 4
We showed how credit can highlight parts of the database that cover certain topics instead of others, as defined by queries. Credit and citations are correlated measures, but credit offers a new perspective to evaluate the impact of both data and curators. It can highlight parts of the database related to certain query topics, so-called “hotspots”. It directly rewards the tuples, and corresponding authors, that contributed to the production of cited data, even those that are not in the output itself. Moreover, it proportionately rewards data and curators based on their impact in the context defined by the issued queries. This helps to reward authors that would otherwise remain unnoticed. In future works, credit can become the basis for new bibliometrics and applications based on its presence. For example, data pricing, that is the identification of the price of certain data in a database based on how much they are used by queries.
This work is partially supported by the ExaMode project, as part of the European Union Horizon 2020 program under Grant Agreement no. 825292.