CCS Concepts: • Information systems → Data mining; Information extraction; • Applied computing → Document management and text processing.
Finding new terminology is a kind of named entity recognition(NER) problem. However, many high performance methods need labelled data. Although they can obtain excellent results on training and testing data, it is hard for them to process new unlabelled data. One factor leading to this gap is that features of new text are diferent from features models learn on training data owing to the diference between their domains. Also, these new scientific texts usually lack labels for extraction. So an unsupervised method which can also adapt diferent domains is needed.
To overcome this problem, we propose an unsupervised
method based on sentence pattern and part of speech. In
detail, we initialize a few patterns to extract terminologies
in certain sentences. In this step, we can obtain some
terminologies and their part of speech sequences. Then, we try to
ifnd the same POS sequences in sentences not matched by
initial patterns with obtained terminologies’ POS sequences.
If a sentence is matched, we will utilize suitable words in this
sentence to replace the extendable parts of initial patterns.
In this case, we can obtain new patterns and get more
terminologies by using new patterns. After several iterations,
most terminology in scientific sentences can be extracted.
Recent years, terminology extraction has attracted more
and more attention. And all kinds of methods are produced.
Some methods rely on string, syntax and other original
features. Liu li[
Our method aims to extract terminology from unlabelled data. For this purpose, we utilize two features of terminology: surrounding words and POS sequences. The process can be divided into two steps. One step is to cold-start model with unlabelled data. In this step, the model will get sentence patterns, POS sequences of terminology from data. Another step is to extract terminology with POS sequences and sentence patterns learned by model. For a sentence, the model can extract terminology with learned sentence pattern or POS sequences. 3.2
Our sentence pattern is represented by regular expression.
Examples are given in figure.1. These are two patterns aiming to extract method terminology. "propose" is a word which often appear with method words at the same time. Boundary words like "by, to, for" are used to limit the range of terminology words. What we want is matched by "(.+?)". When generating new patterns, we can use words from matched Copyright 2020 for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0). sentence to replace the extendable part of extant pattern. For examples in figure.1, the extendable parts are "propose" and "proposed". They can be replaced by "develop", "present", "put forward" and so on. In this case, new patterns are obtained and can be used to extract terminology in other sentences. iflter new generated patterns according to their matching results and move suitable patterns to pattern base. For new terminology words, they replace the initial extracted terminology words to participate in the extraction loop until no new sentence could be extracted.
After cold start, we can obtain sentence patterns and POS sequences of terminology words. Here are two approaches to get new terminologies from new unlabelled data. One is that we can use patterns to match sentences for obtaining new terminologies when only sentence string is input. Another is that when sentence string and POS sequence (processed by natural language tools) are input, we can use POS sequence to match POS sequence of sentences to get a more accurate result. 4
To test our method, we crawled 200k+ abstracts from Web of
Knowledge. Their topics include machine learning, big data
and data mining. We utilize nltk[
In experiment, we use 54000 sentences and their POS sequences as training data and 1000 sentences and their POS sequences as testing data. All sentences are unlabelled.
The process of cold start of our method is shown in figure.2. The inputs are sentences and their POS sequences and form the sentence base. First, we use each pattern from pattern base to match each sentence from sentence base. At beginning, pattern base only contains initial sentence patterns. Matched sentence will be moved to extracted sentence base and we can obtain terminology words and their POS sequences. Otherwise, the sentence will be moved to unextracted sentence base. The two bases are empty before . After getting terminology words and their POS sequences, we need to filter them to obtain more accurate results. The filtered POS sequences are moved to POS Sequence Base. Then, for each POS sequences from POS sequence base, it is used to ifnd if the sentence POS sequence in unextracted sentence base contains itself. If sentence POS sequence contains, we can choose the candidate words from matched sentence for generation of new patterns. After new patterns are generated, we use them to match sentences in unextracted sentence base and new terminology words are obtained. Then we can
Owing to the lack of labels, we use human evaluation to measure our method’s performance. We use training data to cold-start our model and extract 146902 terminologies from training and testing data. Specifically, the accuracy of our method in testing data is 0.64. According to some cases of result, we can find that this method can partly solve the problem of extracting terminologies from unlabelled texts. However, when it comes to very professional terminologies, the performance may be lower.
To extract terminologies from scientific texts, we propose an unsupervised method based on sentence pattern and POS sequence of sentence. This method can extract terminologies without learning on labelled data and just need a few initial sentence patterns to cold-start. Then it can learn new patterns and POS sequences on unlabelled data and use them to extract new terminologies. In the future, we will test our model on standard datasets and compare it with some baselines.