Abstract
China's technology is developing rapidly, and the number of patent applications has surged. Therefore, there is an urgent need for technical managers and researchers that how to apply computer technology to conduct in-depth mining and analysis of lots of Chinese patent documents to efficiently use patent information, perform technological innovation and avoid R&D risks. Automatic term extraction is the basis of patent mining and analysis, but many existing approaches focus on extracting domain terms in English, which are difficult to extend to Chinese due to the distinctions between Chinese and English languages. At the same time, some common Chinese technical terminology extraction methods focus on the high-frequency characteristics, while technical domain correlation characteristic and the unithood feature of terminology are given less attention. Aiming at these problems, this paper proposes a Chinese technical terminology method based on DC-value and information entropy to achieve automatic extraction of technical terminology in Chinese patents. The empirical results show that the presented algorithm can effectively extract the technical terminology in Chinese patent literatures and has a better performance than the C-value method, the log-likelihood ratio method and the mutual information method, which has theoretical significance and practical application value.
Similar content being viewed by others
Introduction
Terminology refers to a vocabulary unit describing the knowledge system of the professional domain, which contains abundant professional domain knowledge1. Terminology epitomizes and loads the core knowledge of a certain technology domain, whose change reflects the development trend of the technology domain, to some extent2. Terminology plays an important role in aspects of machine translation, scientific writing, question answering systems, automatic abstracting, knowledge communication, etc. Thus, many countries attach great importance to the construction of terminology corpuses, such as the EURODICAUTOM of European Union, LEXIS of the Language Office of the Federal Republic of Germany, TEAM of Siemens, TERMDOK of Sweden, DANETERM of Copenhagen Business School, the TER MINUM terminology group of Canada, the ROSTERM terminology base of Russian and so on3. Currently, the terminology in many technology domains mainly rely on artificial construction4, which is not only time-consuming, but also has a large cost5. Therefore, how to automatically extract terminology has been a concern for a long time.
Patent literature is the carrier of science and technology(S&T) information, recording the process of human S&T development. As the world's largest technology information source, patents cover 90–95% of the world's S&T information6. Most of the new inventions, new technologies, new crafts, and new equipment of various countries in various periods are reflected in patent literatures7. Currently, China's enormous economic market has attracted the attention of relevant people, both domestically and abroad. At the same time, China's technology is developing rapidly, and the number of patent applications has surged, with the number of patent applications in 2019 and 2020 continuously ranked first in the world. Therefore, how to apply computer technology to conduct in-depth mining and analysis of massive Chinese patent literature to make full use of patent information, perform technological innovation and avoid R&D risks has attracted widespread attention. Automatic term extraction is the basis of patent mining and analysis, but many existing approaches focus on extracting domain terms in English and are difficult to extend to Chinese due to the distinctions between Chinese and English languages. At the same time, some common Chinese technical terminology extraction methods focus on high-frequency characteristics, while the technical domain correlation characteristic and the unithood feature of terminology receive less attention.
In response to the above problems, this paper takes Chinese patent literature as the research object and proposes a method of extracting technical terms that combines grammatical rules and statistical methods to effectively identify technical terms and improve the accuracy of term extraction. The remainder of this paper is organized as follows. In “Theoretical background”, we describe existing work on automatic term extraction and focus on the challenges posed by domain-specific and unithood characteristics. In “The difference between Chinese and English in the process of extracting technical terms”, the difference between Chinese and English in the process of extracting technical terms is analysed. In “Terminology and patent terminology”, we present some basic notions associated with terms and the features of patent terms. We develop our proposed methodology for term extraction from Chinese patent literature in “Terminology extraction method based on domain C-value and information entropy”. Experimental evaluations and performance comparisons are given in “Experiment and results”. Finally, “Conclusion” concludes the method proposed in the paper and discusses the areas of future research.
Theoretical background
Identifying and extracting domain terms from patent literature is a challenging task, which is mainly reflected in two aspects: on one hand, the domain terms in the literature are very professional and rarely appear in the general thesaurus; on the other hand, the phenomena of term abbreviations, entity inclusion, and mutual reference in the literature are very common, and which puts forwards higher requirements for the correctness and completeness of term recognition. Automatic term extraction methods can be summarized into several categories: rule-based methods, statistics-based methods, machine learning-based methods, deep learning-based methods, semantic correlation-based methods, graph-based methods, etc.
Rule-based term extraction methods mainly consider the context of the terms, the internal components of the terms and other factors to identify terms, use grammatical rules, semantic rules, etc. to match in the corpus and output multicharacter units that meet the established rules as terms. The common term extraction models mainly focus on language features8,9, syntactic patterns10,11,12, and retrieval strategies13. The advantages of the method include being concise, intuitive, and having a strong expressive ability. The method can apply expert knowledge, and the accuracy is high when the prior knowledge can match the text. However, this method usually requires an expert knowledge base as a foundation, and whether building a knowledge base manually or automatically, it requires the intervention and supervision of domain experts. At the same time, terms in different fields have different characteristics in terms of word composition. To obtain a better extraction effect, the knowledge base must be continuously updated and adjusted. In view of the shortcomings of the methods, such as poor adaptability, excessive manual intervention, inability to identify unknown words, etc., the application of this method has great limitations in terminology extraction.
The term extraction methods based on statistics apply various statistical models to measure whether a word string is a term in the sense of probability. The term evaluation measures can be categorized as termhood features and unithood features14. The main parameters used to compute the termhood and unithood of the candidate terms are frequency15, TF*IDF16, C-value/NC-value17,18, Domain Component Feature Set (DCFS)19, hypothesis testing (z-test, t-test, chi-square test, etc.)20,21, likelihood ratio (LR)22,23, information entropy24,25, mutual information (MI)26,27, etc. The advantages of the methods are mainly manifested in the following aspects: they are easy to implement and require less manual intervention; they are adaptable and can be used in different technical fields; and the unknown words can be identified. The disadvantages are as follows: they are not sufficiently concise and intuitive; they are very dependent on the corpus, and there must be a sufficient corpus to obtain a more ideal result; the accuracy rate is not high, because many related words in the probabilistic sense are not terms; the low frequency terms cannot be identified; and due to the need to perform many calculations, it is easy to cause operational efficiency problems.
The methods based on machine learning refer to the extraction of terms through machine training text features and constructing models. This method can compensate for the shortcomings of other methods that cannot identify low-frequency terms, and use the data learning models to determine the possibility of whether the word string is a term. Common machine learning methods include the maximum entropy model28 and the conditional random field model29,30,31. However, the methods based on machine learning have high requirements on the scale and quality of the training corpus, and a large-scale manual annotation corpus is required as the training data. Moreover, the methods are not yet mature, and more attempts and verifications are needed. There is currently no targeted, complete, and large-scale annotated corpus in patent literature.
The term extraction methods based on deep learning primarily combine the latest deep learning technologies to automatically extract terminology. It is a special machine learning method based on representation learning of data32 that can solve the problem of manually selecting the best feature in the extracted terms. Related studies have applied the deep learning methods based on neural networks to term extraction, for example, combining SVM33, Markov decision process34, Bi-LSTM35,36,37, CNN38,39, etc., to conduct research in order to avoid manual feature extraction and other issues. However, the methods highly rely on a large-scale annotated corpus, and manual annotation of the corpus is time-consuming and labour-intensive.
Currently, some new methods have appeared in the field of automatic term extraction, such as the term extraction methods based on semantic correlation, the extraction methods based on graphs, and so on. The extraction methods based on semantic correlation mainly use the semantic relationship between phrases to improve the ranking of terms, and thereby increase the accuracy of term extraction. Lahbib et al.40 applied the idea of semantic correlation to the field of bilingual term extraction, and extracted the source-end terms specific to the field. Astrakhantsev et al.41 proposed the KeyConceptRelatedness (KCR) method, which applied key concepts in the field to measure the quality of candidate terms. Yu et al.42 presented CBDLP,a data leakage prevention model based on confidential terms and their context terms. The graph-based term extraction methods are inspired by the ranking method of web page importance in PageRank. Mihalcea et al.43 first applied PageRank to the field of natural language processing(NLP), and proposed a TextRank method to extract key words. Semantic Graph-Based Concept Extraction (SGCCE), a novel concept extraction method was proposed by Qiu et al.44. Khan et al.45 presented the Term Ranker method, constructed an undirected weighted graph and improved the score of low-frequency terms.
In summary, related methods based on rules, statistics, machine learning, deep learning, etc. have all been used for technical term extraction, and these methods have their own advantages and disadvantages. Based on the existing research, this paper extracts the part-of-speech rules and grammatical rules of the terms in accordance with the strong domain characteristics of patent terms and constructs a Chinese patent term extraction model based on DC-value and information entropy theory.
The difference between Chinese and English in the process of extracting technical terms
The biggest difference between Chinese and English is that in English, a "word" is used as the unit, where a single word can express a precise meaning, while in Chinese, the unit is generally a "character", and current Chinese emphasizes that "two-syllable words dominate". That is, it is difficult for each individual character to express a complete meaning. At least two characters are combined to form a word that has an accurate meaning.
At the same time, each word in English is divided by "spaces". Therefore, when extracting English terms, it is easy to extract individual words, but when extracting Chinese terms, it is difficult to express a complete meaning for each individual character, so usually words composed of multiple characters are extracted. In addition, English belongs to inflectional language, while Chinese is an isolated language. Thus, there are the following differences between English and Chinese: ① There are relatively rich inflections in English, and the relationship between words is expressed through inflections. ② An inflectional morpheme can express several different grammatical meanings in English. ③ The word order is strict in Chinese. Due to the lack of morphological changes in isolated words, there is no morphological sign of what component a word belongs to in a sentence; it is completely determined according to the word order. ④ Function words are very important in Chinese. The relationship between words in isolated languages is often reflected by function words, an important grammatical means.
Terminology and patent terminology
-
A.
Basic principles of terminology structure
Terms are a type of language representation of concepts in a certain technology domain, and may be words, phrases, letters or digital symbols. According to the structure of terms, they can be divided into simple terms and complex terms46. Among them, the simple terms are composed of only one word, for example, "communication" and "information"; while complex terms can be broken down into smaller units with an independent meaning, for example, "communication apparatus" is made up of "communication" and "apparatus".
-
B.
Features of patent terminology
Because patent literature belongs to S&T literature, the terms extracted from patent literature have general characteristics of S&T terminology. The characteristics are roughly summarized as follows47:
-
C.
Existing headwords. There are a few basic terms frequently appearing in a certain technology domain, which are very important and may be headwords. Then you can find that in the domain, many complex terms consist of the headwords in nominal structure or predicate structure. For example, in the password domain, a term that often appears is the word "key", which could be seen as the headword, to constitute the nominal structure, such as "session key", "master key", etc.; or the predicate structure, such as "key management", "key update", etc. Thus,a large number of compound terms are formed. In this technology domain, the word "key" is a headword.
-
D.
Existing nested relationship among terms. Some complex terms are iteratively combined by simple terms, so there is a nested relationship among terms. For example, the nested relationship among "symmetric cryptography algorithms", "cryptography algorithms", and "algorithms" can be seen.
-
E.
Constituting connecting structure by symbols. Terms are composed of symbols ("/", "-", ".", "_", etc.), such as "MH/NI battery", "D-H key exchange protocol", etc.
-
F.
Combining English words with Chinese words to construct terms. Many terms are composed of both Chinese words and English words together to form technical terms.
-
G.
Greater difference in length. There are not only existing terms with 2 or 3 characters, such as "电池" and "电动机", but also existing terms with lengths greater than 6 or 10, such as "反应式步进电机" and "管式固体氧化物燃料电池".
-
H.
Uneven distribution in different domain. Because of the great difference in technical content in different technology domains, terms are closely related to technology domains, namely, the terms frequently appear in a technology domain but rarely emerge in other technology domains.
Patents can be products, production methods, or technical schemes48. In addition to the general characteristics of S&T terminology, patent terminology also has its own uniqueness, which is roughly as follows:
-
The vast majority of patent terminology expresses the specific entity of objects, components, and other objective existences. This type of terms must include nouns that act as headwords.
-
There exist a few terms representing abstract concepts of crafts and methods. These terms are mainly composed of verbs, and a few nouns, for example, "weld", "extract", "forge", etc.
-
A term with more characters is, generally speaking, the object mainly described by the patent literature. The type of terms represent the latest technology frontier and need to be given significant attention, such as "electronic control gasoline injection engine", "plug-in series hybrid electric vehicle" and so on.
Terminology extraction method based on domain C-value and information entropy
-
A.
Framework of terminology extraction
According to the characteristics of patent literature, the framework of technical terminology extraction is constructed, which is shown in Fig. 1.
The terminology extraction system is mainly composed of three parts: the text preprocessing module, the candidate terms extraction module and the terms filtration module.
-
B.
Domain C-value (abbreviated as DC-value)
The C-value method is a type of hybrid terminology extraction method combining linguistic rules and statistical theory17. The calculation formula of the C-value is shown in Eq. (1)49:
where s represents a candidate term, |s| refers to the length of candidate term s, whose value is the number of characters included by s; f(s) represents the appearance frequency of s; bi represents the candidate terms nesting s; and n(bi) is the number of bi.
However, the technical terms have the characteristics of domain correlation. The domain terms frequently appear or only appear in the texts belonging to a certain domain, while they rarely or never appear in other domains50. Therefore, the C-value method is optimized in this paper with the introduction of a background corpus51. Then the corpus is composed of two parts, the domain corpus and background corpus, based on which the domain C-value is constructed for the preliminary extraction of the candidate terms.
-
(1)
Domain C-value (DC-value)
DC-value is set as Eq. (2)
where s represents a candidate term; |s| refers to the length of s; sf(s) represents the frequency of s appearing in the domain corpus; bi represents the extracted candidate terms nesting s; sc(bi) is the number of bi in the domain corpus; and bf(s) represents the frequency of s appearing in the background corpus.
The extraction accuracy and performance of low-frequency words are effectively improved through the DC-value algorithm. However, the unithood feature is not considered. Aiming at this problem, the method of information entropy is introduced in subsequent research to ensure the integrity of the obtained terms.
-
III.
Information entropy method
Information entropy in information theory represents the uncertainty of random variables. The more uncertain a random variable is, the larger its entropy value is. In the terminology extraction, the information entropy is mainly used to calculate the uncertainty of the boundaries of strings. The more uncertain the border of a string is, the larger the information entropy is. Then the string is more likely to be a complete term52,53.
The border uncertainty of strings is measured by computing the left and right information entropy of strings in this paper. For example, in the following paragraph "本发明提供一种转矩传感器以及动力转向装置。在具有一对解算器的转矩传感器中, 能够将上述两解算器的特性用作转矩传感器。" , the string “转矩传感器” has appeared a total of 3 times. Its left adjacent words successively are "种", "的" and "作", and its right adjacent words successively are "以", "中" and "。". In the entire corpus, the string "转矩传感器" appeares a total of 27 times. The number of different left adjacent words amounts to 15, and the number of different right adjacent words is 19. It can be seen that the left and right adjacent words are not fixed. Therefore, it can be inferred that "转矩传感器" is likely to be a complete phrase, or even a term.
In the study of whether the phrase of "转矩传感" is complete or not, the phrase "转矩传感" appeares 29 times. The different left adjacent words are 19, while the right ones are only 2. Thus, "转矩传感" is not suitable to be a complete phrase. Therefore, the uncertainty of this string collocation is estimated by calculating the information entropy of the string.Then, the formulas of the left and right information entropy are defined as follows54:
where s is the candidate term, IE(s)L and IE(s)R respectively represent the left and right information entropy of s, l is the left adjacent word of s, ls is the phrase composed of l and s, p(ls|s) means the conditional probability that l is the left adjacent word of s in the case of the appearance of s, r is the right adjacent word of s, sr is the phrase consisting of s and r, and p(sr|s) means the conditional probability that r is the right adjacent word of s in the case of the appearance of s. The smaller IE(s)L and IE(s)R and the more fixed the left and right adjacent words are, then the less likely it is that s is an independent phrase.
To comprehensively evaluate the possibility of s standing alone as a phrase, the threshold values of the left and right information entropy are set to filter candidate strings that cannot stand alone as phrases53. The setting of the threshold is shown in the formula:
where IEmin is a constant,it represents the minimum information entropy of word boundary and is set manually.
-
IV.
Terminology filtration
In order to extract terms more fully and effectively, terminology filtering rules are set through a large amount of corpus analysis. The lexical rules and structural characteristics of Chinese patent terms are as follows:
-
Location words, state words, interjections, and pronouns are not included in the terms;
-
Terms should not begin with conjunctions, auxiliary words, or suffixes;
-
Terms should not end with orientation words, auxiliary words, conjunctions, or prefixes;
-
Nouns or verbs must be contained in terms;
-
Adjectives and adverbs cannot stand alone as terms55;
-
Focus on filtering symbols (such as "-", ". ", "_", "/", etc.);
-
Focus on filtering the candidate terms containing English marks;
-
The length of every term is less than 15;
-
When a word does not appear in the stop word list and its part of speech is shown in Table 1, it needs to be filtered as a stop word.
Experiment and results
-
A.
Datasets construction
In this paper, the public service platform of Shanghai intellectual property (https://www.shanghaiip.cn/search/#/home) is applied as a patent retrieval database. The attributes of title, abstract, claims and international patent classification (IPC) are applied to retrieve the relevant patents, in which patents in the domain of information and communication are used as the domain dataset and patents in the domain of electric vehicles are used as the background dataset. We respectively selected 30,000 Chinese invention patents from the field of information and communication and the field of electric vehicles, where the retrieval time range was from 2010 to 2020. Then, a total of 60,000 items are used to construct a Chinese patent dataset. Among them, 20,000 items are respectively taken from the domain dataset and background dataset, and a total of 40,000 items are used as the training set. 10,000 items are separately taken from the domain dataset and the background dataset, and a total of 20,000 items are used as the test set.
To generate the initial candidate terms, we used the corresponding analysis tools and relational corpus-Chinese lexical analysers Language Technology Platform (LTP) and ACE RDC 2005 (Automatic Content Extraction Relation Detection and Characterization) Chinese corpus to perform data preprocessing for the domain dataset and background dataset. LTP provides a series of Chinese natural language processing tools that can be used to perform word segmentation, part-of-speech tagging, and syntactic analysis of Chinese text. The ACE RDC 2005 Chinese corpus contains three fields information——newswire, broadcast conversations and newspaper, and includes 85,575 relation instances, in which there are 8,469 positive instances. In this paper, LTP is applied to segment sentences into words and assign each word a POS tagging; ACE RDC 2005 is then used to merge synonyms or similar words. After the data preprocessing work has been completed, 50,129 initial candidate terms are obtained.
Table 2 shows the number of candidate terms after different selection and filtration steps. The results of each step are based on the results of the previous step.
Finally, we successfully reduced the size of the candidate set from 50,129 to 3921.
-
B.
Experimental results
For ease of application, a technical terminology extraction tool has been developed. The tool interfaces are shown in Figs. 2 and 3.
The terms are then extracted by applying the extraction tools based on the methods of DC-value and information entropy algorithms. The results are shown in Table 3.
-
III.
Result analysis
Generally, two indicators, P (precision) and R (recall rate), are used to evaluate the effect of the term extraction. However, in a corpus that has not all been manually tagged, it is difficult to determine the total number of terms it contains. Therefore, an alternative method is adopted, that is, P is expressed as a percentage of the number of terms correctly extracted to the total number of terms extracted by the system; and R is expressed as the percentage of the number of terms correctly extracted by the system to the total number of manually tagged terms48.
Among them, the number of manually tagged terms were obtained by extracting 175 documents according to each IPC subcategory in the domain corpus. Finally, a total of 2625 documents were extracted, and a total of 559 manually tagged terms were obtained.
To comprehensively evaluate the effect of the term extraction algorithm, the F-score evaluation index can be used, which is the harmonic mean of P and R, and the calculation formula is as follows8:
In this paper, 60,000 patent documents in the domain of information and communication and in the domain of electric vehicles were processed through the extraction algorithms based on DC-value and information entropy. According to the extraction results of technical terminology, the P, R and F-Score indicators are calculated.
To truly reflect the performance of the term extraction method based on the DC-value and information entropy proposed in this paper, several current mainstream term extraction methods are used for a comparison. These methods include the C-value, likelihood ratio, and mutual information methods.
Part of the contrastive result and the performance comparison between the method proposed in this paper and the other three methods for the extraction of technical terminology are shown in Tables 4 and 5:
Table 4 shows the extraction results of technical terminology by three different algorithms. Aiming at the same candidate terms, the judging result may be different.
Table 5 shows that the P, R and F-Score values of the terminology extraction algorithm based on the DC-value and Information Entropy are 82.79%, 85.51% and 84.13%, respectively, which is significantly better than the ones based on C-value, Log-likelihood estimation and mutual information methods. Therefore, the validity of the algorithm proposed in the paper is verified.
At the same time, the experiment has compared the results of the four methods when 200, 400, 600, 800 and 1000 terms are extracted. The experimental results show as the number of extracted terms increases, the precision is decreasing, the recall rate is increasing, and F-Score is also increasing. The precision and recall rate of the first 1000 extracted terms among the four methods are compared, as shown in Figs. 4 and Figs. 5. In precision, the DC-value and information entropy method is 37%, 10% and 6% higher than the information entropy, log-likelihood ratio and mutual information methods, respectively. In recall rate, the DC-value and information entropy method is 49%, 7% and 11% higher than the information entropy, log-likelihood ratio and mutual information methods, respectively.
Through the analysis of experimental results, the method in this paper has been significantly improved compared with other methods.
-
(1)
Compared with the methods based on machine learning, the method in this paper does not require high-quality training corpus, and need not to spend a lot of time for corpus training. At the same time, through empirical studies in the fields of "biodegradable plastics", "carbon capture" and other fields, the effects are similar to the above, verifying that the method is applicable to various professional fields.
-
(2)
The extraction effect of combined terms and long terms is better. Due to the introduction of the background corpus, the setting of nested terms, the discrimination of term boundaries, etc., term recognition is more accurate. Through the analysis of the first 1000 candidate terms extracted, the extraction ratio of terms with 6 characters and above is higher than the extraction ratio of terms with less than 6 characters. For example, the term “生物降解专用树脂 (biodegradable special resin)” and the term "高强度导电聚乙烯醇 (high-strength conductive polyvinyl alcohol)" are both accurately extracted.
Conclusion
Automatic term extraction is an important issue in natural language processing, and is the basis of patent mining and analysis. China currently attaches great importance to technological development, and China's patent applications have surged. Many (S&T) managers and researchers in different organizations urgently need conduct in-depth mining and analysis of massive Chinese patents in order to formulate accurate and effective technology research and development strategies. However, many existing approaches focus on extracting the domain terms in English and are difficult to extend to Chinese due to the distinctions between Chinese and English languages. Therefore, this paper proposed a Chinese patent term extraction method based on DC-value and information entropy to achieve automatic extraction of technical terms in Chinese patents.
Based on the traditional C-value method, this paper constructs the DC-value method to measure the termhood of terms. According to the characteristics of the terms, the relationship between terms and the context of terms is considered, and the left and right information entropy are used to calculate the boundary uncertainty of the strings. Through the above work, the selection of technical terms is completed according to the features of termhood and unithood. In addition, through the analysis of the structural features and lexical rules of Chinese patent terms, the filtering of technical terms is completed. The experiments show that the method in this paper has achieved better extraction results.
To improve the speed and accuracy of the algorithm, in future work, we will introduce association rules into the term extraction research to calculate the relevance of words, construct the relational structure of words or phrases and obtain domain terms. By deeply exploring the technology of automatic machine learning semantic relations between terms, the effectiveness and intelligence of term extraction can be improved.
References
Gu, J. & Wang, H. Study on term extraction on the basis of Chinese domain texts. N. Technol. Lib. Inf. Serv. 4, 29–34 (2011) (in Chinese).
Wang, Q., Li, Y. & Zhang, P. Automatic term extraction in the field of information technology. Terml. Std. Inf. Technol. 1, 32–33 (2003) (in Chinese).
Liang, A. On the development of terminological knowledge engineering. Terml. Std. Inf. Technol. 2, 4–10 (2007) (in Chinese).
Lin, Y., Chen, Z. & Sun, Q. Computer domain term automatic extraction and hierarchical structure building. Comput. Eng. 37, 172–174 (2011) (in Chinese).
Han, H. & An, X. Chinese scientific and technical term extraction by using C-value and unithood measure. Lib. Inf. Serv. 56, 85–89 (2012) (in Chinese).
Liu, C. Y. & Yang, J. C. Decoding patent information using patent maps. Data Sci. J. 7, 14–22 (2008).
Kisik, S., Kyuwoong, K. & Sungjoo, L. Identifying promising technologies using patents: A retrospective feature analysis and a prospective needs analysis on outlier patents. Technol. Forecast. Soc. Change. 128, 118–132 (2018).
Fu, J., Fan, X., Mao, J. & Yu, Z. An algorithm of Chinese domain term extraction based on language feature. Trans. B. Inst. Technol. 30, 307–310 (2010) (In Chinese).
Tatar, S. & Cicekli, I. Automatic rule learning exploiting morphological features for named entity recognition in Turkish. J. Inf. Sci. 37, 137–151 (2011).
Zhang, X., Dai, Y. & Gao, Z. Applying syntactic patterns to semantic relation extraction from a terminology dictionary. Eng. Technol. 8, 43–45 (2008) (in Chinese).
Lee, J., Yi, J. S. & Son, J. Development of automatic-extraction model of poisonous clauses in international construction contracts using rule-based NLP. J. Comput. Civ. Eng. 33, 04019003 (2019).
Shao, W., Hua, B. & Song, L. A pattern and POS auto-learning method for terminology extraction from scientific text. Data Inf. Manag. 5, 329–335 (2021).
Déjean, H., Gaussier, R. & Sadat, F. Bilingual terminology extraction: An approach based on a multilingual thesaurus applicable to comparable corpora [EB/OL]. [2022-08-11]. https://www.xrce.xerox.com/content/download/23595/171307/file/dejean.pdf (2020).
Kageura, K. & Umino, B. Methods of automatic term recognition: A review. Terminology. 3, 259–289 (1996).
Salton, G. & Buckley, C. Term-weighting approaches in automatic text retrieval. Inform. Process. Manag. 24, 513–523 (1988).
Lossio-Ventura, J. A., Jonquet, C., Roche, M. & Teisseire, M. Biomedical terminology extraction: A new combination of statistical and web mining approaches. In Proc. of the JADT. 2014, 421–432 (2014).
Frantzi, K., Ananiadou, S. & Mima, H. Automatic recognition of multi-word terms: The c-value/nc-value method. Int. J. Digit. Lib. 3, 115–130 (2000).
Astrakhantsev, N. Methods and software for terminology extraction from domain-specific text collection [Ph.D. Thesis]. Institute for System Programming of Russian Academy of Sciences (2015).
Zhang, Q. L. & Sui, Z. F. Measuring termhood in automatic terminology extraction. In Proceedings of the International Conference on Natural Language Processing and Knowledge Engineering, 328–335 (IEEE Press, 2007).
Hua, W. & Zhang, H. Y. Extraction of Chinese term based on chi-square test. Comput. Appl. 27, 3019–3025 (2007) (in Chinese).
Montgomery, D. C. & Runger, G.C. Applied Statistics and Probability for Engineers. 7th ed. 208–211 (Wiley, 2018).
Dunning, T. Accurate methods for the statistics of surprise and coincidence. Comput. Linguist. 19, 61–74 (1993).
Verberne, S., Sappeli, M., Hiemstra, D. & Kraaij, W. Evaluation and analysis of term scoring methods for term extraction. Inform. Retr. J. 19, 510–545 (2016).
Dong, Y. Y., Li, W. H. & Hu, H. Domain term extraction method based on hierarchical combination strategy for Chinese Web documents. J. Northwest. Polytech. Univ. 35, 729–735 (2017) (in Chinese).
Li, L. The research of term and relation acquisition methods for domain ontology learning, Ph.D. Dissertation. Dalian Univ. Technol. 63–69 (2013) (in Chinese).
Church, K. W. & Hanks, P. Word association norms, mutual information, and lexicography. Comput. Linguist. 16, 22–29 (1990).
Zeng, W., Xu, S., Zhang, Y. & Zhai, J. The research and analysis on automatic extraction of science and technology literature terms. Lib. Inform. Technol. 1, 51–55 (2014) (in Chinese).
Muheyat,·N. & Kunsaule,·T.,. Research on Automatic Identification of IT Terms in Kazakh. J. China Inform. Process. 30, 68–73 (2016) (In Chinese).
Mozharova, V. A. & Loukachevitch, N. V. Combining knowledge and CRF-based approach to named entity recognition in Russian. In International Conference on Analysis of Images, Social Networks and Texts. 185–195 (Springer, 2016).
Wang, H., Wang, M. & Su, X. A study on Chinese patent terms extraction for ontology learning. J. China Soc. Sci. Technol. Inform. 35, 573–585 (2016) (in Chinese).
Zeng, D., Sun, C., Lin, L. & Liu, B. LSTM-CRF for drug-named entity recognition. Entropy 19, 283–295 (2017).
Gu, Z. et al. Gradient shielding: Towards understanding vulnerability of deep neural networks. IEEE Trans. Netw. Sci. Eng. 8, 921–932 (2021).
Hu, N., Tian, Z., Lu, H., Du, X. & Mohsen, G. A multiple-kernel clustering based intrusion detection scheme for 5G and IoT networks. Int. J. Mach. Learn. Cybern. 12, 3129–3144 (2021).
Pan, M. et al. DHPA: Dynamic human preference analytics framework: A case study on taxi drivers’ learning curve analysis. ACM. Trans. Intell. Syst. Technol. 11, 1–19 (2020).
Liu, Y., Yin, L. & Zhang, K. Deep transfer learning for technical term extraction-A case study in computer numerical control system. J. Intell. 38, 168–175 (2019).
Miwa, M. & Bansal, M. End-to-end relation extraction using LSTMs on sequences and tree structures. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Association for Computational Linguistics, 2016).
Geng, Z., Chen, G., Han, Y., Lu, G. & Li, F. Semantic relation extraction using sequential and tree-structured LSTM with attention. Inform. Sci. 509, 183–192 (2020).
Khosla, K., Jones, R. & Bowman, N. Featureless Deep Learning Methods for Automated Key-Term Extraction (Stanford University, 2019).
Xu, D. et al. Deep learning based emotion analysis of microblog texts. Inform Fusion. 64, 1–11 (2020).
Lahbib, W., Bounhas, I. & Slimani Y. A possibilistic approach for Arabic domain terminology extraction and translation. In Proc. of the Int’l Symp. on Computer and Information Sciences 231–238 (Springer, 2018).
Astrakhantsev, N. Automatic term acquisition from domain-specific text collection by using Wikipedia. Proc. Inst. Syst. Program. RAS. 26, 7–20 (2014).
Yu, X., Tian, Z., Qiu, J. & Jiang, F. A data leakage prevention method based on the reduction of confidential and context terms for smart mobile devices. Wirel. Commun. Mob. Comput. 2018, 1–11 (2018).
Mihalcea, R. & Tarau, P. Textrank: Bringing order into text. In Proc. of the EMNLP 404–411 (ACL, 2004).
Qiu, J., Chai, Y., Tian, Z., Du, X. & Guizani, M. Automatic concept extraction based on semantic graphs from big data in smart city. IEEE Trans. Comput. Soc. Syst. 7, 225–233 (2019).
Khan, M. T., Ma, Y. & Kim, J. Term ranker: A graph-based re-ranking approach. In Proc. of the 29th Int’l Florida Artificial Intelligence Research Society Conf. 310–315 (AAAI Press, 2016).
Wang, H. & Li, G. Research of automatic term wxtraction based on association rules. Lib. Inform. 5, 20–25 (2014) (In Chinese).
Chen, S. & Yu, B. Model of automatic term extraction for technology domain. Syst. Eng. Theory Prac. 33, 230–235 (2013).
Xu, X. & Cai, H. Ontology and rule-based natural language processing approach for interpreting textual regulations on underground utility infrastructure. Adv. Eng. Inform. 48, 1–16 (2021).
Ji, P., Yan, X. Y. & Cen, Y. A survey of term recognition and extraction for domain-specific Chinese text information processing. Lib. Inf. Serv. 54, 124–129 (2010) (in Chinese).
Zhu, Q. & Leng, F. Existing problems and developing trends of automatic term recognition. Lib. Inf. Serv. 56, 104–109 (2012) (in Chinese).
Xiong, L., Tan, L. & Zhong, M. An automatic term extraction system of improved C-value based on effective word frequency. N. Technol. Lib. Inf. Serv. 9, 54–59 (2013) (in Chinese).
Patry, A. & Langlais, P. Corpus-based terminology extraction. In 7th International Conference on Terminology and Knowledge Engineering Copenhagen, Denmark 313–321 (2005).
Li, L. The Research of term and relation acquisition methods for domain ontology learning, Ph.D. Dissertation, Dalian Univ. Technol 63–69 (2013) (in Chinese).
Ren, H. & Zeng, J. A Chinese word extraction algorithm based on information entropy. J. Chin. Inform. Proc. 20, 40–43 (2006) (in Chinese).
Zhou, L., Zhang, L., Feng, C. & Huang, H. Terminology extraction based on statistical word frequency distribution variety. Comp. Sci. 36, 177–180 (2009) (in Chinese).
Acknowledgements
This study was supported by the National Key R&D Program of China (2021YFE0101300), the National Social Science Foundation (15CTQ031), Research on Patent Quality Evaluation Method (ZBBZK-2021-012), Beijing Social Sciences Foundation (14JGC113), and Beijing Natural Science Foundation (9132004).
Author information
Authors and Affiliations
Contributions
Z.L.W.: conceptualization, methodology, software, model development, writing-original draft preparation, and manuscript revision.
Corresponding author
Ethics declarations
Competing interests
The author declares no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Liwei, Z. Chinese technical terminology extraction based on DC-value and information entropy. Sci Rep 12, 20044 (2022). https://doi.org/10.1038/s41598-022-23209-6
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-022-23209-6
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.