|
View: |
Part 1: Document Description
|
|
Citation |
|
|---|---|
|
Title: |
Replication data for: Measure schematicity through information content: A quantitative approach to grammaticalization |
|
Identification Number: |
doi:10.18710/APTUHA |
|
Distributor: |
DataverseNO |
|
Date of Distribution: |
2025-09-03 |
|
Version: |
1 |
|
Bibliographic Citation: |
Zhang, Liulin, 2025, "Replication data for: Measure schematicity through information content: A quantitative approach to grammaticalization", https://doi.org/10.18710/APTUHA, DataverseNO, V1 |
|
Citation |
|
|
Title: |
Replication data for: Measure schematicity through information content: A quantitative approach to grammaticalization |
|
Identification Number: |
doi:10.18710/APTUHA |
|
Authoring Entity: |
Zhang, Liulin (Soochow University) |
|
Producer: |
Soochow University |
|
Software used in Production: |
AntConc |
|
Distributor: |
DataverseNO |
|
Distributor: |
The Tromsø Repository of Language and Linguistics (TROLLing) |
|
Access Authority: |
Zhang, Liulin |
|
Depositor: |
Zhang, Liulin |
|
Date of Deposit: |
2023-01-27 |
|
Holdings Information: |
https://doi.org/10.18710/APTUHA |
|
Study Scope |
|
|
Keywords: |
Arts and Humanities, morpheme bigram, schematicity, gradience, gradualness, Chinese, English |
|
Abstract: |
This is a study to propose a quantitative method to compute the schematicity of constructions, which is a key indicator of the level of grammaticalization of morphemes. In this method, to estimate the schematicity of a schema made up of two morphemes, i.e., X_ (X is the target morpheme and _ represents an open slot), we need to know the total token frequency of all types of X_, and the token frequencies of all kinds of elements occurring in the open slot. For example, if we are interested in the schematicity of “_ment”. We need to know the total token frequency of “_ment”, which is the sum of the frequencies of “shipment”, “equipment”, “employment”, “appointment” … (all types of “_ment”). We also need to know the token frequencies of “ship”, “equip”, “employ”, “appoint” … (all types of elements occurring in the open slot). Therefore, the data are morpheme bigrams (2-gram) generated from the English and Chinese corpora showing what morphemes can each morpheme combine with, together with the token frequency of each bigram, and the token frequencies of its two components respectively. |
|
Time Period: |
400BC-301BC500BC-401BC0700-09001640-16401989-19931990-2015 |
|
Date of Collection: |
2023-01-01-2023-01-31 |
|
Country: |
China |
|
Kind of Data: |
annotated corpus data |
|
Methodology and Processing |
|
|
Sources Statement |
|
|
Data Sources: |
<p>The Manually Annotated Sub-Corpus (MASC) of the Open American National Corpus (<a href="https://anc.org/data/masc/" title="MASC Corpus" target="_blank">https://anc.org/data/masc/</a>), used under the conditions of the <a href="http://creativecommons.org/licenses/by/3.0/us/" title="CC BY 3.0 US" target="_blank">Creative Commons Attribution 3.0 United States License</a>.</p> |
|
<p>A self-built Chinese corpus comprising of texts from five historical periods, including: <ol type="1"> <li>Zuozhuan (《左传》), about 180,000 characters, the 4th century BCE;</li> <li>Shishuoxinyu (《世说新语》), about 79,000 characters, the 5th century AE;</li> <li>Six vernacular stories from Bianwen (《变文》), i.e.,《刘家太子变》《 大目乾连冥间救母变文》《降魔变文》《降魔变柙座文》《八相变》《汉将王陵变》, about 40,000 characters, 700-900 AE;</li> <li>Four novels from Sanyan Erpai (《三言二拍》), i.e.,《施润泽滩阙遇友》《杜十娘怒沉百宝箱》《蒋兴哥重会珍珠衫》《卖油郎独占花魁》, about 70,000 characters, around 1640 AE;</li> <li>Five novels written by Wang Shuo (王朔), i.e.,《你不是个俗人》《玩的就是心跳》《顽主》《无人喝彩》《与青春有关的日子》, about 490,000 characters, Contemporary Modern Mandarin.</li> </ol> </p> <p></p> <p>The extracted words from these texts that are contained in the data files of this dataset only represent an insignificant part of the corpus, and they do not represent coherent text. Therefore, the reuse (including redistribution) of these words is permitted by the exceptions rules in IPR and database protection regulations, such as Fair use (USA cf. <a href="https://www.copyright.gov/fair-use/more-info.html" title="Fair use" target="_blank">US Copyright Act</a>), Fair dealing (UK; cf. <a href="https://www.gov.uk/guidance/exceptions-to-copyright" title="Fair dealing" target="_blank">Exceptions to copyright</a>), "sitatretten" (Norway; cf. <a href="https://lovdata.no/lov/2018-06-15-40/§29" title="sitatretten" target="_blank">§ 29 i Åndsverkloven</a>).</p> |
|
|
Data Access |
|
|
Notes: |
<a href="http://creativecommons.org/licenses/by/4.0">CC BY 4.0</a> |
|
Other Study Description Materials |
|
|
Related Publications |
|
|
Citation |
|
|
Title: |
Zhang, L., & Tao, J. (2025). Measure schematicity through information content. Language and Linguistics, 26(2), 323-354. https://doi.org/https://doi.org/10.1075/lali.00189.zha |
|
Identification Number: |
10.1075/lali.00189.zha |
|
Bibliographic Citation: |
Zhang, L., & Tao, J. (2025). Measure schematicity through information content. Language and Linguistics, 26(2), 323-354. https://doi.org/https://doi.org/10.1075/lali.00189.zha |
|
Label: |
00_ReadMe_Measure_schematicity_through_information_content.txt |
|
Notes: |
text/plain |
|
Label: |
01_EnglishData.csv |
|
Text: |
Morpheme bigrams of the Manually Annotated Sub-Corpus (MASC) of the Open American National Corpus (https://anc.org/data/masc/). The first column “FrequencyRank” is the frequency rank of the bigram. The second column “Frequency” is the frequency of the bigram. The third column “M1” is the first morpheme of the bigram. The fourth column “M2” is the second morpheme of the bigram. The fifth column “M1Frequency” is the frequency of the first morpheme of the bigram. The sixth column “M2Frequency” is the frequency of the second morpheme of the bigram. |
|
Notes: |
text/csv |
|
Label: |
02_ChineseData.csv |
|
Text: |
Morpheme bigrams of the self-built corpora of five historical periods of Chinese. The first column “Frequency” is the frequency of the bigram. The second column “C1” is the first morpheme of the bigram. The third column “C2” is the second morpheme of the bigram. The fourth column “C1Frequency” is the frequency of the first morpheme of the bigram. The fifth column “C2Frequency” is the frequency of the second morpheme of the bigram. The sixth column “Time” indicates the historical period. |
|
Notes: |
text/csv |