View: |
Part 1: Document Description
|
Citation |
|
---|---|
Title: |
Replication data for: Who needs particles? A challenge to the classification of particles as a part of speech in Russian |
Identification Number: |
doi:10.18710/700FNV |
Distributor: |
DataverseNO |
Date of Distribution: |
2016-03-29 |
Version: |
1 |
Bibliographic Citation: |
Endresen, Anna; Janda, Laura A.; Reynolds, Robert; Tyers, Francis M., 2016, "Replication data for: Who needs particles? A challenge to the classification of particles as a part of speech in Russian", https://doi.org/10.18710/700FNV, DataverseNO, V1 |
Citation |
|
Title: |
Replication data for: Who needs particles? A challenge to the classification of particles as a part of speech in Russian |
Identification Number: |
doi:10.18710/700FNV |
Authoring Entity: |
Endresen, Anna (UiT The Arctic University of Norway) |
Janda, Laura A. (UiT The Arctic University of Norway) |
|
Reynolds, Robert (UiT The Arctic University of Norway) |
|
Tyers, Francis M. (UiT The Arctic University of Norway) |
|
Producer: |
UiT The Arctic University of Norway |
Date of Production: |
2016 |
Grant Number: |
222506 |
Distributor: |
DataverseNO |
Distributor: |
The Tromsø Repository of Language and Linguistics (TROLLing) |
Access Authority: |
Janda, Laura A. |
Date of Deposit: |
2016-03-28 |
Date of Distribution: |
2016 |
Holdings Information: |
https://doi.org/10.18710/700FNV |
Study Scope |
|
Keywords: |
Arts and Humanities, Russian, Hidden Markov Model |
Topic Classification: |
Field: Lexis, Time-depth: synchronic, Topic: particles |
Abstract: |
In 1985, Zwicky argued that “particle” is a pretheoretical notion that should be eliminated from linguistic analysis. We propose a reclassification of Russian particles that implements Zwicky’s directive. Russian particles lack a coherent conceptual basis as a category and many are ambiguous with respect to part of speech. Our corpus analysis of Russian particles addresses theoretical questions about the cognitive status of parts of speech and practical concerns about how particles should be represented in computational models. We focus on nine high-frequency words commonly classed as particles: ešče, tak, ved’, slovno, daže, že, li, da, net. We show that current tagging of particles in the manually disambiguated Morphological Standard of the Russian National Corpus (RNC) is not entirely consistent, and that this can create challenges for training a part-of-speech tagger. We offer an alternative tagging scheme that eliminates the category of “particle” altogether. We show that our enriched scheme makes it possible for a part-of-speech tagger to achieve more useful results. Our analysis of particles provides a detailed account of various sub-uses that correspond to different parts of speech, their relationships, and relative distribution. In this sense, our study also contributes to the study of words that exhibit part-of-speech ambigu ities. We construct a database by extracting from the RNC gold standard 100 random sentences for each of the nine focus words. This database is used for both training and testing a Hidden Markov Model (HMM) trigram tagger (Halácsy et al. 2007), which is the standard model for training part-of-speech tagging. This is done in two rounds: in Experiment 1 we use the tagging of the nine words as in the RNC, including the use of “particle” as a tag; in Experiment 2 we use our own tagging scheme which eliminates “particle” as a tag. In both experiments we partition our database into ten chunks and perform a ten-fold cross-validation, each time using 90 sentences as the training set and 10 sentences as the test set. This means that each part of the total set is tested in the course of the ten repetitions of training and testing. |
Geographic Coverage: |
Russia, Russia |
Kind of Data: |
corpus |
Methodology and Processing |
|
Sources Statement |
|
Data Access |
|
Other Study Description Materials |
|
Related Publications |
|
Citation |
|
Title: |
Endresen, A., Janda, L. A., Reynolds, R., & Tyers, F. M. (2016). Who needs particles? A challenge to the classification of particles as a part of speech in Russian / Кому нужны частицы? Стоит ли определять частицы как отдельную часть речи в русском языке? Russian Linguistics, 40(2), 103–132. http://www.jstor.org/stable/43945159 |
Identification Number: |
https://www.jstor.org/stable/43945159 |
Bibliographic Citation: |
Endresen, A., Janda, L. A., Reynolds, R., & Tyers, F. M. (2016). Who needs particles? A challenge to the classification of particles as a part of speech in Russian / Кому нужны частицы? Стоит ли определять частицы как отдельную часть речи в русском языке? Russian Linguistics, 40(2), 103–132. http://www.jstor.org/stable/43945159 |
Label: |
DATABASE particles.csv |
Text: |
This is a spreadsheet of our database, which was used in both Experiment 1 and Experiment 2. |
Notes: |
text/plain; charset=UTF-8 |
Label: |
experiment.tar.gz |
Text: |
This file contains all the data and code needed to run Experiment 1 and Experiment 2. |
Notes: |
application/x-gzip |
Label: |
Readme file for DATABASE particles.txt |
Text: |
This file describes the columns and values in those columns for the DATABASE particles.cvs file. |
Notes: |
text/plain; charset=UTF-8 |
Label: |
Readme file for experiment.txt |
Text: |
This file explains the contents of the experiment.tar.gz file. |
Notes: |
text/plain; charset=UTF-8 |