3-digit occupation code images from the Norwegian census of 1950 - Manual review dataset (doi:10.18710/LYXKN1)

View:

Part 1: Document Description
Part 2: Study Description
Part 5: Other Study-Related Materials
Entire Codebook

3-digit occupation code images from the Norwegian census of 1950 - Manual review dataset

doi:10.18710/LYXKN1

DataverseNO

2023-07-03

1

The Norwegian Historical Data Centre, 2023, "3-digit occupation code images from the Norwegian census of 1950 - Manual review dataset", https://doi.org/10.18710/LYXKN1, DataverseNO, V1

3-digit occupation code images from the Norwegian census of 1950 - Manual review dataset

doi:10.18710/LYXKN1

The Norwegian Historical Data Centre (UiT The Arctic University of Norway)

Sommerseth, Hilde

Pedersen, Bjørn-Richard

Andersen, Trygve

Langholz, Petja

Bjørklund, Bente

Torsetnes, Elin

Foshaug, Eva

Kjosnes, Line Silja

Strand, Toril

UiT The Arctic University of Norway

Python

322231

970422528

DataverseNO

UiT The Arctic University of Norway

The Norwegian Historical Data Centre

Pedersen, Bjørn-Richard

2023-06-21

https://doi.org/10.18710/LYXKN1

Computer and Information Science, 3-digit occupational codes, Machine learning, Population census, Manual review, Manual correction, Norway, Norwegian data, Occupation data

<p>This dataset is made up of images containing handwritten 3-digit occupation codes from the Norwegian population census of 1950. The occupation codes were added to the census sheets by Statistics Norway after the census was concluded for the purpose of creating aggregated occupational statistics for the entire population.</p> <p>The coding standard used in the 1950 census is, according to Statistics Norway’s official publications (https://www.ssb.no/historisk-statistikk/folketellinger/folketellingen-1950, booklet 4, page 81), very similar to the standards used in the census for 1920. Cf. the 13th booklet published for the 1920 census (https://www.ssb.no/historisk-statistikk/folketellinger/folketellingen-1920, note that this booklet is only available in Norwegian).</p> <p>In short, an occupation code is a 3-digit number that corresponds to a given occupation or type of occupation. According to the official list of occupation codes provided by Statistics Norway there are 339 unique codes. These are not all necessarily sequential or hierarchical in general, but some subgroupings are. This list can be found under Files. </p> <p>It is also worth noting that these images were extracted from the original census sheet images algorithmically. This process was not flawless and lead to additional images being extracted, these can contain written occupation titles or be left entirely blank.</p> <p>The dataset consists of 90,000 unique images, and 9,000 images that were randomly selected and copied from the unique images. These were all used for a research project (link to preprint article: https://doi.org/10.48550/arXiv.2306.16126) where we (author list can be found in preprint) tried to find a more efficient way of reviewing and correcting classification results from a Machine Learning model, where the results did not pass a pre-set confidence threshold. This was a follow-up to our previous article where we describe the initial project and creating of our model in more detail, if it is of interest (“Lessons Learned Developing and Using a Machine Learning Model to Automatically Transcribe 2.3 Million Handwritten Occupation Codes”, https://doi.org/10.51964/hlcs11331).</p>

1950-12-01-1950-12-01

1950-11-30-1950-12-01

Norway

• West Bounding Longitude: 4.09
• East Bounding Longitude: 31.76
• South Bounding Latitude: 57.76
• North Bounding Latitude: 71.38

Individuals.

Any individual residing in Norway during the data collection period.

Handwritten census data

Handwritten occupational data

Handwritten numerical data

Cross-sectional.

Statistics Norway.

Statistics Norway (https://www.ssb.no/en). Information about rules and practices for gathering the data are exhaustively covered in booklets 3 and 4 (https://www.ssb.no/historisk-statistikk/folketellinger/folketellingen-1950)

<a href="http://creativecommons.org/publicdomain/zero/1.0">CC0 1.0</a>

The Norwegian Historical Data Centre, 2021, "Manually annotated 3-digit occupation code training set from the Norwegian 1950 census", https://doi.org/10.18710/7JWAZX, DataverseNO, V1

Pedersen, B.-R., Holsbø, E., Andersen, T., Shvetsov, N., Ravn, J., Sommerseth, H. L., & Bongo, L. A. (2022). Lessons Learned Developing and Using a Machine Learning Model to Automatically Transcribe 2.3 Million Handwritten Occupation Codes. Historical Life Course Studies, 12, 1–17.

10.51964/hlcs11331

Pedersen, B.-R., Holsbø, E., Andersen, T., Shvetsov, N., Ravn, J., Sommerseth, H. L., & Bongo, L. A. (2022). Lessons Learned Developing and Using a Machine Learning Model to Automatically Transcribe 2.3 Million Handwritten Occupation Codes. Historical Life Course Studies, 12, 1–17.

Bjørn-Richard Pedersen, Rigmor Katrine Johansen, Einar Holsbø, Hilde Sommerseth, Lars Ailo Bongo (2023). More efficient manual review of automatically transcribed tabular data. Arxiv preprint. arXiv:2306.16126 [cs.LG]

https://arxiv.org/abs/2306.16126

Bjørn-Richard Pedersen, Rigmor Katrine Johansen, Einar Holsbø, Hilde Sommerseth, Lars Ailo Bongo (2023). More efficient manual review of automatically transcribed tabular data. Arxiv preprint. arXiv:2306.16126 [cs.LG]

The Norwegian Historical Data Centre, 2021, "Manually annotated 3-digit occupation code training set from the Norwegian 1950 census", DataverseNO, V1

10.18710/7JWAZX

The Norwegian Historical Data Centre, 2021, "Manually annotated 3-digit occupation code training set from the Norwegian 1950 census", DataverseNO, V1

Label:

00_ReadMe.txt

text/plain

Label:

1950_Occupational_Codes_list.csv

text/comma-separated-values

Label:

3-digit_Occupation_Code_images_from_Norwegian_Census_1950_Manual_Review_dataset.zip

application/zip