10.18710/LYXKN1 The Norwegian Historical Data Centre UiT The Arctic University of Norway DataverseNO 2023 Computer and Information Science 3-digit occupational codes Machine learning Population census Manual review Manual correction Norway Norwegian data Occupation data UiT The Arctic University of Norway The The Arctic University of Norway UiT The Arctic University of Norway The The Arctic University of Norway UiT The Arctic University of Norway The Norwegian Historical Data Centre UiT The Arctic University of Norway Sommerseth, Hilde Hilde Sommerseth Pedersen, Bjørn-Richard Bjørn-Richard Pedersen Andersen, Trygve Trygve Andersen Langholz, Petja Petja Langholz Bjørklund, Bente Bente Bjørklund Torsetnes, Elin Elin Torsetnes Foshaug, Eva Eva Foshaug Kjosnes, Line Silja Line Silja Kjosnes Strand, Toril Toril Strand 2023-06-21 2023-07-03 2023-09-28 1950-11-30/1950-12-01 1950-12-01/1950-12-01 Handwritten census data;Handwritten occupational data;Handwritten numerical data 10.51964/HLCS11331 https://arxiv.org/abs/2306.16126 10.18710/7JWAZX 10.18710/LYXKN1/PV9GMZ 10.18710/LYXKN1/XYDEEX 10.18710/LYXKN1/YIBJCX 1860373835 54006 7270 application/zip text/comma-separated-values text/plain 1.1 Creative Commons CC0 1.0 Universal Public Domain Dedication. <p>This dataset is made up of images containing handwritten 3-digit occupation codes from the Norwegian population census of 1950. The occupation codes were added to the census sheets by Statistics Norway after the census was concluded for the purpose of creating aggregated occupational statistics for the entire population.</p> <p>The coding standard used in the 1950 census is, according to Statistics Norway’s official publications (https://www.ssb.no/historisk-statistikk/folketellinger/folketellingen-1950, booklet 4, page 81), very similar to the standards used in the census for 1920. Cf. the 13th booklet published for the 1920 census (https://www.ssb.no/historisk-statistikk/folketellinger/folketellingen-1920, note that this booklet is only available in Norwegian).</p> <p>In short, an occupation code is a 3-digit number that corresponds to a given occupation or type of occupation. According to the official list of occupation codes provided by Statistics Norway there are 339 unique codes. These are not all necessarily sequential or hierarchical in general, but some subgroupings are. This list can be found under Files. </p> <p>It is also worth noting that these images were extracted from the original census sheet images algorithmically. This process was not flawless and lead to additional images being extracted, these can contain written occupation titles or be left entirely blank.</p> <p>The dataset consists of 90,000 unique images, and 9,000 images that were randomly selected and copied from the unique images. These were all used for a research project (link to preprint article: https://doi.org/10.48550/arXiv.2306.16126) where we (author list can be found in preprint) tried to find a more efficient way of reviewing and correcting classification results from a Machine Learning model, where the results did not pass a pre-set confidence threshold. This was a follow-up to our previous article where we describe the initial project and creating of our model in more detail, if it is of interest (“Lessons Learned Developing and Using a Machine Learning Model to Automatically Transcribe 2.3 Million Handwritten Occupation Codes”, https://doi.org/10.51964/hlcs11331).</p> Python, 3.5+ Statistics Norway (https://www.ssb.no/en). Information about rules and practices for gathering the data are exhaustively covered in booklets 3 and 4 (https://www.ssb.no/historisk-statistikk/folketellinger/folketellingen-1950) Norway 4.09 31.76 57.76 71.38 The Research Council of Norway 322231 UiT The Arctic University of Norway 970422528