{"id":187569,"identifier":"LYXKN1","persistentUrl":"https://doi.org/10.18710/LYXKN1","protocol":"doi","authority":"10.18710","separator":"/","publisher":"DataverseNO","publicationDate":"2023-07-03","storageIdentifier":"S3://10.18710/LYXKN1","datasetType":"dataset","datasetVersion":{"id":3504,"datasetId":187569,"datasetPersistentId":"doi:10.18710/LYXKN1","storageIdentifier":"S3://10.18710/LYXKN1","versionNumber":1,"versionMinorNumber":1,"versionState":"RELEASED","latestVersionPublishingState":"RELEASED","deaccessionLink":"","lastUpdateTime":"2023-09-28T22:16:06Z","releaseTime":"2023-09-28T22:16:06Z","createTime":"2023-09-20T06:20:34Z","publicationDate":"2023-07-03","citationDate":"2023-07-03","license":{"name":"CC0 1.0","uri":"http://creativecommons.org/publicdomain/zero/1.0","iconUri":"https://licensebuttons.net/p/zero/1.0/88x31.png","rightsIdentifier":"CC0-1.0","rightsIdentifierScheme":"SPDX","schemeUri":"https://spdx.org/licenses/","languageCode":"en"},"fileAccessRequest":true,"metadataBlocks":{"citation":{"displayName":"Citation Metadata","name":"citation","fields":[{"typeName":"title","multiple":false,"typeClass":"primitive","value":"3-digit occupation code images from the Norwegian census of 1950 - Manual review dataset"},{"typeName":"author","multiple":true,"typeClass":"compound","value":[{"authorName":{"typeName":"authorName","multiple":false,"typeClass":"primitive","value":"The Norwegian Historical Data Centre"},"authorAffiliation":{"typeName":"authorAffiliation","multiple":false,"typeClass":"primitive","value":"UiT The Arctic University of Norway"}}]},{"typeName":"datasetContact","multiple":true,"typeClass":"compound","value":[{"datasetContactName":{"typeName":"datasetContactName","multiple":false,"typeClass":"primitive","value":"The Norwegian Historical Data Centre"},"datasetContactAffiliation":{"typeName":"datasetContactAffiliation","multiple":false,"typeClass":"primitive","value":"UiT The Arctic University of Norway"},"datasetContactEmail":{"typeName":"datasetContactEmail","multiple":false,"typeClass":"primitive","value":"bjorn-richard.pedersen@uit.no"}}]},{"typeName":"dsDescription","multiple":true,"typeClass":"compound","value":[{"dsDescriptionValue":{"typeName":"dsDescriptionValue","multiple":false,"typeClass":"primitive","value":"

This dataset is made up of images containing handwritten 3-digit occupation codes from the Norwegian population census of 1950. The occupation codes were added to the census sheets by Statistics Norway after the census was concluded for the purpose of creating aggregated occupational statistics for the entire population.

\n

The coding standard used in the 1950 census is, according to Statistics Norway’s official publications (https://www.ssb.no/historisk-statistikk/folketellinger/folketellingen-1950, booklet 4, page 81), very similar to the standards used in the census for 1920. Cf. the 13th booklet published for the 1920 census (https://www.ssb.no/historisk-statistikk/folketellinger/folketellingen-1920, note that this booklet is only available in Norwegian).

\n

In short, an occupation code is a 3-digit number that corresponds to a given occupation or type of occupation. According to the official list of occupation codes provided by Statistics Norway there are 339 unique codes. These are not all necessarily sequential or hierarchical in general, but some subgroupings are. This list can be found under Files.

\n

It is also worth noting that these images were extracted from the original census sheet images algorithmically. This process was not flawless and lead to additional images being extracted, these can contain written occupation titles or be left entirely blank.

\n

The dataset consists of 90,000 unique images, and 9,000 images that were randomly selected and copied from the unique images. These were all used for a research project (link to preprint article: https://doi.org/10.48550/arXiv.2306.16126) where we (author list can be found in preprint) tried to find a more efficient way of reviewing and correcting classification results from a Machine Learning model, where the results did not pass a pre-set confidence threshold. \nThis was a follow-up to our previous article where we describe the initial project and creating of our model in more detail, if it is of interest (“Lessons Learned Developing and Using a Machine Learning Model to Automatically Transcribe 2.3 Million Handwritten Occupation Codes”, https://doi.org/10.51964/hlcs11331).

"},"dsDescriptionDate":{"typeName":"dsDescriptionDate","multiple":false,"typeClass":"primitive","value":"2023-06-29"}}]},{"typeName":"subject","multiple":true,"typeClass":"controlledVocabulary","value":["Computer and Information Science"]},{"typeName":"keyword","multiple":true,"typeClass":"compound","value":[{"keywordValue":{"typeName":"keywordValue","multiple":false,"typeClass":"primitive","value":"3-digit occupational codes"}},{"keywordValue":{"typeName":"keywordValue","multiple":false,"typeClass":"primitive","value":"Machine learning"}},{"keywordValue":{"typeName":"keywordValue","multiple":false,"typeClass":"primitive","value":"Population census"}},{"keywordValue":{"typeName":"keywordValue","multiple":false,"typeClass":"primitive","value":"Manual review"}},{"keywordValue":{"typeName":"keywordValue","multiple":false,"typeClass":"primitive","value":"Manual correction"}},{"keywordValue":{"typeName":"keywordValue","multiple":false,"typeClass":"primitive","value":"Norway"}},{"keywordValue":{"typeName":"keywordValue","multiple":false,"typeClass":"primitive","value":"Norwegian data"}},{"keywordValue":{"typeName":"keywordValue","multiple":false,"typeClass":"primitive","value":"Occupation data"}}]},{"typeName":"publication","multiple":true,"typeClass":"compound","value":[{"publicationCitation":{"typeName":"publicationCitation","multiple":false,"typeClass":"primitive","value":"Pedersen, B.-R., Holsbø, E., Andersen, T., Shvetsov, N., Ravn, J., Sommerseth, H. L., & Bongo, L. A. (2022). Lessons Learned Developing and Using a Machine Learning Model to Automatically Transcribe 2.3 Million Handwritten Occupation Codes. Historical Life Course Studies, 12, 1–17."},"publicationIDType":{"typeName":"publicationIDType","multiple":false,"typeClass":"controlledVocabulary","value":"doi"},"publicationIDNumber":{"typeName":"publicationIDNumber","multiple":false,"typeClass":"primitive","value":"10.51964/hlcs11331"},"publicationURL":{"typeName":"publicationURL","multiple":false,"typeClass":"primitive","value":"https://doi.org/10.51964/hlcs11331"}},{"publicationCitation":{"typeName":"publicationCitation","multiple":false,"typeClass":"primitive","value":"Bjørn-Richard Pedersen, Rigmor Katrine Johansen, Einar Holsbø, Hilde Sommerseth, Lars Ailo Bongo (2023). More efficient manual review of automatically transcribed tabular data. Arxiv preprint. arXiv:2306.16126 [cs.LG]"},"publicationIDType":{"typeName":"publicationIDType","multiple":false,"typeClass":"controlledVocabulary","value":"arXiv"},"publicationIDNumber":{"typeName":"publicationIDNumber","multiple":false,"typeClass":"primitive","value":"https://arxiv.org/abs/2306.16126"},"publicationURL":{"typeName":"publicationURL","multiple":false,"typeClass":"primitive","value":"https://arxiv.org/abs/2306.16126"}},{"publicationCitation":{"typeName":"publicationCitation","multiple":false,"typeClass":"primitive","value":"The Norwegian Historical Data Centre, 2021, \"Manually annotated 3-digit occupation code training set from the Norwegian 1950 census\", DataverseNO, V1"},"publicationIDType":{"typeName":"publicationIDType","multiple":false,"typeClass":"controlledVocabulary","value":"doi"},"publicationIDNumber":{"typeName":"publicationIDNumber","multiple":false,"typeClass":"primitive","value":"10.18710/7JWAZX"},"publicationURL":{"typeName":"publicationURL","multiple":false,"typeClass":"primitive","value":"https://doi.org/10.18710/7JWAZX"}}]},{"typeName":"language","multiple":true,"typeClass":"controlledVocabulary","value":["English"]},{"typeName":"producer","multiple":true,"typeClass":"compound","value":[{"producerName":{"typeName":"producerName","multiple":false,"typeClass":"primitive","value":"UiT The Arctic University of Norway"},"producerAbbreviation":{"typeName":"producerAbbreviation","multiple":false,"typeClass":"primitive","value":"UiT"},"producerURL":{"typeName":"producerURL","multiple":false,"typeClass":"primitive","value":"https://en.uit.no/"}}]},{"typeName":"contributor","multiple":true,"typeClass":"compound","value":[{"contributorType":{"typeName":"contributorType","multiple":false,"typeClass":"controlledVocabulary","value":"Project Leader"},"contributorName":{"typeName":"contributorName","multiple":false,"typeClass":"primitive","value":"Sommerseth, Hilde"}},{"contributorType":{"typeName":"contributorType","multiple":false,"typeClass":"controlledVocabulary","value":"Project Manager"},"contributorName":{"typeName":"contributorName","multiple":false,"typeClass":"primitive","value":"Pedersen, Bjørn-Richard"}},{"contributorType":{"typeName":"contributorType","multiple":false,"typeClass":"controlledVocabulary","value":"Project Member"},"contributorName":{"typeName":"contributorName","multiple":false,"typeClass":"primitive","value":"Andersen, Trygve"}},{"contributorType":{"typeName":"contributorType","multiple":false,"typeClass":"controlledVocabulary","value":"Project Member"},"contributorName":{"typeName":"contributorName","multiple":false,"typeClass":"primitive","value":"Langholz, Petja"}},{"contributorType":{"typeName":"contributorType","multiple":false,"typeClass":"controlledVocabulary","value":"Project Member"},"contributorName":{"typeName":"contributorName","multiple":false,"typeClass":"primitive","value":"Bjørklund, Bente"}},{"contributorType":{"typeName":"contributorType","multiple":false,"typeClass":"controlledVocabulary","value":"Project Member"},"contributorName":{"typeName":"contributorName","multiple":false,"typeClass":"primitive","value":"Torsetnes, Elin"}},{"contributorType":{"typeName":"contributorType","multiple":false,"typeClass":"controlledVocabulary","value":"Project Member"},"contributorName":{"typeName":"contributorName","multiple":false,"typeClass":"primitive","value":"Foshaug, Eva"}},{"contributorType":{"typeName":"contributorType","multiple":false,"typeClass":"controlledVocabulary","value":"Project Member"},"contributorName":{"typeName":"contributorName","multiple":false,"typeClass":"primitive","value":"Kjosnes, Line Silja"}},{"contributorType":{"typeName":"contributorType","multiple":false,"typeClass":"controlledVocabulary","value":"Project Member"},"contributorName":{"typeName":"contributorName","multiple":false,"typeClass":"primitive","value":"Strand, Toril"}}]},{"typeName":"grantNumber","multiple":true,"typeClass":"compound","value":[{"grantNumberAgency":{"typeName":"grantNumberAgency","multiple":false,"typeClass":"primitive","value":"The Research Council of Norway"},"grantNumberValue":{"typeName":"grantNumberValue","multiple":false,"typeClass":"primitive","value":"322231"}},{"grantNumberAgency":{"typeName":"grantNumberAgency","multiple":false,"typeClass":"primitive","value":"UiT The Arctic University of Norway"},"grantNumberValue":{"typeName":"grantNumberValue","multiple":false,"typeClass":"primitive","value":"970422528"}}]},{"typeName":"distributor","multiple":true,"typeClass":"compound","value":[{"distributorName":{"typeName":"distributorName","multiple":false,"typeClass":"primitive","value":"UiT The Arctic University of Norway"},"distributorAffiliation":{"typeName":"distributorAffiliation","multiple":false,"typeClass":"primitive","value":"UiT The Arctic University of Norway"},"distributorURL":{"typeName":"distributorURL","multiple":false,"typeClass":"primitive","value":"https://dataverse.no/dataverse/uit"}}]},{"typeName":"depositor","multiple":false,"typeClass":"primitive","value":"Pedersen, Bjørn-Richard"},{"typeName":"dateOfDeposit","multiple":false,"typeClass":"primitive","value":"2023-06-21"},{"typeName":"timePeriodCovered","multiple":true,"typeClass":"compound","value":[{"timePeriodCoveredStart":{"typeName":"timePeriodCoveredStart","multiple":false,"typeClass":"primitive","value":"1950-12-01"},"timePeriodCoveredEnd":{"typeName":"timePeriodCoveredEnd","multiple":false,"typeClass":"primitive","value":"1950-12-01"}}]},{"typeName":"dateOfCollection","multiple":true,"typeClass":"compound","value":[{"dateOfCollectionStart":{"typeName":"dateOfCollectionStart","multiple":false,"typeClass":"primitive","value":"1950-11-30"},"dateOfCollectionEnd":{"typeName":"dateOfCollectionEnd","multiple":false,"typeClass":"primitive","value":"1950-12-01"}}]},{"typeName":"kindOfData","multiple":true,"typeClass":"primitive","value":["Handwritten census data","Handwritten occupational data","Handwritten numerical data"]},{"typeName":"software","multiple":true,"typeClass":"compound","value":[{"softwareName":{"typeName":"softwareName","multiple":false,"typeClass":"primitive","value":"Python"},"softwareVersion":{"typeName":"softwareVersion","multiple":false,"typeClass":"primitive","value":"3.5+"}}]},{"typeName":"relatedDatasets","multiple":true,"typeClass":"primitive","value":["The Norwegian Historical Data Centre, 2021, \"Manually annotated 3-digit occupation code training set from the Norwegian 1950 census\", https://doi.org/10.18710/7JWAZX, DataverseNO, V1"]},{"typeName":"originOfSources","multiple":false,"typeClass":"primitive","value":"Statistics Norway (https://www.ssb.no/en).\nInformation about rules and practices for gathering the data are exhaustively covered in booklets 3 and 4 (https://www.ssb.no/historisk-statistikk/folketellinger/folketellingen-1950)"}]},"geospatial":{"displayName":"Geospatial Metadata","name":"geospatial","fields":[{"typeName":"geographicCoverage","multiple":true,"typeClass":"compound","value":[{"country":{"typeName":"country","multiple":false,"typeClass":"controlledVocabulary","value":"Norway"}}]},{"typeName":"geographicBoundingBox","multiple":true,"typeClass":"compound","value":[{"westLongitude":{"typeName":"westLongitude","multiple":false,"typeClass":"primitive","value":"4.09"},"eastLongitude":{"typeName":"eastLongitude","multiple":false,"typeClass":"primitive","value":"31.76"},"northLatitude":{"typeName":"northLatitude","multiple":false,"typeClass":"primitive","value":"71.38"},"southLatitude":{"typeName":"southLatitude","multiple":false,"typeClass":"primitive","value":"57.76"}}]}]},"socialscience":{"displayName":"Social Science and Humanities Metadata","name":"socialscience","fields":[{"typeName":"unitOfAnalysis","multiple":true,"typeClass":"primitive","value":["Individuals."]},{"typeName":"universe","multiple":true,"typeClass":"primitive","value":["Any individual residing in Norway during the data collection period."]},{"typeName":"timeMethod","multiple":false,"typeClass":"primitive","value":"Cross-sectional."},{"typeName":"dataCollector","multiple":false,"typeClass":"primitive","value":"Statistics Norway."}]}},"files":[{"label":"00_ReadMe.txt","restricted":false,"version":1,"datasetVersionId":3504,"dataFile":{"id":187693,"persistentId":"doi:10.18710/LYXKN1/PV9GMZ","pidURL":"https://doi.org/10.18710/LYXKN1/PV9GMZ","filename":"00_ReadMe.txt","contentType":"text/plain","friendlyType":"Plain Text","filesize":7270,"storageIdentifier":"S3://uit-dataverseno-prod01:1891a5e901c-69b741e3ff72","rootDataFileId":-1,"md5":"eae4ebf737339c169a204282d2628431","checksum":{"type":"MD5","value":"eae4ebf737339c169a204282d2628431"},"tabularData":false,"creationDate":"2023-07-03","publicationDate":"2023-07-03","fileAccessRequest":true}},{"label":"1950_Occupational_Codes_list.csv","restricted":false,"version":1,"datasetVersionId":3504,"dataFile":{"id":187688,"persistentId":"doi:10.18710/LYXKN1/XYDEEX","pidURL":"https://doi.org/10.18710/LYXKN1/XYDEEX","filename":"1950_Occupational_Codes_list.csv","contentType":"text/comma-separated-values","friendlyType":"Comma Separated Values","filesize":54006,"storageIdentifier":"S3://uit-dataverseno-prod01:18907803d2a-00b4f8c254c9","rootDataFileId":-1,"md5":"3844b2cfee18254d3b1d2c3782823a00","checksum":{"type":"MD5","value":"3844b2cfee18254d3b1d2c3782823a00"},"tabularData":false,"creationDate":"2023-06-29","publicationDate":"2023-07-03","fileAccessRequest":true}},{"label":"3-digit_Occupation_Code_images_from_Norwegian_Census_1950_Manual_Review_dataset.zip","restricted":false,"version":1,"datasetVersionId":3504,"dataFile":{"id":187571,"persistentId":"doi:10.18710/LYXKN1/YIBJCX","pidURL":"https://doi.org/10.18710/LYXKN1/YIBJCX","filename":"3-digit_Occupation_Code_images_from_Norwegian_Census_1950_Manual_Review_dataset.zip","contentType":"application/zip","friendlyType":"ZIP Archive","filesize":1860373835,"storageIdentifier":"S3://uit-dataverseno-prod01:188dde26e8c-f55e8699fdc3","rootDataFileId":-1,"md5":"78f59ed21a84c58ff17ae2cb93440436","checksum":{"type":"MD5","value":"78f59ed21a84c58ff17ae2cb93440436"},"tabularData":false,"creationDate":"2023-06-21","publicationDate":"2023-07-03","fileAccessRequest":true}}],"citation":"The Norwegian Historical Data Centre, 2023, \"3-digit occupation code images from the Norwegian census of 1950 - Manual review dataset\", https://doi.org/10.18710/LYXKN1, DataverseNO, V1"}}