Datasets

The data will be hosted on the Zenodo platform under the NLP in HR community, following the file structure outlined below. Each time new data is added, an updated version of the dataset will be published on the platform.

Access the Zenodo download page

The dataset structure on Zenodo is organized into two *.zip files, TaskA and TaskB, each containing training, validation and test folders to suuport different stages of model development. Until the official release of the full training set, users can access a sample version of the data through the sampleset_TaskA.zip and sampleset_TaskB.zip files.

TaskA includes language-specific subfolders within the training and validation directories, covering English, Spanish, German, and Chinese job title data. The tr*aining folders for TaskA contain language-specific .tsv files for each respective language. Validation folders include three essential files—queries, corpus_elements, and q_rels—for evaluating model relevance to search queries. TaskA’s test folder has queries and corpus_elements files for testing retrieval.

  • 🗜️️ TaskA
      • 📁 training
        • 📁 english
          • 📄 taskA_training_en.tsv
        • 📁 spanish
          • 📄 taskA_training_es.tsv
        • 📁 german
          • 📄 taskA_training_de.tsv
      • 📁 validation
        • 📁 english
          • 📄 queries
          • 📄 corpus_elements
          • 📄 q_rels
        • 📁 spanish
        • 📁 german
        • 📁 chinese
      • 📁 test
        • 📄 queries
        • 📄 corpus_elements

    • TaskB follows a similar structure but without language-specific subfolders, providing general .tsv files for training, validation, and testing. This consistent file organization enables efficient data access and structured updates as new data versions are published.

      • 🗜️️ TaskB
        • 📁 training
          • 📄 taskB_training.tsv
        • 📁 validation
          • 📄 queries
          • 📄 corpus_elements
          • 📄 q_rels
        • 📁 test
          • 📄 queries
          • 📄 corpus_elements
    Last modified October 28, 2024: Updates on data (c614c8b)