Adaptively selecting occupations to detect skill shortages from online job ads

Abstract

Labour demand and skill shortages have historically been difficult to assess given the high costs of conducting representative surveys and the inherent delays of these indicators. This is particularly consequential for fast developing skills and occupations, such as those relating to Data Science and Analytics (DSA). This paper develops a data-driven solution to detecting skill shortages from online job advertisements (ads) data. We first propose a method to generate sets of highly similar skills based on a set of seed skills from job ads. This provides researchers with a novel method to adaptively select occupations based on granular skills data. Next, we apply this adaptive skills similarity technique to a dataset of over 6.7 million Australian job ads in order to identify occupations with the highest proportions of DSA skills. This uncovers 306,577 DSA job ads across 23 occupational classes from 2012-2019. Finally, we propose five variables for detecting skill shortages from online job ads: (1) posting frequency;(2) salary levels; (3) education requirements; (4) experience demands; and (5) job ad posting predictability. This contributes further evidence to the goal of detecting skills shortages in realtime. In conducting this analysis, we also find strong evidence of skills shortages in Australia for highly technical DSA skills and occupations. These results provide insights to Data Science researchers, educators, and policy-makers from other advanced economies about the types of skills that should be cultivated to meet growing DSA labour demands in the future.

Job Forecasting Based on the Patent Information: A Word Embedding-Based Approach

“…Technologies of robots and artificial intelligence (AI) are expected to replace simple labor and make workplaces more skill-polarized [2,3]. Researchers tried to predict the future of the job market based on numerical data (e.g., labor employment [4] and statistics of graduates [5]) or textual data (e.g., job postings [6,7], job attributes [8], and Google trends [9]). However, these approaches were mainly focused on occupational data and limitedly considered changes in technology.…”

A Survey on Skill Identification From Online Job Ads

“…A skill shortage tool was proposed in [122]; the tool detects skill shortages by correlating different features in the job ad such as its location, salary level and the job ad period being advertised. In [85], they developed a data-driven solution to detect skill shortages from online job ads data. To do so, they identified skills specific to data science and analysis, to capture the labor trends of such an occupation.…”

Using Fuzzy Approach to Model Skill Shortage in Vietnam’s Labor Market in the Context of Industry 4.0

“…Therefore, workers to work on soft skills such as their learning ability, adaptability, communication skills, problem-solving and decision-making, teamwork, and creative capacity. Furthermore, 309,000 vacancies in 169 professions of various professional levels in the United Kingdom (UK) was analyzed [40]. The research indicated that employers found it difficult to recruit suitable workers in 106,000 of these positions.…”