Giving Structure to Unstructured Healthcare Workforce Documents Using Natural Language Processing

Abstract

Developers and data scientists in the DAS Analytics + Foresight Hub created a suite of tools to showcase the utility of job vacancy descriptions for providing insight into workforce skill requirements within a public sector organisation. Our solution layers a Python web application embedding interactive visualisations on top of a selection of statistical tools for augmented search and summarisation of over 14,000 job descriptions, retrieved via a web scraper that snapshots a public sector recruitment website. The application allows the user to quickly navigate thousands of roles, to perceive recruitment trends by clustering roles according to job description, and to segment the workforce by scoring descriptions against user-specified skill profiles. Overall, our solution has the potential to enhance monitoring capability and support next-generation workforce allocation and planning.