![Page 1: Detecting latent training · Detecting latent training needs from digital traces Phase IIIb EPFL CHILI ... • Compare importance of skills by their term frequency in job ads. [Chuck,](https://reader034.vdocuments.site/reader034/viewer/2022050418/5f8e2ca16fb3a1288f4e6768/html5/thumbnails/1.jpg)
Leading House « DUAL-T » Technologies for Vocational Education
Detecting latent training needs from digital traces
Phase IIIbEPFL CHILI
Fu-Yin Cherng
![Page 2: Detecting latent training · Detecting latent training needs from digital traces Phase IIIb EPFL CHILI ... • Compare importance of skills by their term frequency in job ads. [Chuck,](https://reader034.vdocuments.site/reader034/viewer/2022050418/5f8e2ca16fb3a1288f4e6768/html5/thumbnails/2.jpg)
Outline
• Motivation
• Literature Survey
• Research Projects
• 1st and 2nd semester
2
![Page 3: Detecting latent training · Detecting latent training needs from digital traces Phase IIIb EPFL CHILI ... • Compare importance of skills by their term frequency in job ads. [Chuck,](https://reader034.vdocuments.site/reader034/viewer/2022050418/5f8e2ca16fb3a1288f4e6768/html5/thumbnails/3.jpg)
Why we need to know training needs?As the technology evolves, the demand for the job market and the required skills change rapidly.
3
![Page 4: Detecting latent training · Detecting latent training needs from digital traces Phase IIIb EPFL CHILI ... • Compare importance of skills by their term frequency in job ads. [Chuck,](https://reader034.vdocuments.site/reader034/viewer/2022050418/5f8e2ca16fb3a1288f4e6768/html5/thumbnails/4.jpg)
Identify training needs by survey or meeting
Set up new training offers
Take several years!
Quicker way to identify potential training needs
4
![Page 5: Detecting latent training · Detecting latent training needs from digital traces Phase IIIb EPFL CHILI ... • Compare importance of skills by their term frequency in job ads. [Chuck,](https://reader034.vdocuments.site/reader034/viewer/2022050418/5f8e2ca16fb3a1288f4e6768/html5/thumbnails/5.jpg)
Skill Gaps
WorkplaceSchool
Bridging the gaps
Finding those gaps by data science and machine learning
![Page 6: Detecting latent training · Detecting latent training needs from digital traces Phase IIIb EPFL CHILI ... • Compare importance of skills by their term frequency in job ads. [Chuck,](https://reader034.vdocuments.site/reader034/viewer/2022050418/5f8e2ca16fb3a1288f4e6768/html5/thumbnails/6.jpg)
Understand customers opinion and interests
6
![Page 7: Detecting latent training · Detecting latent training needs from digital traces Phase IIIb EPFL CHILI ... • Compare importance of skills by their term frequency in job ads. [Chuck,](https://reader034.vdocuments.site/reader034/viewer/2022050418/5f8e2ca16fb3a1288f4e6768/html5/thumbnails/7.jpg)
7
French Election
![Page 8: Detecting latent training · Detecting latent training needs from digital traces Phase IIIb EPFL CHILI ... • Compare importance of skills by their term frequency in job ads. [Chuck,](https://reader034.vdocuments.site/reader034/viewer/2022050418/5f8e2ca16fb3a1288f4e6768/html5/thumbnails/8.jpg)
Mining Job Skills• Snapshot data of job ads
• Information technology (IT) job skills
• Compare importance of skills by their term frequency in job ads. [Chuck, L. et al., IEEE 2010]
8
![Page 9: Detecting latent training · Detecting latent training needs from digital traces Phase IIIb EPFL CHILI ... • Compare importance of skills by their term frequency in job ads. [Chuck,](https://reader034.vdocuments.site/reader034/viewer/2022050418/5f8e2ca16fb3a1288f4e6768/html5/thumbnails/9.jpg)
Longitudinal Analysis• Collected IT job ads over 3-years period (2002-2005) from
online job board
• Compare how the % of each skill change over timePrabhakar, B. et al., "IT skills in a tough job market." Communications of the ACM 48.10 (2005)
9
Linux
SQL Server
Operational system Database
![Page 10: Detecting latent training · Detecting latent training needs from digital traces Phase IIIb EPFL CHILI ... • Compare importance of skills by their term frequency in job ads. [Chuck,](https://reader034.vdocuments.site/reader034/viewer/2022050418/5f8e2ca16fb3a1288f4e6768/html5/thumbnails/10.jpg)
Skill Gaps
• Questionnaire: perceived skill gaps
• Mismatch of perceived importance between student and employee
• Compare skill sets from job ads and curricula of related disciplines. (e.g., ACM Curriculum Committee)
[Aken, A. et al., SIGMIS 2007]
[Richard, W. et al. Higher Education Theory and Practice 2016]
10
![Page 11: Detecting latent training · Detecting latent training needs from digital traces Phase IIIb EPFL CHILI ... • Compare importance of skills by their term frequency in job ads. [Chuck,](https://reader034.vdocuments.site/reader034/viewer/2022050418/5f8e2ca16fb3a1288f4e6768/html5/thumbnails/11.jpg)
What kind of data can reflect the training needs?
11
![Page 12: Detecting latent training · Detecting latent training needs from digital traces Phase IIIb EPFL CHILI ... • Compare importance of skills by their term frequency in job ads. [Chuck,](https://reader034.vdocuments.site/reader034/viewer/2022050418/5f8e2ca16fb3a1288f4e6768/html5/thumbnails/12.jpg)
Digital trace about training needs
Q&A sites
12
![Page 13: Detecting latent training · Detecting latent training needs from digital traces Phase IIIb EPFL CHILI ... • Compare importance of skills by their term frequency in job ads. [Chuck,](https://reader034.vdocuments.site/reader034/viewer/2022050418/5f8e2ca16fb3a1288f4e6768/html5/thumbnails/13.jpg)
Job Ads
Digital trace about training needs
Q&A sites
13
Digital trace about training needs
![Page 14: Detecting latent training · Detecting latent training needs from digital traces Phase IIIb EPFL CHILI ... • Compare importance of skills by their term frequency in job ads. [Chuck,](https://reader034.vdocuments.site/reader034/viewer/2022050418/5f8e2ca16fb3a1288f4e6768/html5/thumbnails/14.jpg)
General Interests
Digital trace about training needs
Job AdsQ&A sites
14
Digital trace about training needs
![Page 15: Detecting latent training · Detecting latent training needs from digital traces Phase IIIb EPFL CHILI ... • Compare importance of skills by their term frequency in job ads. [Chuck,](https://reader034.vdocuments.site/reader034/viewer/2022050418/5f8e2ca16fb3a1288f4e6768/html5/thumbnails/15.jpg)
Job Ads General Interests
Digital trace about training needs
Q&A sites
15
Digital trace about training needs
![Page 16: Detecting latent training · Detecting latent training needs from digital traces Phase IIIb EPFL CHILI ... • Compare importance of skills by their term frequency in job ads. [Chuck,](https://reader034.vdocuments.site/reader034/viewer/2022050418/5f8e2ca16fb3a1288f4e6768/html5/thumbnails/16.jpg)
Finding Question Topics in MOOCs Forum by Using Stack
Exchange as Training Data 2016 fall
16
![Page 17: Detecting latent training · Detecting latent training needs from digital traces Phase IIIb EPFL CHILI ... • Compare importance of skills by their term frequency in job ads. [Chuck,](https://reader034.vdocuments.site/reader034/viewer/2022050418/5f8e2ca16fb3a1288f4e6768/html5/thumbnails/17.jpg)
tags
predict tags of questions in MOOC Forum
which topics that students have the most questions of?
Training needs17
![Page 18: Detecting latent training · Detecting latent training needs from digital traces Phase IIIb EPFL CHILI ... • Compare importance of skills by their term frequency in job ads. [Chuck,](https://reader034.vdocuments.site/reader034/viewer/2022050418/5f8e2ca16fb3a1288f4e6768/html5/thumbnails/18.jpg)
Posts: 10,105 Date: 08/2011 - 09/2016
Posts: 5,910 Date: 02/2013 - 03/2015
18
![Page 19: Detecting latent training · Detecting latent training needs from digital traces Phase IIIb EPFL CHILI ... • Compare importance of skills by their term frequency in job ads. [Chuck,](https://reader034.vdocuments.site/reader034/viewer/2022050418/5f8e2ca16fb3a1288f4e6768/html5/thumbnails/19.jpg)
ChallengeWhether the posts of Stack Exchange and MOOC forum are similar?
signal processing signal processing
19
![Page 20: Detecting latent training · Detecting latent training needs from digital traces Phase IIIb EPFL CHILI ... • Compare importance of skills by their term frequency in job ads. [Chuck,](https://reader034.vdocuments.site/reader034/viewer/2022050418/5f8e2ca16fb3a1288f4e6768/html5/thumbnails/20.jpg)
Measure Divergence
• Methods: cross-entropy, KL and JS divergence, and L1, L2 distance
divergence between two distributions
word distribution 1 word distribution 2
20
![Page 21: Detecting latent training · Detecting latent training needs from digital traces Phase IIIb EPFL CHILI ... • Compare importance of skills by their term frequency in job ads. [Chuck,](https://reader034.vdocuments.site/reader034/viewer/2022050418/5f8e2ca16fb3a1288f4e6768/html5/thumbnails/21.jpg)
0.0
0.1
0.2
0.3
0.4
0.5
0.6
Similarity by JS
0.49006
0.35064
0.50959
0.08698
●
●
●
●
dsp_reactive train_dsp train_reactive train_test
n=1 n=5 n=5 n=5
Similarity by JS
0.35064
0.50959
●
●
dsp_reactive train_dsp train_reactive
n=5 n=5
Divergent
Similar
signal processing
0.08698●
train_test
n=5
reactive programing
signal processing
signal processing
signal processing
0.087
0.509
0.351
JS divergence
signal processing
![Page 22: Detecting latent training · Detecting latent training needs from digital traces Phase IIIb EPFL CHILI ... • Compare importance of skills by their term frequency in job ads. [Chuck,](https://reader034.vdocuments.site/reader034/viewer/2022050418/5f8e2ca16fb3a1288f4e6768/html5/thumbnails/22.jpg)
Summary• Two data sets are not similar enough to predict
tags across platforms.
• In the context of the same platform, we can reach 75% accuracy of predicting tags of new posts in Stack Exchange.
22
![Page 23: Detecting latent training · Detecting latent training needs from digital traces Phase IIIb EPFL CHILI ... • Compare importance of skills by their term frequency in job ads. [Chuck,](https://reader034.vdocuments.site/reader034/viewer/2022050418/5f8e2ca16fb3a1288f4e6768/html5/thumbnails/23.jpg)
Digital trace about training needs
Q&A sites
23
Job Ads General Interests
Digital trace about training needs
![Page 24: Detecting latent training · Detecting latent training needs from digital traces Phase IIIb EPFL CHILI ... • Compare importance of skills by their term frequency in job ads. [Chuck,](https://reader034.vdocuments.site/reader034/viewer/2022050418/5f8e2ca16fb3a1288f4e6768/html5/thumbnails/24.jpg)
Online Job Ads Analysis2017 spring
work in progress
24
![Page 25: Detecting latent training · Detecting latent training needs from digital traces Phase IIIb EPFL CHILI ... • Compare importance of skills by their term frequency in job ads. [Chuck,](https://reader034.vdocuments.site/reader034/viewer/2022050418/5f8e2ca16fb3a1288f4e6768/html5/thumbnails/25.jpg)
“Job ads provide information about employers’ expectations of potential employees and other information about evolving skill sets required in the technology workforce.”
[Hauyan H. et al., SIGMIS’09]
25
![Page 26: Detecting latent training · Detecting latent training needs from digital traces Phase IIIb EPFL CHILI ... • Compare importance of skills by their term frequency in job ads. [Chuck,](https://reader034.vdocuments.site/reader034/viewer/2022050418/5f8e2ca16fb3a1288f4e6768/html5/thumbnails/26.jpg)
Research GoalAnalysis job skill sets using job ads and find what kind of skills emerged lately.
26
![Page 27: Detecting latent training · Detecting latent training needs from digital traces Phase IIIb EPFL CHILI ... • Compare importance of skills by their term frequency in job ads. [Chuck,](https://reader034.vdocuments.site/reader034/viewer/2022050418/5f8e2ca16fb3a1288f4e6768/html5/thumbnails/27.jpg)
Challenges• Online job ads collections • Extract skill terms from job description
Have a MSc in Computer Science, Electrical Engineering or related disciplines. Ph.D. degree is a plus Have advanced Java, Scala or Python programming skills. Experience with real-world data is a plus Have advanced data management skills, including knowledge of data curation, data governance and data stewardship Have hands-on experience with data manipulation using SparkSQL, Hive, HBase, Phoenix, Solr or similar using a leading Apache Hadoop distribution.
27
![Page 28: Detecting latent training · Detecting latent training needs from digital traces Phase IIIb EPFL CHILI ... • Compare importance of skills by their term frequency in job ads. [Chuck,](https://reader034.vdocuments.site/reader034/viewer/2022050418/5f8e2ca16fb3a1288f4e6768/html5/thumbnails/28.jpg)
• Online job ads collections • Extract skill terms from job description
Exploratory analysis on job titles
Have a MSc in Computer Science, Electrical Engineering or related disciplines. Ph.D. degree is a plus Have advanced Java, Scala or Python programming skills. Experience with real-world data is a plus Have advanced data management skills, including knowledge of data curation, data governance and data stewardship Have hands-on experience with data manipulation using SparkSQL, Hive, HBase, Phoenix, Solr or similar using a leading Apache Hadoop distribution.
represent a set of skills
28
Challenges
![Page 29: Detecting latent training · Detecting latent training needs from digital traces Phase IIIb EPFL CHILI ... • Compare importance of skills by their term frequency in job ads. [Chuck,](https://reader034.vdocuments.site/reader034/viewer/2022050418/5f8e2ca16fb3a1288f4e6768/html5/thumbnails/29.jpg)
JobApis
http://expat.careers.adicio.com/jobs/software-engineer-m-f-eysins-95831815-d?rsite=careercast&rgroup=1&clientid=expat&widget=1&type=job&
29
![Page 30: Detecting latent training · Detecting latent training needs from digital traces Phase IIIb EPFL CHILI ... • Compare importance of skills by their term frequency in job ads. [Chuck,](https://reader034.vdocuments.site/reader034/viewer/2022050418/5f8e2ca16fb3a1288f4e6768/html5/thumbnails/30.jpg)
JobApis
30
![Page 31: Detecting latent training · Detecting latent training needs from digital traces Phase IIIb EPFL CHILI ... • Compare importance of skills by their term frequency in job ads. [Chuck,](https://reader034.vdocuments.site/reader034/viewer/2022050418/5f8e2ca16fb3a1288f4e6768/html5/thumbnails/31.jpg)
Exploratory Analysis
Year # Jobs # Categories # Job Title Location
2013 244,768 29 135,436 UK
2017 357,750 29 168,143 UK
31
• How the job ads change between 2013 and 2017 • Two datasets are in similar context
![Page 32: Detecting latent training · Detecting latent training needs from digital traces Phase IIIb EPFL CHILI ... • Compare importance of skills by their term frequency in job ads. [Chuck,](https://reader034.vdocuments.site/reader034/viewer/2022050418/5f8e2ca16fb3a1288f4e6768/html5/thumbnails/32.jpg)
Rank of top 10 increasing job categories
32
20132017
Decreasing
![Page 33: Detecting latent training · Detecting latent training needs from digital traces Phase IIIb EPFL CHILI ... • Compare importance of skills by their term frequency in job ads. [Chuck,](https://reader034.vdocuments.site/reader034/viewer/2022050418/5f8e2ca16fb3a1288f4e6768/html5/thumbnails/33.jpg)
Increase: Healthcare & Nursing Jobs
Healthcare
2013 2017
20132017
![Page 34: Detecting latent training · Detecting latent training needs from digital traces Phase IIIb EPFL CHILI ... • Compare importance of skills by their term frequency in job ads. [Chuck,](https://reader034.vdocuments.site/reader034/viewer/2022050418/5f8e2ca16fb3a1288f4e6768/html5/thumbnails/34.jpg)
Decrease: Energy, Oil & Gas Jobs
Energy jobs
Gas jobs
Oil jobs
2013 2017
20132017
![Page 35: Detecting latent training · Detecting latent training needs from digital traces Phase IIIb EPFL CHILI ... • Compare importance of skills by their term frequency in job ads. [Chuck,](https://reader034.vdocuments.site/reader034/viewer/2022050418/5f8e2ca16fb3a1288f4e6768/html5/thumbnails/35.jpg)
Rank of top 10 increasing job titles
20132017
![Page 36: Detecting latent training · Detecting latent training needs from digital traces Phase IIIb EPFL CHILI ... • Compare importance of skills by their term frequency in job ads. [Chuck,](https://reader034.vdocuments.site/reader034/viewer/2022050418/5f8e2ca16fb3a1288f4e6768/html5/thumbnails/36.jpg)
2013 2017
Caregiver
Care Assistant
20132017
Increase: Care Assistant
![Page 37: Detecting latent training · Detecting latent training needs from digital traces Phase IIIb EPFL CHILI ... • Compare importance of skills by their term frequency in job ads. [Chuck,](https://reader034.vdocuments.site/reader034/viewer/2022050418/5f8e2ca16fb3a1288f4e6768/html5/thumbnails/37.jpg)
2013 2017
20132017
Increase: Registered Nurse
Registered Nurse
![Page 38: Detecting latent training · Detecting latent training needs from digital traces Phase IIIb EPFL CHILI ... • Compare importance of skills by their term frequency in job ads. [Chuck,](https://reader034.vdocuments.site/reader034/viewer/2022050418/5f8e2ca16fb3a1288f4e6768/html5/thumbnails/38.jpg)
2013 2017
20132017
Increase: Quantity Surveyor
![Page 39: Detecting latent training · Detecting latent training needs from digital traces Phase IIIb EPFL CHILI ... • Compare importance of skills by their term frequency in job ads. [Chuck,](https://reader034.vdocuments.site/reader034/viewer/2022050418/5f8e2ca16fb3a1288f4e6768/html5/thumbnails/39.jpg)
Functional Programming Data Science
Deep Learning
39
Blockchain
Jupyter Notebook
Social Media Manager
![Page 40: Detecting latent training · Detecting latent training needs from digital traces Phase IIIb EPFL CHILI ... • Compare importance of skills by their term frequency in job ads. [Chuck,](https://reader034.vdocuments.site/reader034/viewer/2022050418/5f8e2ca16fb3a1288f4e6768/html5/thumbnails/40.jpg)
Future Works
• Skill terms extraction
• Detecting emerging skills
• Skill gaps between education curricula and industrial requirements
40
Have a MSc in Computer Science, Electrical Engineering or related disciplines. Ph.D. degree is a plus Have advanced Java, Scala or Python programming skills. Experience with real-world data is a plus Have advanced data management skills, including knowledge of data curation, data governance and data stewardship Have hands-on experience with data manipulation using SparkSQL, Hive, HBase, Phoenix, Solr or similar using a leading Apache Hadoop distribution.
![Page 41: Detecting latent training · Detecting latent training needs from digital traces Phase IIIb EPFL CHILI ... • Compare importance of skills by their term frequency in job ads. [Chuck,](https://reader034.vdocuments.site/reader034/viewer/2022050418/5f8e2ca16fb3a1288f4e6768/html5/thumbnails/41.jpg)
Thank you
41