LMI For All

Documentation & Development

User Tools

Site Tools


Sidebar

Start Pages

Team Pages

Upcoming Events

Apr 24 Modding Day
data:issues_on_data_integration

Table of Contents

ESS

SUM(vacancies) on essRegionalVac returns 330888 and on essUKVac it returns 330876… We think they should be the same. Assuming that they are the same (or close enough), can we loose the essUKVac table? Dave to tidy up DAVE HAS CHECKED THIS AND THINKS THE COMMENT IS OUT OF DATE AND REDUNDANT

Qualification

We have qualification in LFS, Earnings and WF. How are they related?

Qualifications in Working Futures ('WFDataOcc4Digit.csv') and the Earnings data ('estPay2011.csv' and 'estPay2012.csv')

id nqfQCF
1 NQF 8QCF8 Doctorate
2 NQF 7QCF7 Other higher degree
3 NQF 6QCF6 First degree
4 NQF 5QCF5 Foundation degree;Nursing;Teaching
5 NQF 4QCF4 HE below degree level
6 NQF 3QCF3 A level & equivalent
7 NQF 2QCF2 GCSE(A-C) & equivalent
8 NQF 1QCF1 GCSE(below grade C) & equivalent
9 No QualificationNo Qualification

QCF and NQF are basically equivalent as indicated. I THINK THIS ANSWERS THE QUESTION? RAW 11/07/2014

Aggregated QCF is equivalent to NQF (old).

idAggregated QCFNQF (old)
1 QCF 7-8NQF 5
2 QCF 4-6NQF 4
3 QCF 3NQF 3
4 QCF 2NQF 2
5 QCF 1NQF 1
6 No QualificationNQF 0

File 'WFDataOcc4Digit.csv' does not make use of these qualifications data, [these categories may not be used]. THIS IS NOT CORRECT - THE 4-DIGIT DATA FILE USE THE FULL SET OF NQF8-0 CATEGORIES RAW 11/07/2014

Employment is classified into 9 broad qualification categories and 6 aggregated qualification groups:

id QCF id QCF aggregated
1 QCF8 Doctorate 1 QCF 7-8 Higher degree
2 QCF7 Other higher degree
3 QCF6 First degree 2 QCF 4-6 First degree & other HE
4 QCF5 Foundation degree;Nursing;Teaching
5 QCF4 HE below degree level
6 QCF3 A level & equivalent 3 QCF 3 A level & equivalent
7 QCF2 GCSE(A-C) & equivalent 4 QCF 2 GCSE(A-C) & equivalent
8 QCF1 GCSE(below grade C) & equivalent 5 QCF 1 GCSE(below grade C) & equivalent
9 No qualification 6 No qualification

Earnings data from LFS:

id qualification
1 Degree or equivalent
2 Higher education
3 GCE, A-level or equivalent
4 GCSE grades A*-C or equivalent
5 Other qualifications
6 No qualification

This is based on LFS variable hiqual11d THIS IS NOW REDUNDANT ALL THE PAY DATA USE THE NQF* CATEGORIES RAW 11/07/2014

Region

LFS and ESS use same regions. Earnings need to map to LFS regions (seems simple, but is it??). Yes

LFS and ESS:

id region code
1 London UKI
2 South East (England) UKJ
3 East of England UKH
4 South West (England) UKK
5 West Midlands (England) UKG
6 East Midlands (England) UKF
7 Yorkshire and the Humber UKE
8 North West (England) UKD
9 North East (England) UKC
10 Wales UKL
11 Scotland UKM
12 Northern Ireland UKN

WF and Earnings: (looks the same as above, needs checking)

idGovernment Office Region (standard ordering)
1 London
2 South East
3 East of England
4 South West
5 West Midlands
6 East Midlands
7 Yorks & the Humber
8 North West
9 North East
10 Wales
11 Scotland
12 Northern Ireland

File 'WFDataOcc4Digit.csv' does not make use of the data in the following region ordering: AGAIN THIS IS NOT CORRECT - THE 4-DIGIT DATA FILE USE THE FULL SET OF NQF8-0 CATEGORIES RAW 11/07/2014

This is the ordering used originally for Earnings:

id Region
1 London
2 North East
3 North West
4 Yorkshire & Humberside
5 East Midlands
6 West Midlands
7 Eastern
8 South East
9 South West
10 Wales
11 Scotland
12 Northern Ireland

This is now redundant. The revised data will use the standard ordering for regions. AS NOTED THIS ALL SEEMS REDUNDANT THE STANDARD ORDER HAS BEEN ADOPTED AS IN THE FIRST LFS/ESS TABLE RAW 11/07/2014

Industry

LFSIndustry (88 rows) and earnings Industry (79 rows) and WF75/WF79 (75 and 79 rows) How are they related? How can we integrate them?? We should use 75 throughout. LFS and ESS(?) need aggregating to 75. AGAIN I THINK THIS IS ALL REDUNDANT THE 75 INDUSTRIES ARE NOW USED THROUGHOUT? RAW 11/07/2014

idSIC: Industry Name (75)
101-03: Agriculture, etc
205-09: Coal, oil & gas; Mining & related
310: Food products
411: Beverages & tobacco
513: Textiles
614,15: Wearing apparel; Leather, etc
716: Wood, etc
817: Paper, etc
918: Printing & recording
1019,20: Coke & refining; Chemicals,etc
1121: Pharmaceuticals
1222: Rubber & plastic
1323: Other non-metallic
1424: Basic metals
1525: Metal products
1626: Computers, etc
1727: Electrical equipment
1828: Machinery, etc
1929: Motor vehicles, etc
2030: Other trans. equipment
2131: Furniture
2232: Other manufacturing
2333: Repair & installation
2435: Electricity, gas, etc
2536: Water
2637: Sewerage
2738-39: Waste management
2841: Construction
2942: Civil engineering
3043: Specialised construction
3145: Sale of motor vehicles
3246: Wholesale trade
3347: Retail trade
3449: Land transport, etc
3550: Water transport
3651: Air transport
3752: Warehousing, etc
3853: Postal, etc
3955: Accommodation
4056: Food & beverage services
4158: Publishing activities
4259: Film & music
4360: Broadcasting
4461: Telecommunications
4562: Computer programming, etc
4663: Information services
4764: Financial services
4865: Insurance & pensions
4966: Auxiliary services
5068: Real estate
5169: Legal & accounting
5270: Head offices, etc
5371: Architectural & related
5472: Scientific research
5573: Advertising, etc
5674: Other professional
5775: Veterinary
5877: Rental & leasing
5978: Employment activities
6079: Travel, etc
6180: Security, etc
6281: Services to buildings
6382: Office admin.
6484: Public admin. & defence
6585: Education
6686: Health
6787: Residential care
6888: Social work
6990: Arts & entertainment
7091: Libraries, etc
7192: Gambling
7293: Sport & recreation
7394: Membership organisations
7495: Repair of goods
7596-99: Other personal service
idSIC: Industry Name (79)
101-03: Agriculture, etc
205-06: Coal, oil & gas
307-08: Other mining and quarrying
409: Mining support
510: Food products
611: Beverages & tobacco
713: Textiles
814: Wearing apparel
915: Leather, etc
1016: Wood, etc
1117: Paper, etc
1218: Printing & recording
1319: Coke & refining
1420: Chemicals,etc
1521: Pharmaceuticals
1622: Rubber & plastic
1723: Other non-metallic
1824: Basic metals
1925: Metal products
2026: Computers, etc
2127: Electrical equipment
2228: Machinery, etc
2329: Motor vehicles, etc
2430: Other trans. equipment
2531: Furniture
2632: Other manufacturing
2733: Repair & installation
2835: Electricity, gas, etc
2936: Water
3037: Sewerage
3138-39: Waste management
3241: Construction
3342: Civil engineering
3443: Specialised construction
3545: Sale of motor vehicles
3646: Wholesale trade
3747: Retail trade
3849: Land transport, etc
3950: Water transport
4051: Air transport
4152: Warehousing, etc
4253: Postal, etc
4355: Accommodation
4456: Food & beverage services
4558: Publishing activities
4659: Film & music
4760: Broadcasting
4861: Telecommunications
4962: Computer programming, etc
5063: Information services
5164: Financial services
5265: Insurance & pensions
5366: Auxiliary services
5468: Real estate
5569: Legal & accounting
5670: Head offices, etc
5771: Architectural & related
5872: Scientific research
5973: Advertising, etc
6074: Other professional
6175: Veterinary
6277: Rental & leasing
6378: Employment activities
6479: Travel, etc
6580: Security, etc
6681: Services to buildings
6782: Office admin.
6884: Public admin. & defence
6985: Education
7086: Health
7187: Residential care
7288: Social work
7390: Arts & entertainment
7491: Libraries, etc
7592: Gambling
7693: Sport & recreation
7794: Membership organisations
7895: Repair of goods
7996-99: Other personal service
idSIC Industry Name (SIC Divisions - 2 Digit)
101 Crop and animal production, hunting and related service activities
202 Forestry and logging
303 Fishing and aquaculture
405 Mining of coal and lignite
506 Extraction of crude petroleum and natural gas
607 Mining of metal ores
708 Other mining and quarrying
809 Mining support service activities
910 Manufacture of food products
1011 Manufacture of beverages
1112 Manufacture of tobacco products
1213 Manufacture of textiles
1314 Manufacture of wearing apparel
1415 Manufacture of leather and related products
1516 Manufacture of wood and of products of wood and cork, except furniture; manufacture of articles of straw and plaiting materials
1617 Manufacture of paper and paper products
1718 Printing and reproduction of recorded media
1819 Manufacture of coke and refined petroleum products
1920 Manufacture of chemicals and chemical products
2021 Manufacture of basic pharmaceutical products and pharmaceutical preparations
2122 Manufacture of rubber and plastic products
2223 Manufacture of other non-metallic mineral products
2324 Manufacture of basic metals
2425 Manufacture of fabricated metal products, except machinery and equipment
2526 Manufacture of computer, electronic and optical products
2627 Manufacture of electrical equipment
2728 Manufacture of machinery and equipment n.e.c.
2829 Manufacture of motor vehicles, trailers and semi-trailers
2930 Manufacture of other transport equipment
3031 Manufacture of furniture
3132 Other manufacturing
3233 Repair and installation of machinery and equipment
3335 Electricity, gas, steam and air conditioning supply
3436 Water collection, treatment and supply
3537 Sewerage
3638 Waste collection, treatment and disposal activities; materials recovery
3739 Remediation activities and other waste management services
3841 Construction of buildings
3942 Civil engineering
4043 Specialised construction activities
4145 Wholesale and retail trade and repair of motor vehicles and motorcycles
4246 Wholesale trade, except of motor vehicles and motorcycles
4347 Retail trade, except of motor vehicles and motorcycles
4449 Land transport and transport via pipelines
4550 Water transport
4651 Air transport
4752 Warehousing and support activities for transportation
4853 Postal and courier activities
4955 Accommodation
5056 Food and beverage service activities
5158 Publishing activities
5259 Motion picture, video and television programme production, sound recording and music publishing activities
5360 Programming and broadcasting activities
5461 Telecommunications
5562 Computer programming, consultancy and related activities
5663 Information service activities
5764 Financial service activities, except insurance and pension funding
5865 Insurance, reinsurance and pension funding, except compulsory social security
5966 Activities auxiliary to financial services and insurance activities
6068 Real estate activities
6169 Legal and accounting activities
6270 Activities of head offices; management consultancy activities
6371 Architectural and engineering activities; technical testing and analysis
6472 Scientific research and development
6573 Advertising and market research
6674 Other professional, scientific and technical activities
6775 Veterinary activities
6877 Rental and leasing activities
6978 Employment activities
7079 Travel agency, tour operator and other reservation service and related activities
7180 Security and investigation activities
7281 Services to buildings and landscape activities
7382 Office administrative, office support and other business support activities
7484 Public administration and defence; compulsory social security
7585 Education
7686 Human health activities
7787 Residential care activities
7888 Social work activities without accommodation
7990 Creative, arts and entertainment activities
8091 Libraries, archives, museums and other cultural activities
8192 Gambling and betting activities
8293 Sports activities and amusement and recreation activities
8394 Activities of membership organisations
8495 Repair of computers and personal and household goods
8596 Other personal service activities
8697 Activities of households as employers of domestic personnel
8798 Undifferentiated goods- and services-producing activities of private households for own use
8899 Activities of extraterritorial organisations and bodies

Aggregation SIC Division to 75 Industries

Ind75 industry [SIC] SIC2007 Division (2-digit)
1Agriculture, etc [01-03]101 Crop and animal production, hunting and related service activities
202 Forestry and logging
303 Fishing and aquaculture
2Coal, oil & gas; Mining & related [05-09]405 Mining of coal and lignite
506 Extraction of crude petroleum and natural gas
607 Mining of metal ores
708 Other mining and quarrying
809 Mining support service activities
3Food products [10]910 Manufacture of food products
4Beverages and tobacco [11-12]1011 Manufacture of beverages
1112 Manufacture of tobacco products
5Textiles [13]1213 Manufacture of textiles
6Wearing apparel; Leather, etc [14,15]1314 Manufacture of wearing apparel
1415 Manufacture of leather and related products
7Wood and cork [16]1516 Manufacture of wood and of products of wood and cork, except furniture; manufacture of articles of straw and plaiting materials
8Paper, etc [17]1617 Manufacture of paper and paper products
9Printing and recording [18]1718 Printing and reproduction of recorded media
10Coke and petroleum; Chemicals, etc [19,20]1819 Manufacture of coke and refined petroleum products
1920 Manufacture of chemicals and chemical products
11Pharmaceuticals [21]2021 Manufacture of basic pharmaceutical products and pharmaceutical preparations
12Rubber and plastic [22]2122 Manufacture of rubber and plastic products
13Other non-metallic [23]2223 Manufacture of other non-metallic mineral products
14Basic metals [24]2324 Manufacture of basic metals
15Metal products [25]2425 Manufacture of fabricated metal products, except machinery and equipment
16Computer, etc [26]2526 Manufacture of computer, electronic and optical products
17Electrical equipment [27]2627 Manufacture of electrical equipment
18Machinery n.e.c. [28]2728 Manufacture of machinery and equipment n.e.c.
19Motor vehicles, etc [29]2829 Manufacture of motor vehicles, trailers and semi-trailers
20Other transport equipment [30]2930 Manufacture of other transport equipment
21Furniture [31]3031 Manufacture of furniture
22Other manufacturing [32]3132 Other manufacturing
23Repair and installation [33]3233 Repair and installation of machinery and equipment
24Electricity, gas, etc [35]3335 Electricity, gas, steam and air conditioning supply
25Water [36]3436 Water collection, treatment and supply
26Sewerage [37]3537 Sewerage
27Waste management [38-39]3638 Waste collection, treatment and disposal activities; materials recovery
3739 Remediation activities and other waste management services
28Construction [41]3841 Construction of buildings
29Civil engineering [42]3942 Civil engineering
30Specialised construction [43]4043 Specialised construction activities
31Motor vehicle trade [45]4145 Wholesale and retail trade and repair of motor vehicles and motorcycles
32Wholesale trade [46]4246 Wholesale trade, except of motor vehicles and motorcycles
33Retail trade [47]4347 Retail trade, except of motor vehicles and motorcycles
34Land transport, etc [49]4449 Land transport and transport via pipelines
35Water transport [50]4550 Water transport
36Air transport [51]4651 Air transport
37Warehousing, etc [52]4752 Warehousing and support activities for transportation
38Postal and courier [53]4853 Postal and courier activities
39Accommodation [55]4955 Accommodation
40Food and beverage services [56]5056 Food and beverage service activities
41Publishing activities [58]5158 Publishing activities
42Film and music [59]5259 Motion picture, video and television programme production, sound recording and music publishing activities
43Broadcasting [60]5360 Programming and broadcasting activities
44Telecommunications [61]5461 Telecommunications
45Computing services [62]5562 Computer programming, consultancy and related activities
46Information services [63]5663 Information service activities
47Financial services [64]5764 Financial service activities, except insurance and pension funding
48Insurance and pensions [65]5865 Insurance, reinsurance and pension funding, except compulsory social security
49Auxiliary financial services [66]5966 Activities auxiliary to financial services and insurance activities
50Real estate [68]6068 Real estate activities
51Legal and accounting [69]6169 Legal and accounting activities
52Head offices, etc [70]6270 Activities of head offices; management consultancy activities
53Architectural and related [71]6371 Architectural and engineering activities; technical testing and analysis
54Scientific research and development [72]6472 Scientific research and development
55Advertising, etc [73]6573 Advertising and market research
56Other professional [74]6674 Other professional, scientific and technical activities
57Veterinary [75]6775 Veterinary activities
58Rental and leasing [77]6877 Rental and leasing activities
59Employment activities [78]6978 Employment activities
60Travel, etc [79]7079 Travel agency, tour operator and other reservation service and related activities
61Security, etc [80]7180 Security and investigation activities
62Services to buildings [81]7281 Services to buildings and landscape activities
63Office administrative [82]7382 Office administrative, office support and other business support activities
64Public administration and defence [84]7484 Public administration and defence; compulsory social security
65Education [85]7585 Education
66Health [86]7686 Human health activities
67Residential care [87]7787 Residential care activities
68Social work [88]7888 Social work activities without accommodation
69Arts and entertainment [90]7990 Creative, arts and entertainment activities
70Libraries, etc [91]8091 Libraries, archives, museums and other cultural activities
71Gambling and betting [92]8192 Gambling and betting activities
72Sport and recreation [93]8293 Sports activities and amusement and recreation activities
73Membership organisations [94]8394 Activities of membership organisations
74Repair of goods [95]8495 Repair of computers and personal and household goods
75Other personal service [96-99]8596 Other personal service activities
8697 Activities of households as employers of domestic personnel
8798 Undifferentiated goods- and services-producing activities of private households for own use
8899 Activities of extraterritorial organisations and bodies

Gender

WF uses 1 male, 2 female as does the LFS

data/issues_on_data_integration.txt · Last modified: 2014-07-30 10:09 by Luke Bosworth