statistics 2020 and platform approach te käpehu whetü may 2011
TRANSCRIPT
Statistics 2020 and Platform Approach
Te Käpehu Whetü
May 2011
Agenda
Current Legacy Architecture
Statistics NZ Strategic Plan 2010-20
Te Käpehu Whetü - Statistics 2020
IT Strategy 2009–12
Platform-based Architecture
Reuse, Integration and Transition
Current State of Play
Strategic Benefits
February 2011 2End to End Architecture Framework
3
Current Stovepiped Architecture
Collect50+ Collection Systems
CollectionSystem 1
CollectionSystem 2
CollectionSystem 3
CollectionSystem 4
CollectionSystem 5
CollectionSystem 6
CollectionSystem 7
CollectionSystem 8
…
CollectionSystem 50
Process80+ Processing
Systems
ProcessingSystem 1
ProcessingSystem 2
ProcessingSystem 3
ProcessingSystem 4
ProcessingSystem 5
ProcessingSystem 6
ProcessingSystem 7
ProcessingSystem 8
ProcessingSystem 9
ProcessingSystem 10
ProcessingSystem 11
ProcessingSystem 12
ProcessingSystem 13
ProcessingSystem 14
ProcessingSystem 15
ProcessingSystem 16
…
ProcessingSystem 80
Analyse50+ Output Systems
OutputSystem 1
OutputSystem 2
OutputSystem 3
OutputSystem 4
OutputSystem 5
OutputSystem 6
OutputSystem 7
OutputSystem 8
…
OutputSystem 50
Disseminate25+ Dissemination
Systems
DisseminationTool 1
DisseminationTool 2
DisseminationTool 3
…
DisseminationTool 25
Statistics NZ Strategic Plan 2010-20
4
Te Käpehu Whetü – Statistics 2020
A waka is navigated by aligning the points of the craft with the points on the horizon where the sun and particular stars rise and set
Whetu (the stars) Kapehu (compass)
Generic Business Process Model
Describes Statistics NZ's end-to-end statistical business process
It has been used as a model for international GSBPM
Processes are generic, across Statistics NZ, down to the sub-process level for all statistical collections and outputs
6
Need Develop & Design Build Collect Process Analyse Disseminate
Need Develop & Design Build
Corporate
Statistical Architecture Framework
7
Collect Process Analyse Disseminate
Colle
ction
Dis
sem
inati
on
Standards & Methods
Infrastructure
Micro EconomicMicro Economic
Macro EconomicMacro Economic
Social and PopulationSocial and PopulationCENSUSCENSUS
IT Infrastructure
Platforms
Tools & Services
Data
Enterprise Architecture Framework
8
Need Develop & Design Build Collect Process Analyse Disseminate
Sup
port
s
9
Enterprise Architecture FrameworkPlatforms
Tools & Services
Data
4
IT Infrastructure
Foundation Services
SQL Server (RDBMS)
SQL Server Integration Svcs
SQL Server Analysis Svcs
SQL Server Reporting Svcs SAS .Net Framework Internet Explorer MSCRM
Statistical Services Non Statistical Services Corporate Services
Statistical Data Non Statistical Data Corporate DataHH Survey Unit
Record
Time Series
Micro Economic Unit Record
Geospatial
Address Register
CENSUS
ClassificationsHousehold Frame
Business Frame Static & Dynamic
Research & Analysis Metadata
Concept Library
Statistical Activity Metadata
Runtime Metadata
Question Metadata
Location & Access Metadata
Collection Metadata
Paradata
Configuration
Customer
Finance
Human Resource
Editing(BANFF)
Selective Editing(SELEKT )
ConfigurationManagement
Collection Data PickupAggregation
Confidentiality Time Series Processing
Time Series Tools
Seasonal Adjust(X-12-ARIMA)
Classification Services
Dataset Definition Services Dataset CreationCoding
Imputation(BANFF)
Calc Weights(GregWt)
Jackknife(Estimation) Paradata Analysis Advertise
Metadata Management
Metadata Search
Customer Management
Workforce Management
Workflow
Editing (CANCEIS )
Imputation(CANCEIS )
Existing ProposedLegend:
Frames & Sampling
Collection
Micro-Economic
Macro-Economic
Social & Population
Dissemination
Information Analysis
Information Access
Metadata
Geospatial
Standards & Classifications
Platforms & Services Reuse
10
Platforms
Foundation Services
Tools & Services
Platform A Platform B
Combination of tools & services to perform business processes
Specialised – perform individual tasks
Performs task specific to collection
Reusable within platform
Platforms & Services Reuse
11
Platforms
Foundation Services
Tools & Services
Platform A Platform B
Combination of tools & services to perform business processes
Specialised – perform individual tasks
Performs task specific to collection
Reusable within platform
Cloud Services
12
Transition Phases – Current
Stats.govt.nzPOSS, BESt, DNA
Dissemination systems
25+
Processing systems
80+
Collection systems
50 +
Analysis/output systems
50 +
DisseminateProcessCollect Analyse(Produce Statistics)
Platforms
LegacySystems
Statistical Infrastructure systems – 50+
13
Transition Phases – Transition
Stats.govt.nz
Dissemination Platform
POSS, BEST & DNAHLFS Sub Annual
Surveys
DisseminateProcessCollect Analyse(Produce Statistics)
Platforms
LegacySystems
Statistical Infrastructure systems (foundation tools & services)
14
Transition Phases – Future
Stats.govt.nz
Dissemination Platform
Micro Economic PlatformMacro Economic Platform
Household & Population Platform
Collection Platform
DisseminateProcessCollect Analyse(Produce Statistics)
Platforms
LegacySystems
Statistical Infrastructure systems(foundation tools & services)
Household Survey Platform
15
Household Survey Platform - Survey Portal
Data Management
Metadata Management
Process Management Classify & Code
Micro Edit
Derive
FinaliseImpute
Calculate & Apply Weights
Quality Assurance
Classify & Code5.1
Perform Micro Editing
5.2
Impute Missing Data5.3
Derive New Variables
5.4
Calculate & Apply Weights
5.5
Integrate Data5.6
Finalise Unit Record Data
5.7
Acquire Domain Intelligence
6.1
Produce Statistics
6.2
Check Quality of Statistics
6.3
Interpret & Explain
Statistics6.4
Prepare Statistics for
Dissemination6.5
Finalise Content6.6
5 Process
6 Analyse
Sup
port
s
Aggregate Seasonally Adjust Confidentialise Advertise
Define Dataset
Household Survey Platform
16
Household Survey Platform - Survey Portal
Statistical Tools & Services Non Statistical Tools & Services
Data
IT Infrastructure
Data Management
Metadata Management
Classifications Configuration Process Logging Questionnaire Performance Household Frame Household Survey
Process Management Classify & Code
Micro Edit
Derive
FinaliseImpute
Calculate & Apply Weights
Quality Assurance
CodingCANCEIS (Imputation)
GregWt (Estimation)
Jackknife (Estimation)
ConfigurationManagement
Collection Data Pickup
Questionnaire Perform’ Analysis
SQL Server (RDBMS)
SQL Server Integration Services
SQL Server Analysis Services
SQL Server Reporting Services SAS .Net Framework Internet Explorer
Excel
Aggregation
Confidentiality Time Series Processing
Time Series Tools
Advertise
Time Series
Aggregate
Seasonally Adjust Confidentialise
X12(Seasonally Adjust)
Classification Services
Define Dataset
Micro Economic Platform
17
Micro Economic Platform – BESt UI
Data Management
Metadata Management
Process Management
Micro Edit
Derive
Impute
Quality Assurance
Classify & Code5.1
Perform Micro Editing
5.2
Impute Missing Data5.3
Derive New Variables
5.4
Calculate & Apply Weights
5.5
Integrate Data5.6
Finalise Unit Record Data
5.7
Acquire Domain Intelligence
6.1
Produce Statistics
6.2
Check Quality of Statistics
6.3
Interpret & Explain
Statistics6.4
Prepare Statistics for
Dissemination6.5
Finalise Content6.6
5 Process
6 Analyse
Sup
port
s
Aggregate Seasonally Adjust Confidentialise Publish
Define Dataset
Micro Economic Platform
18
Micro Economic Platform – BESt UI
Statistical Tools & Services Non Statistical Tools & Services
Data
IT Infrastructure
Data Management
Metadata Management
Classifications Configuration Process Logging Business Frame Micro Economic
Process Management
Micro Edit
Derive
Impute
Quality Assurance
BANFF (Imputation) SELEKT (Editing) Configuration
ManagementCollection Data
Pickup
SQL Server (RDBMS)
SQL Server Integration Services
SQL Server Analysis Services SAS .Net Framework
Aggregation
Confidentiality Time Series Processing
Time Series Tools
X12(Seasonally Adjust)
Classification Services
Info Access – Dataset Def’n Svcs
Info Access – Dataset Creation
Define Dataset
Advertise
Strategic Benefits
5 Key Benefits
Continued supply of important and
trusted statistics (B1)
An agile and responsive NSO able to respond to
changing needs (B2)
Costs to government, businesses, and
households minimised (B3)
Increased use of government data
(B4)
Government has confidence that its
investment in official statistics is value-for-money (B5)