status, data transfer and processing
DESCRIPTION
ICP Tool Pack. Status, Data Transfer and Processing. Vilas Mandlekar, Nada Hamadeh and Yuri Dikhanov ICP Regional Coordinators Meeting 7-11 March 2005, Washington DC. Agenda. Status Report – ICP Tool Pack Work Flow and Data Exchange between Countries and Regions - PowerPoint PPT PresentationTRANSCRIPT
Status, Data Transfer Status, Data Transfer and Processingand Processing
Vilas Mandlekar, Nada Hamadeh and Yuri DikhanovVilas Mandlekar, Nada Hamadeh and Yuri DikhanovICP Regional Coordinators MeetingICP Regional Coordinators Meeting7-11 March 2005, Washington DC7-11 March 2005, Washington DC
ICP Tool Pack
AgendaAgenda
1.1. Status Report – ICP Tool Pack Status Report – ICP Tool Pack 2.2. Work Flow and Data Exchange between Work Flow and Data Exchange between
Countries and RegionsCountries and Regions3.3. Data Processing Module – DemoData Processing Module – Demo4.4. Q & AQ & A
Tool PackTool Pack Status UpdateStatus Update
Price Collection Module (PCM)Price Collection Module (PCM)
Export to Excel -- Price observations once entered can be Export to Excel -- Price observations once entered can be downloaded to Excel for viewing or recording downloaded to Excel for viewing or recording Impact on Data Transfer screen – one new buttonImpact on Data Transfer screen – one new button
““Cut and Paste” of observations from other sources (Excel) Cut and Paste” of observations from other sources (Excel) into the PCM multiple product data entry screeninto the PCM multiple product data entry screen Impact on Multiple Products data entry screen – one Impact on Multiple Products data entry screen – one
new icon on the gridnew icon on the grid Option to recompute converted pricesOption to recompute converted prices
Impact on Data Editing screen – one new button that Impact on Data Editing screen – one new button that appears only if product parameters have changedappears only if product parameters have changed
Tool Pack 1.2 – what’s changed since 1.1?
Price Administration Module (PAM)Price Administration Module (PAM)
No change in the screen layouts or text appearing on No change in the screen layouts or text appearing on screensscreens
Items (products/observations) beyond tolerance are Items (products/observations) beyond tolerance are highlighted in red in the Diagnostics Tables.highlighted in red in the Diagnostics Tables.
Old Excel templates used in PAM 1.1 are NOT useable in Old Excel templates used in PAM 1.1 are NOT useable in 1.21.2 Download blank templates for each of the Master data Download blank templates for each of the Master data
–products lists, characteristics, characteristic values, –products lists, characteristics, characteristic values, specifications, outlets and their mapping etc. specifications, outlets and their mapping etc.
““Cut and Paste” product lists etc. from old templates Cut and Paste” product lists etc. from old templates into the new templatesinto the new templates
Upload into PAM 1.2Upload into PAM 1.2
Tool Pack 1.2 – what’s changed since 1.1?
Data Processing Module (DPM)Data Processing Module (DPM)
New module primarily for regional use, but also used by countries
Region can create templates, i.e. selections of products, locations, attributes etc., and time periods over which the countries provide their data
Enter Exchange rates, population, expenditures, and weights (optional)
Run Quaranta Tables, Index processing, and produce Reports
Tool Pack 1.2 – what’s changed since 1.1?
Data Processing Module (DPM)Data Processing Module (DPM)
For ICP purposes, country use is limited to:1. Import a template from the Regional Coordinator2. Export average or raw prices data to Regional
Coordinator Tested by Statistics CanadaTested by Statistics Canada DPM User Manual and DPM Summary Steps preparedDPM User Manual and DPM Summary Steps prepared DPM Substantive Manual / Step-by-Step Guide underwayDPM Substantive Manual / Step-by-Step Guide underway
Tool Pack 1.2 – what’s changed since 1.1?
What do Countries need to know about Tool Pack 1.2 ?What do Countries need to know about Tool Pack 1.2 ? There’s There’s very little or no changevery little or no change between 1.1 and 1.2 in terms between 1.1 and 1.2 in terms
of functions of price observations data entry and running of functions of price observations data entry and running preliminary diagnostic reportspreliminary diagnostic reports
Countries receive from regions a selection of product lists Countries receive from regions a selection of product lists and time periods over which the price observations are and time periods over which the price observations are requiredrequired
Countries generate average prices data (Excel format) using Countries generate average prices data (Excel format) using the DPM module and send it to the Regional Coordinator the DPM module and send it to the Regional Coordinator
Raw prices (optionally) Raw prices (optionally) cancan be sent by countries to the be sent by countries to the Region for index processingRegion for index processing
Tool Pack 1.2 – what’s changed since 1.1?
How do Countries/Regions upgrade to Tool Pack 1.2 ?How do Countries/Regions upgrade to Tool Pack 1.2 ? RegionsRegions
Install the PAM 1.2 after first un-installing the PAM 1.1 Install the PAM 1.2 after first un-installing the PAM 1.1 Input the product lists and any attributes (location Input the product lists and any attributes (location
attribute such as, Rural/Urban) for their countries, using attribute such as, Rural/Urban) for their countries, using new Excel templates in PAM 1.2new Excel templates in PAM 1.2
Regions DO NOT normally NEED PCM to be installedRegions DO NOT normally NEED PCM to be installedCountriesCountries
If they have a PAM 1.1 already installed, then use the If they have a PAM 1.1 already installed, then use the patch to upgrade to 1.2. Data entered under 1.1 will not be patch to upgrade to 1.2. Data entered under 1.1 will not be disturbed due to this upgradedisturbed due to this upgrade
They can also install PAM 1.2 afresh if they want to enter They can also install PAM 1.2 afresh if they want to enter their product lists and observations againtheir product lists and observations again
Tool Pack 1.2 – what’s changed since 1.1?
Countries not using PCM can use the Batch Upload Utility Countries not using PCM can use the Batch Upload Utility to upload their data into the PAM to perform data to upload their data into the PAM to perform data validationvalidation
Tried and tested by Statistics Canada in their pilot Tried and tested by Statistics Canada in their pilot collectioncollection
Stand-alone utilityStand-alone utility
File for upload of observations must be in “CSV” formatFile for upload of observations must be in “CSV” format
Batch Upload User guide and CSV file formatBatch Upload User guide and CSV file format
Batch Upload Utility for Price Observations
Countries might require the help of RC team to convert Countries might require the help of RC team to convert their files into the CSV file formattheir files into the CSV file format
Fields in the file must follow a prescribed layout
Product codes, UoM codes, UoM conversions must exist on the PAM before upload
Utility is in English i.e. the screens labels and messages are in English
Batch Upload Utility for Price Observations
Tool Pack 1.2 – Status of implementation
Africa Asia ESCWA LAC CISDelivery of ToolPack 1.2
CD sent Feb 24 CD sent Jan 28. Sent again Feb 28 (via WB Manila office)
Version 1.2 sent on Mar. 8
Sent Jan 19 ??
Documentation DPM user guide and summary steps sent
DPM user guide and summary steps sent
DPM user guide and summary steps to be sent
DPM user guide and summary steps sent
??
Africa Asia ESCWA LAC CISTraining on DPM To be arranged To be arranged To be arranged StatCanada staff
trained in Washington
??
Translation Some PAM and all of DPM strings need to be translated to French
All Chinese translations done
Only DPM strings need to be translated to Arabic
Some PAM and all of DPM strings need to be translated to Spanish
Some PAM and all of DPM strings need to be translated to Russian
Tool Pack 1.2 – Status of implementation
Other news and issues
HHD – ESCWA funded and specified a hand held computer based price collection module. To be finalized in Arabic and English by March end.
Transferring Tool Pack software to Regional Coordinator Offices – use of the World Bank FTP site or website for software upgrades/patches.
Training of Regional Coordinators staff on DPM.
Lessons from LAC pilot data collectionLessons from LAC pilot data collection
3 types of problems:3 types of problems: BugsBugs Erroneous use of the system by countriesErroneous use of the system by countries New functionalities requiredNew functionalities required
Countries have different levels of technological Countries have different levels of technological capabilitiescapabilities
Tool Pack needs close support from regional and Tool Pack needs close support from regional and global officesglobal offices
Troubleshooting capabilitiesTroubleshooting capabilities All documentation should be translatedAll documentation should be translated
Tool PackTool Pack Workflow Workflow and Data Exchangeand Data Exchange
Country PAM / DPM
Country PCM (s)
2- Data Collection
5- Setup
Region PAM / DPM
9- Index Processing
ObservationsSurvey Details
1- Setup 4- Data Validation 7- Data Transfer to/from Region
PAM DPM
Average Price
Templates
Individual or Average Prices
8- InterCountry
Validation
6- Data Transfer to/from Country
3- Data Entry and Editing
10- Reports
Country PAM
1- Setup
• ProductsProducts• AttributesAttributes• OutletsOutlets• Price CollectorsPrice Collectors• Mapping Products – Outlets – Price CollectorsMapping Products – Outlets – Price Collectors• SurveysSurveys
Survey DetailsSurvey Details
XML fileXML file Survey products, outlets and price collectors Survey products, outlets and price collectors
detailsdetails
Country PCM (s)
2- Data Collection:
• Printing Data Collection FormsPrinting Data Collection Forms
3- Data Entry and Editing:
• Data EntryData Entry• Data EditingData Editing• Outlier AnalysisOutlier Analysis
ObservationsObservations
XML fileXML file Individual observations (including outliers Individual observations (including outliers
if the country chose to keep the outliers)if the country chose to keep the outliers)
Country PAM
4- Data Validation (Diagnostic Reports)
• Product Level Diagnostics – Table 1Product Level Diagnostics – Table 1• Observation Level Diagnostics – Table 2Observation Level Diagnostics – Table 2
Region PAM / DPM
5- Setup
• ProductsProducts• AttributesAttributes• PopulationPopulation• ExpendituresExpenditures• Exchange RatesExchange Rates
Region PAM / DPM
6- Data Transfer to/from Country
• Send Average Price TemplatesSend Average Price Templates• Receive Average Prices + IndicatorsReceive Average Prices + Indicators• Receive Individual PricesReceive Individual Prices
Average Price TemplatesAverage Price Templates
Analytical template XML fileAnalytical template XML file Means of data selection to ensure data Means of data selection to ensure data
qualityquality Determines timeframe coverage, product Determines timeframe coverage, product
selection, breakdown by outlet types, and selection, breakdown by outlet types, and attributesattributes
Average prices + indicators (coefficient of Average prices + indicators (coefficient of variation)variation)
Country DPM
7- Data Transfer to/from Region
• Receive Average Price Templates• Send Individual prices• Send Average prices + indicators• By outlet types? • By attribute breakdown?
Individual or Average PricesIndividual or Average Prices
Individual prices (preferred) --- xml fileIndividual prices (preferred) --- xml file Average prices + indicators (minimum Average prices + indicators (minimum
requirement to run Quaranta Table) --- requirement to run Quaranta Table) --- Excel fileExcel file
Index processing can be run with individual Index processing can be run with individual prices or with average prices.prices or with average prices.
Region PAM / DPM
8- Inter Country Validation
• Quaranta TableQuaranta Table• Iterations between region and countries Iterations between region and countries
to revisit some average pricesto revisit some average prices
Region PAM / DPM
9- Index Processing
• Multiple price indicesMultiple price indices• PPPs, Average Prices, and Real ExpendituresPPPs, Average Prices, and Real Expenditures
Region PAM / DPM
10- Reports
• Average pricesAverage prices• Price indicesPrice indices• Real and nominal expendituresReal and nominal expenditures• Per capita real and nominal expendituresPer capita real and nominal expenditures
Country PAM / DPM
5- Setup
Region PAM / DPM
9- Index Processing
1- Setup 4- Data Validation 7- Data Transfer to/from Region
PAM DPM
Average Price
Templates
Individual or Average Prices
8- InterCountry
Validation
6- Data Transfer to/from Country
10- Reports
Country CPI systems
2- Data Collection 3- Data Entry and Editing
Observations through Batch Upload
Data Processing ModuleData Processing ModuleDemonstrationDemonstration