External Trade Statistics

New Eurotrace and data exchange

1st External trade experts meeting

on the CARDS Programme

Luxembourg - May 2003

Pierre BALBONI - ESTAT/C0

The EU Data Exchange System

INTRASTAT, EXTRASTAT

and COMEXT Processing

MemberState

EUROSTAT

EXTRASTAT

Customs Declaration (SAD)

ExtraStat Monthly Filesent to EUROSTAT

COMEXT EEC Special Trade

COMEXT

Browser

DPS : Process and Control

MemberState

EUROSTAT

INTRASTAT

Enterprise Declaration

IntraStat Monthly Filesent to EUROSTAT

COMEXT EEC Special Trade

COMEXT

Browser

DPS : Process and Control

Data Processing

and

Quality

UN Data

COMTRADE : ==> Annual Data

IMF==> Total Product

Partner CountryData

Monthly DataReporter-Partner

Commodity : HS6 ++

EU Indices Seasonal adjusted data

DEMETRA

Transport Info.Statistical Procedure

ReconciliationExercise

Mirror Statistics

MirStatT

Data Derivation Chain

COMEXTDatabase

Monthly DataReporter-Partner

Commodity : HS6 ++Transport Info.

Statistical Procedure

EU in the World : Why ?

To extend data collection on a Common Basis : Reporter, Partner, HS6, Flow, Value, Quantity and Supplementary Unit, To share information and generate picture of Trade between different Partner Countries and EU, To be able to carry out mirror statistics, Reconciliation Exercise (with Transport and Statistical procedure information). To improve data quality by understanding of different concept and definitions used. And to unified External Trade Methodology following UN Concepts and Definitions

Candidate Countries

TACIS

MERCOSURCAN

ACP

EU in the WORLDWORLD Matrix

MED Countries

EFTA CARDS

USACanadaMexico

RussiaJapanChina

Bilateral data exchange

Bilateral Data Exchange

Partner Country Eurostat

COMEXTDatabase

EU in the World Framework : Data Exchange and Reciprocity

ExternalTrade

Database

CustomsDatabase

TransmissionRules

CD-ROM

COMEXT Browser

Online Connection

Data Controland Integration

Data Extractionand transformation

Partner Country

NewEurotrace Package

Eurostat

COMEXTDatabase

EU in the World Framework : New Eurotrace Software Integration

ExternalTrade

Database

CustomsDatabase

TransmissionRules

Data Controland Integration

Data Extractionand transformation

COMEXT Browser

Online Connection

CD-ROM

Internet

Regional Integration

COMESA secretariatregional collection of datasharing of information with member statesSouth South trade analysis and Mirror exercisescontact point for sharing of data with EUNorth South trade analysis

IT SolutionActually Eurotrace Regional Unix/Informix basedLink with COMEXT and Eurotrace Windows (end 2003)

Regional Center : the COMESA Example

NationalData

EuropeanCommission

EUROSTAT

RegionalData

EurotraceDOS

EurotraceWindows

CustomSystem

COMEXT ReferenceDatabase

Shared Information(www.Eurotrace.org Web Site)

(March 2003)Exchange Rate

Reference Table HS2000, HSSITC

EurotraceRegional

Member State AnalysisMirror Exercise

Regional Studies Publication

Eurotrace framework Architecture

New Eurotrace Windows

With COMEXT Browser

a tools to process External Trade

Statistics

New Eurotrace Windows Package : Why ?

To follow IT Evolution,

Integrate functionalities into a modular scheme that could be easily extended,

Simplify data exchange procedure via integrated methods and reduce Partner countries workload,

Provide technical helpdesk to Partner countries and give them access to all necessary information.

Eurotrace DOS/Unix current weaknesses

Programs and interfaces are DOS or Unix based

Fixed structure for Custom Declaration Storage

Manual intervention for data integration

Fixed data bank definition

Limited software connectivity

Windows based program without any licenses

Data structure could be completely defined

Automatisation of data integration

Data derivation module fully customizable

Eurostat based and used software Data storage under MS Access

Mostly CUSTOMS DECLARATION

DataSources

External Trade Statistical Production System Implementation

with Comext/Eurotrace Package

DataRequests

EUROSTATMedComext

UNIMF

Country Tableand Publication

External Trade DatabaseDefinition

External Trade Database

RAW DATAEnterprise Indices

Estimation

Data Integration Procedure

COMEXT Stand-Alone

Browser

Derived Data

Source Dataset

ClassificationPlan

Eurotrace ActorsHow to design a Domain ?

4. Data that can be consulted ?

Statistical OfficeStatistics Users

2. Data that can be collected ?

Trade Statistics data Supplier,

Statistical Office

DataEditor

3. Ways Data is Keyed in and Controlled ?

Data Coders,Data Controller

1. How to Define Trade Statistical Database ?Nomenclatures Expert,

Trade Information System Expert

Network Management

WorkstationData Entry

Data Browser

Stand AloneComputerData Entry

Data Browser

Pseudo-ServerData Storage

Data Importation

Stand-Alone PCData Storage

Data Entry/Browser

Eurotrace DOMAIN

Definition

Dictionary

Dictionary

Dictionary

Classification Plan

Classification PlanManaging Nomenclatures

and Relations between Nomenclatures

HS

SITCBEC

Enterprise

Activity

NUTS

GeoNom.

Definition

Eurotrace DOMAIN

Dictionary

Dictionary

Dictionary

Classification Plan

Dataset Source

Source Data

1. Define Data StructureFree definition of data

container using Dictionaries

Data Entry/CorrectionDirect Validation

Source Dataset

Files Importation Asycuda,Old Eurotrace,...

Validation

3. Define Data Integration Algorithm

Free definition data transformation used by

Importation Wizard

2. Source Data StructureFree definition of data Source Structure for

Automatic Integration

Data Entry/Data Correction

1. Database Extraction• Single File• Record Locking Security• Extraction Criteria

2. Data Editor• Appending New Records• Record Modification• “Undo” functionality• Header/Detail decomposition• Validation “On The Fly”

5. Code List Selector• Hierarchy selection• Code Validation

3. Error Trapping• Wrong Codes Highlighted• Errors to be Corrected

6. Record Navigator• Select a specific record directly• View data in Table based format

4. Form Designer• Define your own Customs Declaration Form• Hide/Mask some fields• Move Boxes using Mouse

7. Database Update• File sent to administrator to update to Main Database• Errors could be corrected one after the others (No lock in processes)• Database Records Unlocked

Intranet WEB Link

8. Direct Link• Direct update of Mainframe database• Web based Interface• Future functionality

Source Dataset Management

Data Monitoringand History back-up

Error Correction WizardCheck Importation Errors

and Step by Step Correction Tool

Definition

Eurotrace DOMAINDataset Source

Dictionary

Dictionary

Dictionary

Classification Plan

Source Data

DerivedDataset

DerivedDataset

Upgrad

eUpgrade

1. Define Derived Dataset AlgorithmFree data definition based on Declaration

source, transcodification and conversion Table

2. Simple Interface to Upgrade DatabankMonth to be upgrade could be selectedin order to have a global control on

Reference data Maintenance

Data Banks : Derived Dataset

Upgrade

Definition

Eurotrace DOMAIN

DerivedDataset

DerivedDataset

Dataset Source

Dictionary

Dictionary

Dictionary

Classification Plan

Source Data

Upgrad

eUpgrade

Dissemination/Analysis

COMEXT Stand/AloneA common Interface for Data

Dissemination

Eurotrace Native Data, CD-ROM,

EU MainFrame Database

Criteria Selection and Data Browsing

Comext Plan

COMEXTStand-Alone

Formula definitions COMEXT

Stand-Alone

Dump to Excel COMEXTStand-Alone

Nomenclatures Repository

And itslabels

The nomenclature

COMEXTStand-Alone

Eurotrace DOMAIN

Definition

DerivedDataset

DerivedDataset

Dataset Source

Dictionary

Dictionary

Dictionary

Classification Plan

Source Data

Upgrad

eUpgradeUSER-FRIENDLY INTERFACE

Dissemination/Analysis

Eurotrace LocalAdministrator Black Box

orInstallation mission

Parameters

Eurotrace Windows new Functionalities

Data Backup facilities

Multilingual capabilities

Standard Exportation (Word, Excel, XML, HTML,...)

Guided Data entry (Validation ‘on the fly’)

Simplified Data Download (Currency Rate, …)

‘What’s this’ online Help System Administration and Validation (Data to be integrated, Banks to be upgraded, System check, missing information, ...)

Eurotrace Importation Time

Test onPentium III

700 Mhz512MB RAM

Win NT4.0

Number of Records 50,000 300,000 500,000 750,000 1,000,000 2,000,000

New Importation 0:01:17 0:08:13 0:14:17 0:23:15 0:33:31 2:39:00

0:00:00

0:05:00

0:10:00

0:15:00

0:20:00

0:25:00

0:30:00

0:35:00

0 200,000 400,000 600,000 800,000 1,000,000

Future Evolutions

CUSTOMS DECLARATION

EUROSTATExchange

UNIMF

External Trade Database

RAW DATA

Data Integration Procedure

COMEXT Stand-Alone

Browser

TestJan. 2003

Indices ModuleTest : June 2003

Indices

TradeIndicesModule

Enterprise

Country Tableand Publication

Enterprise Register

And PublicationToolkit2004

EnterpriseRegister

Eurotrace Windows Architecture And Future

Mirror StatisticsAnd

Reconciliation(Regional)

2004

MirStatTReconciliation

Eurotrace Windows Architecture And Future

CUSTOMS DECLARATION

EUROSTATExchange

UNIMF

External Trade Database

RAW DATA

Data Integration Procedure

COMEXT Stand-Alone

Browser

ImplementationJuly 2003

Estimation

Your Own Module

When you want

Trade underThreshold Estimation

Short-Term

Short TermIndicator

Publication

Your Own Module

Why and How

Eurotrace Windows Architecture And Future

CUSTOMS DECLARATION

EUROSTATExchange

UNIMF

External Trade Database

RAW DATA

Data Integration Procedure

COMEXT Stand-Alone

Browser

Export XMLHTML/WebPaper Public.

Source Data under SimpleMSAccess Format

Excel/Word ReportingAccess ReportingVisual Basic, C++, PB application developmentGlobal connectivity with Package like 20-20Business Objects, Cognos

One ClickExcel output.

Thank You