celadeâ€™s approach for census data storage and dissemination

ECLACECLAC--CELADE CELADE

CELADECELADE’’ss Approach for Census Approach for Census Data Storage and DisseminationData Storage and Dissemination

MPC, University of Minnesota“Integrating Global Microdata: the Challenge for the 2010 Census Round”

February 23rd 2008, New York

Dirk JASPERS FAIJER, Director CELADE, Population Division of ECLAC, United Nations


TOPICSTOPICS

Redatam as a tool for data analysis Redatam as a tool for data analysis and processingand processingRedatam as a tool for data Redatam as a tool for data disseminationdisseminationCELADECELADE’’ss regional data bank for regional data bank for Latina American and the Caribbean Latina American and the Caribbean censusescensusesPerspectives for the 2010 census Perspectives for the 2010 census roundround


REDATAM+SP as a tool for analysis REDATAM+SP as a tool for analysis and processing of microdataand processing of microdata

ItIt’’s a database management tool that administrates large s a database management tool that administrates large volumes of census microdata with hierarchical (geographical) volumes of census microdata with hierarchical (geographical) structure down to the smallest area of the census exercise structure down to the smallest area of the census exercise (city blocks)(city blocks)

Facilitates the data processing for user defined areasFacilitates the data processing for user defined areas

How?How?•• by facilitating the NSO the creation of an encrypted database by facilitating the NSO the creation of an encrypted database

which could be provided to third parties taking into account which could be provided to third parties taking into account confidentiality issues (stand alone applications or thru the confidentiality issues (stand alone applications or thru the Web)Web)

•• by providing the by providing the NSONSO’’ss themselves and the end users with a themselves and the end users with a user friendly and fast software for processing large volumes of user friendly and fast software for processing large volumes of data, particularly for small areasdata, particularly for small areas


Hierarchical Structured DatabaseHierarchical Structured Database

HouseholdHousehold

Country

Province

Municipality

. . .

PersonPerson

DwellingDwelling

Block

ItIt’’s a database management tool that s a database management tool that administrates large volumes of census administrates large volumes of census microdata with hierarchical (geographical) microdata with hierarchical (geographical) structure down to the smallest area of the structure down to the smallest area of the census exercise (city blocks)census exercise (city blocks)..

Facilitates the data processing for Facilitates the data processing for user defined geographical areasuser defined geographical areas


Characteristics of REDATAMCharacteristics of REDATAM

Easy exportation of (aggregated) results to other software (ExcEasy exportation of (aggregated) results to other software (Excel, el,

ASCII, GIS)ASCII, GIS)

Allows for thematic mapping & graphsAllows for thematic mapping & graphs

Dissemination of data through stand alone applications on CDs Dissemination of data through stand alone applications on CDs

based on the Redatam structure for interactive processing based on the Redatam structure for interactive processing

microdatamicrodata or aggregated data (with or aggregated data (with R+XPlanR+XPlan).).

OnOn--line data processing (using the Redatam line data processing (using the Redatam WebServerWebServer) of ) of

microdata or aggregated data (Internet, Extranet, Intranet)microdata or aggregated data (Internet, Extranet, Intranet)

Available in English, Portuguese, French and SpanishAvailable in English, Portuguese, French and Spanish

OnOn--line Helpline Help


Constant update of RedatamConstant update of Redatam

Several new functions have been added in the last update of RedaSeveral new functions have been added in the last update of Redatam tam to improve analysis and processing of the data:to improve analysis and processing of the data:

INLINE selection of easy tablesINLINE selection of easy tablesMultiples selectionsMultiples selectionsNew interface (Windows VISTA)New interface (Windows VISTA)External variables attached from DBF filesExternal variables attached from DBF filesNew HintsNew HintsCombined output using FREQUENCY y AREALIST Combined output using FREQUENCY y AREALIST

togethertogetherAutomatic use of weightAutomatic use of weightSampling errors calculationSampling errors calculationCreation of samples of Creation of samples of RedatamRedatam databasedatabaseValuesOnlyValuesOnly -- new table optionnew table optionCustomization of the Command Editor window Customization of the Command Editor window Search tool in the Command Editor windowSearch tool in the Command Editor windowErrors display in the Command Editor windowErrors display in the Command Editor window


Data analysis at Data analysis at small geographic small geographic units such as this units such as this map at the block map at the block level with data on level with data on internal migration internal migration analyzed from the analyzed from the 2002 Chilean census 2002 Chilean census and processed with and processed with RedatamRedatam


Redatam Development team is focusing more and more into Redatam Development team is focusing more and more into the development of special (the development of special (xPlanxPlan) applications to disseminate ) applications to disseminate population data (for example on CDs) using microdata or population data (for example on CDs) using microdata or aggregated data.aggregated data.

Easy and friendly interface; without programming.Easy and friendly interface; without programming.Options of tabulations and processes are defined by the userOptions of tabulations and processes are defined by the userAllows to process predefined indicators. Allow for graphing and Allows to process predefined indicators. Allow for graphing and thematic mapping.thematic mapping.Several applications have been undertaken with Census data, Several applications have been undertaken with Census data, vital statistics, household surveys, industrial census, vital statistics, household surveys, industrial census, agricultural census, trade statistics.agricultural census, trade statistics.

CELADE as a tool for data CELADE as a tool for data dissemination and processingdissemination and processing


CELADE as a tool for data processing CELADE as a tool for data processing on lineon line

Census microdata onCensus microdata on--line line access for Latin American access for Latin American and the Caribbean and the Caribbean countriescountries

•• Some of the Some of the NSONSO’’ss links links are depicted here.are depicted here.•• CELADE is the mirror site CELADE is the mirror site of the NSO web site or is of the NSO web site or is the actual server for some the actual server for some countries census access.countries census access.•• 15 countries offer today 15 countries offer today onon--line census processingline census processing

Powered by Redatam+SP Web ServerPowered by Redatam+SP Web Server


Dominican Republic Dominican Republic census oncensus on--lineline


Each tabulationcan be displayed

as table, graphor map

Census Census processing processing onon--line of line of Trinidad & Trinidad & TobagoTobago


CELADECELADE’’ss regional Intranet data bank for regional Intranet data bank for Latina American and the Caribbean Latina American and the Caribbean

censusescensuses


CELADECELADE’’ssregional regional

Intranet data Intranet data bank: Antigua bank: Antigua

& Barbuda & Barbuda 20012001


CELADE joined the CELADE joined the IPUMSiIPUMSi project from the beginning by project from the beginning by recovering census recovering census microdatamicrodata from magnetic tapes and the census from magnetic tapes and the census documentation.documentation.

•• Assistance to the project, whenever requiredAssistance to the project, whenever required

•• Providing census samples (microdata in in Redatam, SPSS and ASCIProviding census samples (microdata in in Redatam, SPSS and ASCII I formats) of Latin America and the Caribbean countries stored in formats) of Latin America and the Caribbean countries stored in its its databank (with NSO permission) and its documentationdatabank (with NSO permission) and its documentation

•• Background information on database structure and consistenciesBackground information on database structure and consistencies

•• Advise on the harmonization of the census databases and census dAdvise on the harmonization of the census databases and census data ata retrieval systemsretrieval systems

•• Assistance to the Assistance to the NSONSO’’ss to recover other census databases (samples to recover other census databases (samples or complete databases) if they still exists in the countries.or complete databases) if they still exists in the countries.

CELADECELADE’’ss regional data bank for Latin regional data bank for Latin American and the Caribbean censusesAmerican and the Caribbean censuses


20042004--20072007

Before 2004Before 2004

Databases provided by CELADE to the IPUMS projectDatabases provided by CELADE to the IPUMS project


Perspectives for the 2010 census roundPerspectives for the 2010 census round

Websites widely used for dissemination of census results, Websites widely used for dissemination of census results, aggregated data (and metadata)aggregated data (and metadata)Democratization of access to microdataDemocratization of access to microdata

Several countries allow for census data processing online via Several countries allow for census data processing online via internetinternetMore countries are providing census data bases to decentralized More countries are providing census data bases to decentralized institutions (like municipalities), using REDATAM applications tinstitutions (like municipalities), using REDATAM applications to o facilitate its use (and allowing for thematic mapping)facilitate its use (and allowing for thematic mapping)

•• Pending: further promote census analysisPending: further promote census analysis

More More subregionalsubregional coordination and cooperationcoordination and cooperationHigh demand for training in census activities and High demand for training in census activities and demographic analysisdemographic analysisMore interest for harmonizing census questionsMore interest for harmonizing census questions

Final commentsFinal comments


Thank youThank youCELADE, Population Division of ECLAC was CELADE, Population Division of ECLAC was born 50 years ago. During all these years it born 50 years ago. During all these years it has been constantly giving support to all has been constantly giving support to all countries in Population & Development countries in Population & Development issues, and it will continue doing so.issues, and it will continue doing so.

THANK YOU!THANK YOU!

celadeâ€™s approach for census data storage and dissemination

Documents