computer assisted statistics - · pdf filespss stata. epi info ... • create own stata...

35
COMPUTER ASSISTED STATISTICS Dr. Sujith J Chandy Clinical Pharmacology Unit CMC Vellore

Upload: trannga

Post on 17-Mar-2018

215 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: COMPUTER ASSISTED STATISTICS - · PDF fileSPSS STATA. EPI INFO ... • Create own Stata programs that become part of Stata • Compact in terms of disk space, ... • Beginners enjoy

COMPUTER ASSISTED STATISTICS

Dr. Sujith J ChandyClinical Pharmacology Unit

CMC Vellore

Page 2: COMPUTER ASSISTED STATISTICS - · PDF fileSPSS STATA. EPI INFO ... • Create own Stata programs that become part of Stata • Compact in terms of disk space, ... • Beginners enjoy

INTRODUCTION

• Various phases for a study :

1. Identify a problem2. Ask yourself a question3. Define the aim with specific objectives4. Choose a study design5. Construct the methodology6. Estimate the sample size7. Data Collection8. Analysis9. Interpretation10. Conclusion

Page 3: COMPUTER ASSISTED STATISTICS - · PDF fileSPSS STATA. EPI INFO ... • Create own Stata programs that become part of Stata • Compact in terms of disk space, ... • Beginners enjoy

• Planning for a study:

- You remember - Aim, design, methodology, sample size- You forget - data management and analyses

• Data management :

- Data collection, entry, arrangement, processing

• Analysis:

- choice of analysis, process of analysis

• Assistance from a friend:

- Biostatistician, Colleague, or Software

Page 4: COMPUTER ASSISTED STATISTICS - · PDF fileSPSS STATA. EPI INFO ... • Create own Stata programs that become part of Stata • Compact in terms of disk space, ... • Beginners enjoy

Aim of talk :

Get to know statistical software - A process of sensitization

Areas of talk :

1. Data Management software

2. General software packages for analysis

3. Special function software packages

Page 5: COMPUTER ASSISTED STATISTICS - · PDF fileSPSS STATA. EPI INFO ... • Create own Stata programs that become part of Stata • Compact in terms of disk space, ... • Beginners enjoy

DATA MANAGEMENT

• Spreadsheet :-

• Functions :1. Arithmetical - 4 signs, square root etc2. Statistical - Averages, ranges, MMM, SDs etc3. Data sorting - Arranging, distribution analysis4. Data storing - 9999 rows and 255 columns - over 2 million cells5. Transfer into other programs - word processors, database

Examples: Quattro Pro, Lotus 1-2-3, Microsoft Excel -PopTools, XL statistics

Page 6: COMPUTER ASSISTED STATISTICS - · PDF fileSPSS STATA. EPI INFO ... • Create own Stata programs that become part of Stata • Compact in terms of disk space, ... • Beginners enjoy

STATISTICAL ANALYSIS

• Data analysis in multiple ways:

- each of which could yield legitimate answers

• Choice of analysis method:

1. the number of dependent variables (outcome variables)

2. the nature of independent variables (predictors)

3. the nature of dependent variable

- whether interval variable, ordinal or categorical variable,

- whether it is normally distributed

Page 7: COMPUTER ASSISTED STATISTICS - · PDF fileSPSS STATA. EPI INFO ... • Create own Stata programs that become part of Stata • Compact in terms of disk space, ... • Beginners enjoy

STATISTICAL PROGRAMS

• The Past - programs expensive, unfriendly

• The Present - budget driven (many programs available)- user friendly - menu driven, Windows/Mac graphic user interfaces

• Broad types of programs:

1. General Packages: support a wide variety of statistical analyses 2. Special function Packages: with a specific area of analysis 3. Curve fitting and Modelling: handle complex, nonlinear models 4. Surveys, Testing and Measurement: useful in business

and social sciences

Page 8: COMPUTER ASSISTED STATISTICS - · PDF fileSPSS STATA. EPI INFO ... • Create own Stata programs that become part of Stata • Compact in terms of disk space, ... • Beginners enjoy

GENERAL STATISTICAL SOFTWARE PACKAGES

Arcus Pro-Stat - useful statistical functions, user friendlyEpiInfo - downloadable, free, ease to useKwikstat - popular in USAMinitab -available for DOS, Windows, Macintosh, UnixStatSoft - Comprehensive statistical programStatgraphics - Very powerful with integrated graphicsSYSTAT - General statistic packageUNISTAT - range of statistical analysis with charting capabilities SASSPSSSTATA

Page 9: COMPUTER ASSISTED STATISTICS - · PDF fileSPSS STATA. EPI INFO ... • Create own Stata programs that become part of Stata • Compact in terms of disk space, ... • Beginners enjoy

EPI INFO

Features:

• Can rapidly develop a questionnaire or form

• Can customize the data entry process

• Can enter and analyze data

• Epidemiologic statistics, tables, graphs, and maps produced

• Simple commands - READ, FREQ, LIST, TABLES, GRAPH

• Epi Map displays geographic maps with data from Epi Info

Page 10: COMPUTER ASSISTED STATISTICS - · PDF fileSPSS STATA. EPI INFO ... • Create own Stata programs that become part of Stata • Compact in terms of disk space, ... • Beginners enjoy

STATAStatistical Software for

Professionals1984

Page 11: COMPUTER ASSISTED STATISTICS - · PDF fileSPSS STATA. EPI INFO ... • Create own Stata programs that become part of Stata • Compact in terms of disk space, ... • Beginners enjoy

General Features :

• both easy to learn and yet very powerful:

- beginners and veterans- interactive style of operation

• commands give immediate results

• one line commands which can be entered:

- one command at a time (a mode favored by beginners) - many at a time (a mode favored by power users)

• if you make mistake in Stata command:- easy to diagnose and correct the error

Page 12: COMPUTER ASSISTED STATISTICS - · PDF fileSPSS STATA. EPI INFO ... • Create own Stata programs that become part of Stata • Compact in terms of disk space, ... • Beginners enjoy

Data management :

• Data management capabilities not as extensive as SAS

• Powerful yet very simple data management commands

- allows complex manipulations of data with ease

• Works primarily with one data file at a time

- tasks that involve working with multiple files at once - difficult

Page 13: COMPUTER ASSISTED STATISTICS - · PDF fileSPSS STATA. EPI INFO ... • Create own Stata programs that become part of Stata • Compact in terms of disk space, ... • Beginners enjoy

Statistical Analyses :

• Performs most general statistical analyses :

- regression, logistic regression, survival analysis - analysis of variance, factor analysis - computing risk, rate and odds ratios with confidence intervals

• Greatest strength - regression, logistic regression

• Excels - survey data analysis

• Greatest weakness -- analysis of variance - traditional mutivariate methods (manova, discriminant analysis)

Page 14: COMPUTER ASSISTED STATISTICS - · PDF fileSPSS STATA. EPI INFO ... • Create own Stata programs that become part of Stata • Compact in terms of disk space, ... • Beginners enjoy

Graphics :

• Like SPSS, Stata graphics created using Stata commands or using a point and click interface

• Unlike SPSS, the graphs cannot be edited using a graph editor

• The syntax of the graph commands :

- easiest of the three packages- the most powerful

• Stata graphs are high quality, useful in publications

Page 15: COMPUTER ASSISTED STATISTICS - · PDF fileSPSS STATA. EPI INFO ... • Create own Stata programs that become part of Stata • Compact in terms of disk space, ... • Beginners enjoy

Summary:

• Good combination of ease of use and power.

• Easy to learn

• Powerful tools for data management

• Cutting edge statistical procedures

• Easily download programs developed by other users

• Create own Stata programs that become part of Stata

• Compact in terms of disk space, computationally efficient

Page 16: COMPUTER ASSISTED STATISTICS - · PDF fileSPSS STATA. EPI INFO ... • Create own Stata programs that become part of Stata • Compact in terms of disk space, ... • Beginners enjoy

SASSoftware and Services

1976

Page 17: COMPUTER ASSISTED STATISTICS - · PDF fileSPSS STATA. EPI INFO ... • Create own Stata programs that become part of Stata • Compact in terms of disk space, ... • Beginners enjoy

General Features :

• Large general purpose package

• Power and programmability - Professionals love it

• Difficult to learn- (STATA more interactive, SPSS more trial based)

• To use SAS:- write SAS programs that manipulate your data

and perform analyses

• If you make a mistake in a SAS program :- hard to see where the error occurred or how to correct it.

Page 18: COMPUTER ASSISTED STATISTICS - · PDF fileSPSS STATA. EPI INFO ... • Create own Stata programs that become part of Stata • Compact in terms of disk space, ... • Beginners enjoy

Data management :

• Powerful in data management - allows you to manipulate data

• Long time to learn and understand data management

• Complex data management tasks done ( simpler commands in Stata or SPSS )

• SAS can work with many data files at once - easing tasks that involve working with multiple files

• SAS can handle enormous data files - up to 32,768 variables

Page 19: COMPUTER ASSISTED STATISTICS - · PDF fileSPSS STATA. EPI INFO ... • Create own Stata programs that become part of Stata • Compact in terms of disk space, ... • Beginners enjoy

Statistical Analyses :

• Performs most general statistical analyses :

- regression, logistic regression, survival analysis - analysis of variance, factor analysis, multivariate analysis

• Greatest strengths of :- ANOVA, mixed model analysis and multivariate analysis

• Greatest weakness:- ordinal and multinomial logistic regression

• analysis of survey data is quite limited as compared to Stata

Page 20: COMPUTER ASSISTED STATISTICS - · PDF fileSPSS STATA. EPI INFO ... • Create own Stata programs that become part of Stata • Compact in terms of disk space, ... • Beginners enjoy

Graphics :

• Most powerful graphic tools among all of the packages

• Technical and tricky to learn

• Graphs are created mainly using syntax language

• SAS 8 does have a point and click interface for creating graphs- not as easy to use as SPSS

Page 21: COMPUTER ASSISTED STATISTICS - · PDF fileSPSS STATA. EPI INFO ... • Create own Stata programs that become part of Stata • Compact in terms of disk space, ... • Beginners enjoy

Summary :

• SAS is a package geared towards professionals

• Steep learning curve and can be frustrating at first

• Powerful data management

• Range of statistical procedures wide

• Ability to work with numerous data files at once

Page 22: COMPUTER ASSISTED STATISTICS - · PDF fileSPSS STATA. EPI INFO ... • Create own Stata programs that become part of Stata • Compact in terms of disk space, ... • Beginners enjoy

SPSSStatistical Packages for Social

Sciences1968

Page 23: COMPUTER ASSISTED STATISTICS - · PDF fileSPSS STATA. EPI INFO ... • Create own Stata programs that become part of Stata • Compact in terms of disk space, ... • Beginners enjoy

General use :

• Beginners enjoy because - it is easy to use

• "point and click" interface - allows you to use pulldown menus to select commands

• SPSS does have a "syntax" language - syntax generally overly complicated and often unintuitive

• Popular in the social sciences and psychology

Page 24: COMPUTER ASSISTED STATISTICS - · PDF fileSPSS STATA. EPI INFO ... • Create own Stata programs that become part of Stata • Compact in terms of disk space, ... • Beginners enjoy
Page 25: COMPUTER ASSISTED STATISTICS - · PDF fileSPSS STATA. EPI INFO ... • Create own Stata programs that become part of Stata • Compact in terms of disk space, ... • Beginners enjoy

Data Management :

• Friendly data editor that resembles Excel - allows you to enter your data - and attributes of your data (missing values, value labels)

• SPSS does not have very strong data management tools

• SPSS primarily edits one data file at a time

• not very strong for tasks that involve working with multiple data files at once

• SPSS data files can have 4096 variables

Page 26: COMPUTER ASSISTED STATISTICS - · PDF fileSPSS STATA. EPI INFO ... • Create own Stata programs that become part of Stata • Compact in terms of disk space, ... • Beginners enjoy

Statistical Analyses :

• Performs most general statistical analyses:

- regression, logistic regression, survival analysis- analysis of variance, factor analysis, and multivariate analysis

• Greatest strengths :

- analysis of variance and multivariate analysis

• Greatest weakness :

- absence of robust regressions- absence of survey data analysis

Page 27: COMPUTER ASSISTED STATISTICS - · PDF fileSPSS STATA. EPI INFO ... • Create own Stata programs that become part of Stata • Compact in terms of disk space, ... • Beginners enjoy

Graphics :

• Simple point and click interface for creating graphs

• once you create graphs- can be extensively customized via its point and click interface

• Graphs are very high quality - can be pasted into other documents ( Word or Powerpoint)

• SPSS does have a syntax language for creating graphs

• Many of the features in the point and click interface- are not available via the syntax language

• Syntax language more complicated than that provided by Stata, but simpler than the SAS

Page 28: COMPUTER ASSISTED STATISTICS - · PDF fileSPSS STATA. EPI INFO ... • Create own Stata programs that become part of Stata • Compact in terms of disk space, ... • Beginners enjoy

Summary :

• Large and cumbersome, but easy to use

• As a professional - you may outgrow it over time

• Strong in the area of graphics

• Weak in cutting edge statistical procedures

• Hard to keep track of exactly what you've done

Page 29: COMPUTER ASSISTED STATISTICS - · PDF fileSPSS STATA. EPI INFO ... • Create own Stata programs that become part of Stata • Compact in terms of disk space, ... • Beginners enjoy

QUALITATIVE DATA

• Analytical process begins during data collection

• Data preserved in textual form and "indexed" to generateor develop analytical categories and theoretical explanations

• Software designed to enable complex organisation, retrieval of data

• Widely used - QSR NUD*IST and ATLAS.ti.

• EZ-TEXT-- a software program from C.D.C. -to create, manage, analyze semi-structured qualitative databases

Page 30: COMPUTER ASSISTED STATISTICS - · PDF fileSPSS STATA. EPI INFO ... • Create own Stata programs that become part of Stata • Compact in terms of disk space, ... • Beginners enjoy

SPECIAL FUNCTION PACKAGES

• Sample Size & Power :

1. STPLAN, NQUERY, PEST, POWER, SAMPSIZE2. SAMPLEXS - for crosssectional surveys3. GPOWER - precision analysis for t-tests, Chi-square tests

- computes power, sample sizes, alpha, beta, and alpha/beta ratios

• Randomization :

1. RANDOMIZATION GENERATOR - Windows application- simple, blocked randomisation, and gives output in spreadsheet

2. RANDOMIZATION.COM - on-line randomization program3. STATSDIRECT - randomization into groups, matched pairs

Page 31: COMPUTER ASSISTED STATISTICS - · PDF fileSPSS STATA. EPI INFO ... • Create own Stata programs that become part of Stata • Compact in terms of disk space, ... • Beginners enjoy

• Metanalysis :

1. META-ANALYSIS 5.3 -- DOS statistics software - selects the analysis of exact p values or effect sizes - plots a display of correlation coefficients 2. EasyMA - Clinical Trial Results3. EPIMETA - DOS based, but has Windows like interface

• Person Years and Mortality Ratios :

- PANCOMP

• Diagnostic Efficiency Statistics :

1. DIAGNOSTIC STATISTICS - - sensitivity, specificity, positive and negative predictive power, Kappa

Page 32: COMPUTER ASSISTED STATISTICS - · PDF fileSPSS STATA. EPI INFO ... • Create own Stata programs that become part of Stata • Compact in terms of disk space, ... • Beginners enjoy

• Risk Estimation :

1. ABSRISK - MSDOS - for estimating absolute risks from relative risks - Uses age-specific mortality and morbidity data to convertrelative risk estimates into absolute risk estimates

• Missing Data :

1. MANET- Macintosh software for interactive graphics tools for data sets

with missing values.

• Clinical Trial :

1.CLINTRIAL 2. MACRO

Page 33: COMPUTER ASSISTED STATISTICS - · PDF fileSPSS STATA. EPI INFO ... • Create own Stata programs that become part of Stata • Compact in terms of disk space, ... • Beginners enjoy

• Pharmacokinetic and Pharmacodynamic Data :

1. BOOMER - Non-linear Regression Program - Includes normal fitting, Bayesian estimation,

with integrated or differential equation models2. NONMEM - Population Kinetics software

• Surveys :

1. CSPRO ( Census and Survey Processing System) 2. STATPAC Survey Software

• Seasonal Adjustments :

- ARIMA, DEMETRA

Page 34: COMPUTER ASSISTED STATISTICS - · PDF fileSPSS STATA. EPI INFO ... • Create own Stata programs that become part of Stata • Compact in terms of disk space, ... • Beginners enjoy

CONCLUSION

• Each package - its own unique strengths and weaknesses

• SAS, Stata and SPSS - wide variety of statistical analyses

• Stat/Transfer - converts data files from one package to another

• Switching from one analysis package to another : - depends on nature of problem - SAS: analyses using mixed models - Stata : logistic regression - SPSS: analysis of variance

• Choice of program :

1. budget 2. experience 3. size of data 4. complexity of analyses

Page 35: COMPUTER ASSISTED STATISTICS - · PDF fileSPSS STATA. EPI INFO ... • Create own Stata programs that become part of Stata • Compact in terms of disk space, ... • Beginners enjoy

• Take home message for CaS:

The right analysis for the right problem, Your seers will have good views.The right software for the right analysis, Your peers will give good reviews!Whichever software you choose, let there be no excuse,Persist with its use, be familiar with the cues, You’re sure to get your dues,And who knows, one day, you might just be…. in the news!