* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
Download SAS Short Course Presentation 2011 Part 2
Survey
Document related concepts
Transcript
1 Presentation and Data http://www.lisa.stat.vt.edu Short Courses Intro to SAS Download Data to Desktop Introduction to SAS Part 2 Mark Seiss, Dept. of Statistics February 22, 2011 Reference Material The Little SAS Book – Delwiche and Slaughter SAS Programming I: Essentials SAS Programming II: Manipulating Data with the DATA Step Presentation and Data http://www.lisa.stat.vt.edu Presentation Outline Part 1 1. Introduction to the SAS Environment 2. Working With SAS Data Sets Part 2 1. Summary Procedures 2. Basic Statistical Analysis Procedures Presentation Outline Questions/Comments Individual Goals/Interests Summary Procedures 1. 2. 3. 4. 5. Print Procedure Plot Procedure Univariate Procedure Means Procedure Freq Procedure Print Procedure • PROC PRINT is used to print data to the output window • By default, prints all observations and variables in the SAS data set • General Form: PROC PRINT DATA=input_data_set <options> <optional SAS statements>; RUN; • Some Options • input_data_set (obs=n) - Specifies the number of observations to be printed in the output • NOOBS - Suppresses printing observation number • LABEL - Prints the labels instead of variable names Print Procedure • Optional SAS statements • BY variable1 variable2 variable3; • Starts a new section of output for every new value of the BY variables • ID variable1 variable2 variable3; • Prints ID variables on the left hand side of the page and suppresses the printing of the observation numbers • SUM variable1 variable2 variable3; • Prints sum of listed variables at the bottom of the output • VAR variable1 variable2 variable3; • Prints only listed variables in the output Print Procedure • Assignment Use PROC PRINT to print out the state variable separately for each region Note: All procedures for the remainder of the course will be run on the data set work.state_data. Print Procedure • Solution proc sort data=state_data; by region; run; proc print data=state_data; var state; by region; run; Plot Procedure • Used to create basic scatter plots of the data • Use PROC GPLOT or PROC SGPLOT for more sophisticated plots • General Form: PROC PLOT DATA=input_data_set; PLOT vertical_variable * horizontal_variable/<options>; RUN; • By default, SAS uses letters to mark points on plots • A for a single observation, B for two observations at the same point, etc. • To specify a different character to represent a point • PLOT vertical_variable * horizontal variable = ‘*’; Plot Procedure • To specify a third variable to use to mark points • PLOT vertical_variable * horizontal_variable = third_variable; • To plot more than one variable on the vertical axis • PLOT vertical_variable1 * horizontal_variable=‘2’ vertical_variable2 * horizontal_variable=‘1’/OVERLAY; Plot Procedure • Assignment Use the PLOT PROCEDURE to plot SAT Verbal scores versus SAT Math Scores Use the value of the region variable to mark points Plot Procedure • Solution proc plot data=state_data; plot math*verbal=region; run; Univariate Procedure • PROC UNIVARIATE is used to examine the distribution of data • Produces summary statistics for a single variable • Includes mean, median, mode, standard deviation, skewness, kurtosis, quantiles, etc. • General Form: PROC UNIVARIATE DATA=input_data_set <options>; VAR variable1 variable2 variable3; RUN ; • If the variable statement is not used, summary statistics will be produced for all numeric variables in the input data set. Univariate Procedure • Options include: • PLOT – produces Stem-and-leaf plot, Box plot, and Normal probability plot; • NORMAL – produces tests of Normality Univariate Procedure • Assignment Use PROC UNIVARIATE to produce a normal probability plot and test the normality of the SAT Total variable and Expenditure variable Univariate Procedure • Solution proc univariate data=state_data normal plot; var expend total; run; Means Procedure • Similar to the Univariate procedure • General Form: PROC MEANS DATA=input_data_set options; <Optional SAS statements>; RUN; • With no options or optional SAS statements, the Means procedure will print out the number of non-missing values, mean, standard deviation, minimum, and maximum for all numeric variables in the input data set Means Procedure • Options • • Statistics Available CLM Two-Sided Confidence Limits RANGE Range CSS Corrected Sum of Squares SKEWNESS Skewness CV Coefficient of Variation STDDEV Standard Deviation KURTOSIS Kurtosis STDERR Standard Error of Mean LCLM Lower Confidence Limit SUM Sum MAX Maximum Value SUMWGT Sum of Weight Variables MEAN Mean UCLM Upper Confidence Limit MIN Minimum Value USS Uncorrected Sum of Squares N Number Non-missing Values VAR Variance NMISS Number Missing Values PROBT Probability for Student’s t MEDIAN (or P50) Median T Student’s t Q1 (P25) 25% Quantile Q3 (P75) 75% Quantile P1 1% Quantile P5 5% Quantile P10 10% Quantile P90 90% Quantile P95 95% Quantile P99 99% Quantile Note: The default alpha level for confidence limits is 95%. Use ALPHA= option to specify different alpha level. Means Procedure • Optional SAS Statements • VAR Variable1 Variable2; • Specifies which numeric variables statistics will be produced for • BY Variable1 Variable2; • Calculates statistics for each combination of the BY variables • Output out=output_data_set; • Creates data set with the default statistics Means Procedure • Assignment Use PROC MEANS to calculate the mean and variance of the expenditure variable for each region Means Procedure • Solution proc sort data=state_data; by region; run; proc means data=state_data mean var; var expend; by region; run; FREQ Procedure • PROC FREQ is used to generate frequency tables • Most common usage is create table showing the distribution of categorical variables • General Form: • Options • PROC FREQ DATA=input_data_set; TABLE variable1*variable2*variable3/<options>; RUN; • LIST – prints cross tabulations in list format rather than grid • MISSING – specifies that missing values should be included in the tabulations • OUT=output_data_set – creates a data set containing frequencies, list format • NOPRINT – suppress printing in the output window Use BY statement to get percentages within each category of a variable FREQ Procedure • Assignment Use PROC FREQ to find the number of states within each region FREQ Procedure • Solution proc freq data=state_data; table region; run; Summary Procedures Questions/Comments Statistical Analysis Procedures 1. 2. 3. 4. 5. Correlation – PROC CORR Regression – PROC REG Analysis of Variance – PROC ANOVA Chi-square Test of Association – PROC FREQ General Linear Models – PROC GENMOD CORR Procedure • PROC CORR is used to calculate the correlations between variables • Correlation coefficient measures the linear relationship between two variables • Values Range from -1 to 1 • Negative correlation - as one variable increases the other decreases • Positive correlation – as one variable increases the other increases • 0 – no linear relationship between the two variables • 1 – perfect positive linear relationship • -1 – perfect negative linear relationship • General Form: PROC CORR DATA=input_data_set <options> VAR Variable1 Variable2; With Variable3; RUN; CORR Procedure • If the VAR and WITH statements are not used, correlation is computed for all pairs of numeric variables • Options include • SPEARMAN – computes Spearman’s rank correlations • KENDALL – computes Kendall’s Tau coefficients CORR Procedure • Question: What is the correlation between the SAT Total variable and Expenditure variable? Is it significant? Based on previous exercises, which correlation coefficient should we use? • Assignment: Use PROC CORR to find the correlation between the SAT Total variable and Expenditure Variable CORR Procedure • Solution If the normality assumption is valid proc corr data=state_data /; var total expend; run; If the normality assumption is not valid proc corr data=state_data spearman; var total expend; run; REG Procedure • PROC REG is used to fit linear regression models by least squares estimation • One of many SAS procedures that can perform regression analysis • Only continuous independent variables (Use GENMOD for categorical variables) • General Form: PROC REG DATA=input_data_set <options> MODEL dependent=independent1 independent2/<options>; <optional statements>; RUN; • PROC REG statement options include • PCOMIT=m - performs principle component estimation with m principle components • CORR – displays correlation matrix for independent variables in the model REG Procedure • MODEL statement options include • SELECTION= • Specifies a model selection procedure be conducted – FORWARD, BACKWARD, and STEPWISE • ADJRSQ - Computes the Adjusted R-Square • MSE – Computes the Mean Square Error • COLLIN – performs collinearity analysis • CLB – computes confidence limits for parameter estimates • ALPHA= • Sets significance value for confidence and prediction intervals and tests REG Procedure • Optional statements include • PLOT Dependent*Independent1 – generates plot of data REG Procedure • Assignment Use PROC REG to generate a multiple linear regression model Dependent Variable – SAT Total (total) Use Stepwise Selection Possible Independent Variables – Average pupil to teacher ratio (PT_ratio) – Current expenditure per pupil (expend) – Estimated annual salary of teachers (salary) – Percentage of eligible students taking the SAT (students) REG Procedure • Solution proc reg data=state_data; model total=pt_ratio expend salary students/selection=stepwise; run; ANOVA Procedure • PROC ANOVA performs analysis of variance • Designed for balanced data (PROC GLM used for unbalance data) • Can handle nested and crossed effects and repeated measures • General Form: PROC ANOVA DATA=input_data_set <options>; CLASS independent1 independent2; MODEL dependent=independent1 independent2; <optional statements>; Run; • Class statement must come before model statement, used to define classification variables ANOVA Procedure • Useful PROC ANOVA statement option – OUTSTAT=output_data_set • Generates output data set that contains sums of squares, degrees of freedom, statistics, and p-values for each effect in the model • Useful optional statement – MEANS independent1/<comparison type> • Used to perform multiple comparisons analysis • Set <comparison type> to: • TUKEY – Tukey’s studentized range test • BON – Bonferroni t test • T – pairwise t tests • Duncan – Duncan’s multiple-range test • Scheffe – Scheffe’s multiple comparison procedure ANOVA Procedure • Question: Are there significant differences between the Match SAT scores of students from different regions? If there are significant differences, which regions are different? • Assignment: Use PROC ANOVA to determine if there are significant differences in the Math SAT variable between regions Perform multiple comparisons between regions using Tukey’s Adjustment ANOVA Procedure • Solution proc anova data=state_data; class region; model math=region; means region/tukey; run; FREQ Procedure • PROC FREQ can also be used to perform analysis with categorical data • General Form: PROC FREQ DATA=input_data_set; TABLE variable1 variable2/<options>; RUN; • TABLE statement options include: • AGREE – Tests and measures of classification agreement including McNemar’s test, Bowker’s test, Cochran’s Q test, and Kappa statistics • CHISQ - Chi-square test of homogeneity and measures of association • MEASURE - Measures of association include Pearson and Spearman correlation, gamma, Kendall’s Tau, Stuart’s tau, Somer’s D, lambda, odds ratios, risk ratios, and confidence intervals GENMOD Procedure • PROC GENMOD is used to estimate linear models in which the response is not necessarily normal • Logistic and Poisson regression are examples of generalized linear models • General Form: PROC GENMOD DATA=input_data_set; CLASS independent1; MODEL dependent = independent1 independent2/ dist= <option> link=<option>; run; GENMOD Procedure • DIST = - specifies the distribution of the response variable • LINK= - specifies the link function from the linear predictor to the mean of the response • Example – Logistic Regression • • DIST = binomial • LINK = logit Example – Poisson Regression • DIST = poisson • LINK = log GENMOD Procedure • Question: How do we model the probability of having a high total SAT average based on other variables in the dataset? Is the dependent variable normal, or does it have a different distribution? What link function would you specify? • Assignment: Use PROC GENMOD to perform Logistic Regression on the work.state_data data set • Dependent variable – upper_ind • Independent variables – – – – – Average pupil to teacher ratio (PT_ratio) Current expenditure per pupil (expend) Estimated annual salary of teachers (salary) Percentage of eligible students taking the SAT (students) Region (region) GENMOD Procedure • Solution proc genmod data=state_data descending; class region; model upper_ind=pt_ratio expend salary students/dist=bin link=logit; run; Statistical Analysis Procedures Questions/Comments Attendee Questions If time permits