Download Welcome to Statistics 111

Welcome to Statistics 111
Alex Braunstein
The goal of this course is to develop basic tools for data analysis, probability
and statistical methods. Key topics covered in the course include exploratory
data analysis, regression, probability, estimation, and hypothesis testing
Stat 111 - Lecture 1 - Introduction
1
Syllabus notes: website
• All handouts will be available on the website:
http://stat.wharton.upenn.edu/~braunsf/stat111.html
• Website also contains my contact information
• Link on website for getting Wharton class account if
you are not a Wharton student
• Helpful if you want to use Wharton computer labs
Stat 111 - Lecture 1 - Introduction
2
Syllabus notes: Homeworks
• Homeworks will be handed out at the beginning of
every week
• ~ 5 homeworks in all
• Homeworks will be submitted at the beginning of
class on Mondays
• You are encouraged to work together on homework, but
homeworks are to be completed separately and handed in
individually.
• Do not copy from another person.
• No late homeworks will be accepted!!
• Late homeworks will get a score of zero, without exception
• Your lowest homework grade is not included in final grade
Stat 111 - Lecture 1 - Introduction
3
Syllabus Notes: Midterm Exam
• Midterm is held on following date:
Monday, June 15th (in class)
• No makeup midterm examination!
• A missing midterm exam counts as a zero score
• Consider taking this class in the fall or spring
if you can not attend the midterm!
Stat 111 - Lecture 1 - Introduction
4
Student Questionnaire
• Fill out a questionnaire and hand it in before
the break
• I will try to incorporate some of the subjects
that interest you into future lectures
Stat 111 - Lecture 1 - Introduction
5
Course Overview
1
Collecting Data
2
Exploring Data
Probability Intro.
3
4
Inference
Relationships between Variables
Comparing Variables
2
1
Means
Proportions
1
Regression
Stat 111 - Lecture 1 - Introduction
1
Contingency Tables
6
Out in public: You do statistics ?!?
• I hated that class in college!
• That was the most boring class ever!
• Lame.
Stat 111 - Lecture 1 - Introduction
7
Big Picture Ideas
• Statistics is all about uncertainty
• Focus as much on what we don’t know (or haven’t
observed) instead of what we know
• Formulating the question that we want to
answer is often the most difficult part
• Statistics is part mathematics, part roll-upyour-sleeves-and-get-thinking.
Stat 111 - Lecture 1 - Introduction
8
Science and Skepticism
• We always need to be cautious about
conclusions based on data
• Possible sources of bias and confounding?
• How might things have gone wrong?
• A little bit of skepticism is a good thing!
Stat 111 - Lecture 1 - Introduction
9
Statistical Modeling
•
Inference: using mathematical models of
uncertainty to answer questions
•
•
Connect probability concepts to our data
Can not make claims without using models
and making assumptions
•
Are the assumptions reasonable?
Stat 111 - Lecture 1 - Introduction
10
After the break
• Collecting Data: Design of Experiments
• Sections 3.1-3.2 in Moore, McCabe and Craig
• First couple of classes will not involve much
math at all, but we will get into lots of data
analysis after that!
Stat 111 - Lecture 1 - Introduction
11
Break!
• Hand in questionnaire
• 5 minutes
Stat 111 - Lecture 1 - Introduction
12
Outline for Second Half of Lecture
• Introduction to Experiments
• Sources of Bias in Experiments
• Techniques for Avoiding Bias
•
•
•
•
Matching
Randomization
Block Designs
Blinding and Double-Blinding
• Experiments vs. Observational Studies
• Association vs. Causation
Stat 111 - Lecture 2 - Experiments
13
Experiments
• Used to address a specific question
• Often used to examine causal effects
• Eg. medical trials, education interventions
Treatment Group
Treatment
Result
1
Population
Experimental
Units
2
3
Control Group
4
No Treatment
Result
• Can we just look at difference in results to get the
causal effect of the treatment?
• Depends on whether the experiment was done well
• many possible sources of bias in design of experiments
Stat 111 - Lecture 2 - Experiments
14
Sources of Bias
•
An experiment or study is biased if it systematically
favors a particular outcome
1. Subjects are not representative of the population
2. Treatment and control groups are inherently
different on some lurking or confounding variable
3. Subjects are influenced by knowing they are in
treatment or control groups
4. Evaluator of outcomes is influenced by knowing
they are in treatment or control groups
Treatment Group
Treatment
Result
1
Population
Experimental
Units
2
3
Control Group
Stat 111 - Lecture 2 - Experiments
4
No Treatment
Result
15
Bias 1: Non-representative units
• If your subjects are not representative of the
population, you won’t be able to generalize the results
even if the experiment is well done
• Here are two examples
• Treatment group: High Level NICUs
• Control Group: Low Level NICUs
• Problem: classification of NICU is different from
state to state, so a hospital that might qualify as a
high level NICU in one state might not in another
• Observed differences between the groups can not
be generalized from one state to another
Stat 111 - Lecture 2 - Experiments
16
Bias 2: Confounding/Lurking Variables
• Treatment group and control group are different on some
variable that also influences the outcome
• A confounding variable means that we can’t attribute
difference in outcomes to just the treatment
– Part of the difference may be due to the confounding variable not
the treatment
• Simple example: a breast cancer drug trial where only
women receive the treatment and only men receive the
control
• Gender becomes a confounding variable
• Are treatment vs control outcomes different due to the
treatment or gender differences between groups?
Stat 111 - Lecture 2 - Experiments
17
Bias 3: Subject knows treatment assignment
• A subject’s outcome is influenced by knowing that
he/she is in a treatment or control group
• Eg. drug trials: patients improve just because they think they are
receiving the drug
• Solution: blinded experiment with placebo
• Placebo appears to be the treatment, so all subjects
(treatment and control) don’t know their true treatment
assignment
• Controls may improve outcomes slightly; this is often
called “the placebo effect”
Stat 111 - Lecture 2 - Experiments
18
Bias 4: Evaluator knows treatment assignment
• Person evaluating outcome (eg. doctor in drug trial) may
also be influenced by knowing who receives treatment
• Not a problem if outcome is something indisputable,
such as death!
• This is a problem for more subjective measures like pain
reduction or results from social programs
• Solution: double-blinded experiment where neither
subjects not evaluators know treatment assignments
Stat 111 - Lecture 2 - Experiments
19
Association vs Causation
• In the presence of a confounding variable, we can only
conclude there is an association between treatment and
outcome, not causation
Stat 111 - Lecture 2 - Experiments
20
Examples: “Reporters are stupid”
• Children who watch many hours of TV get lower
grades in school on average than those who
watch less TV
• Does this mean that TV causes poor grades?
• What are potential confounding variables?
• People who use artificial sweeteners in place of
sugar tend to be heavier than people who use
sugar
• Does this mean that sweeteners cause weight gain?
• What is probably happening here?
Stat 111 - Lecture 2 - Experiments
21
One solution: Matching
• Make sure that treatment and control groups are very
similar on observed variables like race, gender, age etc.
• Block designs: divide subjects into blocks with similar observed
variables before dividing them into treatment vs control
• Special case: Matched Pairs
• Subjects are matched up into pairs, then one
member of each pair gets treatment and the
other gets control
• Example: Dandruff experiment
• treatment applied to one side and control
to other side of head
• No reason to expect difference
in sides except for treatment
Stat 111 - Lecture 2 - Experiments
22
Another Solution: Randomization
• Problem with matching is that you cannot usually match
on unobserved characteristics (eg. Genetics)
• Eg. Cholesterol drug trial - can’t match treatment and control
groups on genetic predisposition for high cholesterol
• Randomly assign subjects to treatment or control
• Random assignment should lead to groups that are similar
or balanced on both observed and unobserved
confounding variables
• Example: student questionnaire earlier in class - each
form you filled out was randomly assigned either a 1 or 2
Stat 111 - Lecture 2 - Experiments
23
Randomization of In-Class Survey
• Check to see if groups are balanced:
Variable
Treatment
Control
Average Height
Average Shoe Size
Average Number of Siblings
• There are differences, but are they “significant”?
• Later on in the course, we will be able to answer questions like this
• Of course, we can’t check the balance for unobserved
variables…we just have to trust the randomization process
• This is why good science needs to be replicable
Stat 111 - Lecture 2 - Experiments
24
Even Better: Randomization + Matching
• Randomization generally leads to treatment and control
groups that are evenly balanced but you can still get
unlucky and get unbalanced groups
• Example: randomly placing 20 people (10 males, 10
females) into treatment and control groups.
• How many males will end up in treatment group?
• Ideally, we would have 5 males in treatment group,
and 5 males in control group (balanced)
• However, there is a chance to get 9 males in treatment
and 1 male in control group (unbalanced)
Stat 111 - Lecture 2 - Experiments
25
Even Better: Randomization + Matching
• Randomized Blocks: randomize within blocks of
observed variables
• Example:
• Divide up subjects into males and females first, then randomly
assign treatment or control to subjects in each group separately
• Guarantees that equal number of males end up in treatment group
and control group (same with females)
• Randomized Matched Pairs: randomly decide which
member of each pair gets treatment vs. control
• Example:
• For each head in dandruff experiment, randomly assign which
side of head to get dandruff shampoo vs. control
Stat 111 - Lecture 2 - Experiments
26
Experiments vs. Observational Studies
• Often, we want the causal effect of some treatment,
but our data are from an observational study
• Observational studies examine effects of some variable but
without the advantages of a controlled experiment
• No treatment is applied in observational studies
• Example: health effects of smoking
• Unethical to randomly impose a treatment
• Could there be some confounding variable that explains
health differences between smokers and non-smokers ?
• Very risky to make causal statements from
observational data, since we can not avoid bias!
Stat 111 - Lecture 2 - Experiments
27
Health Effects of Chocolate
• Report to European Society of Sexual
Medicine:
• 153 Italian women filled out sexual function
questionnaires
• “intriguing correlation”: sexual function/desire
significantly greater among chocolate-eaters
• Observational study: association does not imply
causation!
• Confounding: average age is 35 among frequent
chocolate-eaters, compared with 40.4 in nonchocolate group
Stat 111 - Lecture 2 - Experiments
28
Next Class - Lecture 2
• Collecting Data:
– Surveys and Sampling
– Graphical summaries of a single variable
• Moore, McCabe and Craig: Sections 3.3
and 1.1
Stat 111 - Lecture 2 - Experiments
29