Survey							
                            
		                
		                * Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
CSCI 4163/6610 WINTER 2015 OBSERVATIONS (CONT’D) CONTEXTUAL INQUIRY Q1: Observations allow you to: a) Learn about real world behaviours b) Learn about opinions and perspectives c) Both A & B d) Neither A nor B Q2: Observations are a good choice… A. When you are trying to understand an ongoing behaviour or process B. When there is physical evidence, products, or outcomes that can be readily seen C. When you want direct information D. All of the above Q3: Disadvantages of observation include… A) Can only be used in natural settings B) The observer’s presence may create an artificial situation C) Both A & B D) Neither A nor B Q4: If unobtrusive, observations allow you to… A) see things in their natural context B) see things that may escape conscious awareness, things that are not seen by others C) discover things that may have been taken for granted D) All of the above Q5: To preserve ecological validity, you must make sure the _____ is/are representative of usual behaviours A. Task B. Setting C. Tools D. All of the above Big disadvantage of pure (unobtrusive) observation…  Can be hard to understand why the behaviours/activities are happeny…. Contextual inquiry  Interviewees are interviewed in their context, when doing their tasks, with as little interference from the interviewer as possible.  Allows probing of “why?”  Can be real-time or record interesting actions for later discussion “Typical” 4 phased approach  Traditional interview  Get an overview, establish trust, start recording  Switch to a master-apprentice relationship  Tell them what you want to observe  Make sure to establish when ok to interrupt  Observe, ask questions  Take notes  Balance need to understand with impact of interruptions  Summarization  Go over observations and your understanding with participant  Make sure that you go it right Other ways of providing context  If natural observation not possible, can ask them to demonstrate specific tasks of interest  Can provide task scenarios and ask them to perform  “Think aloud” protocols Other ways of getting observational data  Logging  Screen recording (check out Camtasia)  Trace data  Read McGrath handout for a great discussion of ways to get observational data Recent readings 1. Why did they do the research/study? a. What was the motivation? b. What were the research questions? 2. What was their approach? 3. Critique their study (Recruitment, running the study, analysis) a. what was good? b. What was bad?) c. Do you think that their findings are valid? 4. What would you do differently if you wanted to replicate/extend this research? Homework  Friday’s tutorials: interview groups  Be a participant  Be an observer  Day of: submit quick feedback sheets for all that you took part in/observed  The next tutorial: submit a critique for ONE group  Advertising Diary exercise for Tues  Assigned reading w/ questions for Tues  Read McGrath’s Methodology Matters (submit questions) for Tues Feb 3rd