Download Physics 001 Conceptual Physics

The Effect of
Shibboleth
on the
Introductory Courses
John Hopkins 2003
The Introductory Courses
Phys 211, 212, 213, 214
Technology Use
Faculty/Staff
Administrative Uses
Course Preparation
Archive
Lectures
Exams
Web
Console
Labs
Recitations
Student
Eduactional Uses
Course Operation
Demos
WebAssign
Help Desk
Job Duties
TA Website
Grades
John Hopkins 2003
Homework
Grading
Excuses
Labs
Grading
Help
Faculty/Staff
Technology Use
Faculty/Staff
Administrative Uses
Course Preparation
Archive
Lectures
Exams
Web
Console
Labs
Student
Eduactional Uses
Course Operation
Demos
WebAssign
Recitations
Help Desk
Job Duties
TA Website
Grades
Homework
Labs
Grading
Help
Grading
Excuses
Demos
in lectures
are tracked
Faculty used
assigned
to the introductory
course are provided access to
an archive of previously used materials.
PIRA Classification Scheme
100’s of previous ppt lectures
Pictures and explanations of hundreds of lecture demonstrations
labs
Electronic request and tracking system
Exams and other information
John Hopkins 2003
Course Operation
Technology Use
Faculty/Staff
Administrative Uses
Course Preparation
Archive
Lectures
Exams
Web
Console
Labs
Recitations
Student
Eduactional Uses
Course Operation
Demos
WebAssign
Help Desk
Job Duties
TA Website
Grades
Homework
Labs
Grading
Grading
Excuses
A
website
developed
toand
assist
ourhours.
assistants.
Help
Desk
is was
staffed
during
normal
business
Staff
respond
within one
Homework
is offered
through
WebAssign
~1/4
million
scores
are
collected
tracked
inteaching
the(NCState)
introcourses.
Scores
working
to questions regarding:
collectedday
from:
•The TAs
up-to-date
grades
on students
Students
logincan
by check
entering
userid and
password
to access
•Grades
•TAs
randomized
questions
selected
for each assignment. 10 -15/set
•Enter
excuses
for
students
•Web
•UTSAssign (typically high at the beginning of the course)
Multiple
are allotted
•Look fortrials
substitutes
to cover unexpected absences.
•Computer
Issues View sample display
•Web Assign
Instant feedback
•Others
John Hopkins 2003
Help
Student Use
Technology Use
Faculty/Staff
Administrative Uses
Course Preparation
Archive
Lectures
Exams
Web
Console
Labs
Student
Eduactional Uses
Course Operation
Demos
WebAssign
Recitations
Help Desk
Job Duties
TA Website
Grades
Homework
Labs
Grading
Grading
Excuses
Primary source of information regarding the administrative
aspects of the course can be found on the course website:
http://class.phys.psu.edu
John Hopkins 2003
Help
Recent Effort
Technology Use
Faculty/Staff
Administrative Uses
Course Preparation
Archive
Lectures
Exams
Web
Console
Labs
Recitations
Student
Eduactional Uses
Course Operation
Demos
WebAssign
Help Desk
Job Duties
TA Website
Grades
Homework
Labs
Grading
Grading
Excuses
Login problems generate a ripple effect through the system
Forgotten passwords, userids, etc.
We were looking to get out of the password business.
Internet2 was looking for a test case where confidential
information could be shared between research institutions.
John Hopkins 2003
Help
Internet2 - Shibboleth
Primary Goals of Inet2 (~200 Universities)
• Create a leading edge network capability for the national research community
• Enable revolutionary Internet applications
• Ensure the rapid transfer of new network services and applications to the broader
Internet community.
Shibboleth
Framework for providing inter-institutional sharing and controlled access to web
available services
Steve Kellogg - recognized that our problem had a shibboleth answer
Renee Shuey and Mark Earnest formed a group that worked with WebAssign and
implemented the code.
John Hopkins 2003
Trust
Request
Attribute
from
Release
User
Policies
Target Site
(Web Resource)
Origin Site
(user browser)
Authentication
Web
Request
Services
John Hopkins 2003
Effect
Trial
35
30
Questions
One large course and one medium
course (~1000 students) using
Shib (Physics 211 and 001)
One large course and two medium
courses used as control (physics
212 and 213/4)
WebAssign questions
25
20
15
10
5
9
10
97
85
73
61
49
37
25
13
Historically, first two weeks • 25 to 30 questions/day
• Almost all are login problems
0
1
Control Group
Date
Numbers of queries in the “Shib” courses …..~1 or 2/day
A reduction of ~85%
Numbers of queries in the normal courses remain at ~ 15/day for 3
John Hopkins 2003
weeks
Full Implementation
WebAssign questions
Fall '02
35
No Shib
Questions
What we saw in the trial
with ~1000 students
30
25
20
15
10
5
9
10
97
85
73
61
49
37
25
13
1
0
Date
25
20
15
10
5
John Hopkins 2003
Date
76
71
66
61
56
51
46
41
36
31
26
21
16
11
0
6
~2500 students.
30
1
(Physics 211, 212, 213/4, 001)
35
# of Queries
Implementation in
all of the classes
"Contact Us" WebAssign
Spr '03