Download Building Cognitive Model by Demonstration

Simulated Student:
Building Cognitive Model by
Demonstration
Noboru Matsuda
School of Computer Science
Carnegie Mellon University
CTAT: Cognitive Tutor Authoring Tools
Simulated Student Project
• No programming at all for Example-Tracing
Tutors
– A cognitive model specific to a particular problem
• For Model-Tracing Tutors, the author must build a
generalized cognitive model
– Writing production rules is challenging
– Cognitive task analysis is also challenging
– Performing a task is much easier…
2
PSLC Summer Intern Seminar :: Noboru Matsuda :: July 11, 2006
SimStudent
• Machine learning agent that …
Simulated Student Project
– Observes model solutions
– Learns problem-solving steps
– Outputs a set of production rules
}
Both for
correct and
incorrect
steps
• Model of human students learning cognitive skills
• Programming by Demonstration
Lau, T. A., & Weld, D. S. (1998). Programming by demonstration
Blessing, S. B. (1997). A programming by demonstration authoring tool for model-tracing tutors
3
PSLC Summer Intern Seminar :: Noboru Matsuda :: July 11, 2006
Next Generation Authoring
Build a tutor GUI
Simulated Student Project
Demonstrate a solution
SimSt. learning
Production Rules
Rule simplify-LHS:
Rule simplify-LHS:
IF
is-equation( Eq ),
IFRule simplify-LHS:
is-equation(
Eq ),
is-lhs(
Eq, Lhs ),
is-lhs(
Eq,
IF polynomial(
is-equation(
Lhs Lhs
), ),Eq ),
polynomial(
Lhs
all-var-terms(
is-lhs( Lhs
Eq, )),
Lhs ),
all-var-terms(
Lhs
Then
simplify(
polynomial(
Lhs, S-lhs
Lhs
),) ),
Then
simplify(
), )
enter(
S-lhs
all-var-terms(
)Lhs, S-lhsLhs
enter(
S-lhs ) Lhs, S-lhs ),
simplify(
enter( S-lhs )
Then
4
PSLC Summer Intern Seminar :: Noboru Matsuda :: July 11, 2006
No Free Lunch
• Background knowledge
Simulated Student Project
– Operators
– Feature predicates
• External Jess function written in Java
(defrule multi-lhs
…
?var22140 <- (column (cells ? ? ?var22143 ? ? ? ? ?))
?var22143 <- (cell (value ?val0&~nil))
=>
)
5
(test (fraction-term ?val0 ))
(bind ?val2 (denominator ?val0))
(bind ?input (mul-term-by ?val0 ?val2))
…
PSLC Summer Intern Seminar :: Noboru Matsuda :: July 11, 2006
Example: Stoichiometry Tutor
Simulated Student Project
Approximate Time Distribution (hours)
30
40
Operator generation
Feature predicate generation
Debugging
Testing
55
6
15
PSLC Summer Intern Seminar :: Noboru Matsuda :: July 11, 2006
Learn more about Simulated Students
Tutorial
Simulated Student Project
http://ctat.pact.cs.cmu.edu/tutorials/2.2/simst-interactive-learning
Send email to Noboru at [email protected]
7
PSLC Summer Intern Seminar :: Noboru Matsuda :: July 11, 2006