DLIM-ITSDistributed Learning Interoperable Modular Intelligent Tutoring System

Kickoff meeting at JADL Co-Lab

May 16, 2007

Presented by: Randy Jensen, jensen@stottlerhenke.comDick Stottler, stottler@stottlerhenke.com650-931-2700http://www.stottlerhenke.com

Don Holmes, don.holmes@imediait.comJohn Campbell, john.campbell@imediait.com

Gary Green, ggreen@ist.ucf.edu

2

Agenda

Project Team

Relevant Prior Work

Project Scope

Questions and Issues

3

Project Team

Stottler Henke

Imedia.it

IST

Randy Jensen, Dick StottlerArtificial Intelligence SoftwareIntelligent Tutoring SystemsAutomated AAR

Don Holmes, John CampbellSCORM sequencingCourse development

Gary GreenC2V testbed at STTC Orlando

4

Stottler HenkeHistory

Locations

Mission

Core competency

Businesses

Solution areas

Personnel

Founded 1988 by Dick Stottler, Andrea Henke

San Mateo, CA; Seattle, WA; Boston, MA

Solve problems that defy solution using traditional approaches

Artificial intelligence

Contract R&D, software products

Education & trainingPlanning & schedulingKnowledge management & discoveryDecision supportAutonomic computing

45 tech staff: 25% PhD, 45% MS/MA, 30% BS

5

Stottler HenkeTraining - Core Competencies

Intelligent Tutoring

Training Simulations

Authoring Tools

Automated performance assessmentAutomated instruction

Intelligent behaviors

Training simulationsIntelligent tutorsSimBionicSimVentive

6

Stottler HenkeIntelligent Tutoring Application Areas

Military & Space

Professional

K-12 & College

Tactical decision-makingCommand and controlSonar data analysisSatellite operationsCounter-terrorism data analysisJoint staff officer inter-Service/agency teamworkSystem diagnosis and recovery

Emergency medicineEquipment and software operationsLeadership, project management

Earth science / satellite imagery (HS, college)Reading comprehension (adult)Math (Grades 3-6, algebra)Nutrition (Jr. HS)Neuroscience (HS)

Helo cockpit operations Helo pilotingInformation warfareAOC operations

7

Institute for Simulation and Training (IST)University of Central Florida (UCF)

• Founded in 1982, IST is an interdisciplinary research institute of the University of Central Florida that performs leading edge basic and applied research in the art and science of simulation

• IST is one of the nation’s leading research centers for simulation, training, modeling, virtual, augmented and mixed reality research for both defense and commercial applications.

• IST employs close to 100 full-time researchers and support personnel.

• IST provides a wide range of research and information services for the modeling, simulation and training community with the focus on training and simulation

8

Institute for Simulation and Training (IST)University of Central Florida (UCF)

• Major Research Domains– Human-Robot Interfaces and Interactions– Medical Simulation and Training – Virtual Environments– Terrain Databases– Computer Generated Forces– Team Training and Human Factors– Complex Adaptive Systems Research– Autonomous Wireless Robots– Embedded Simulation and Training– Parallel Computing– Mathematical Models for Crowd Behavior– Information Technology

9

Imedia.it

• Create knowledge lesson content for prototype with learning objectives corresponding to the ITS principles, such as…– Unmanned asset control procedures– Reporting, calls for fire– Engagement procedures

• Provide SCORM expertise related to development of IPA components for the prototype

• Develop sequenced SCORM 2004 package containing the lesson and 2 scenario LSF objects

10

Imedia.itSCORM Experience

• More than 2 years creating SCORM 2004 content

• Presented at Plugfest 9 regarding conversion of Common Ground Station course from SCORM 1.2 to 2004

• In 2005, developed ICT with Stottler Henke, which was the 1st SCORM 2004 course delivered to the US Army

• Developed 55 content packages, including 520 SCOs for the US Army since 2005

• Demonstrated “on the fly” remediation using SSP during ImplementationFest 2006 and ITEC 2007.

• Active members of the ADL SCORM TWG

11

Imedia.itSCORM Experience, cont’d

• Members of SISO SCORM/Simulation study group

• Won award for best SCORM compliant product (Tactical Questioning) at ELearning Demofest 2006

• Working with US Army PM-DLS to identify and document issues with current ALMS

• Provided consulting for over a dozen major LMS vendors regarding SCORM compliance issues, including the first two 3rd Edition certified vendors.

12

Agenda

Project Team

Relevant Prior Work

Project Scope

Questions and Issues

13

Intelligence in Combating Terrorism

SCORM 2004 course

Collaboration between Imedia.it and Stottler Henke

This screen shows the intelligence traffic, a partially complete association matrix and a partially complete link diagram. The message summary in the top left panel also indicates if a message has been completely processed. A check mark indicates that the student has identified all associations or events in the message.

Projects – ICT

14

Projects – ICT

15

Projects – AOC-ITSWeb-based refresher training ITS for Air Force AOC planners.

16

Projects – CACCTUSProjects – CACCTUS

Automated AAR system for USMC combined arms team training at single sites or synchronous distributed sites.

17

Projects – C2V ITS

Command and Control Vehicle embedded trainer testbed with integrated Intelligent Structured Trainer providing automated evaluation.

18

C2V Testbed

19

C2V History

• Built as a one person futuristic robotic control station to support embedded training research

• Patterned after early concepts for Future Combat System (FCS) command and control stations

• Represents crew station that might reside in the back of an FCS command and control vehicle

• Used for intelligent tutoring and human-robotic interaction research and experimentation by Army Research Lab (ARL) and UCF graduate students

20

C2V Functionality

• A Soldier would use the control station to manage both ground (UGV) and air (UAV) unmanned vehicle operations

• From the testbed, operator can – Designate routes for UGVs to follow autonomously – Drive UGVs remotely using testbed controls– Engage targets with UGV weapons– Manage route and altitude for autonomous UAVs– Monitor and manage sensors on UGVs and UAVs– Send messages such as call for fires or spot reports

21

C2V Display Layout

Situational Awareness

Autonomous Vehicle Status, Robotic Control Interface

Sensor View

Vehicle Instruments, Switches, Knobs, Target List

Driver’s View Gunner’s View

22

C2V Software Architecture

• Simulation is driven by One Semi-Automated Forces (OneSAF) using Distributed Interactive Simulation (DIS) protocol

• Data collection is external

• Data collection sequence– Event detected internally– DIS message created and published externally– Message received by S2Focus – Message parsed to SQL database

23

C2V Testbed Hardware

Sensor View

Vehicle Instruments, Target List

Weapon View

Host 1 Host 2IG IG IG

Autonomous Vehicle Status, Robotic Control (OCU) Interface

S2FOCUSData Collection

Other DISSimulators

24

C2V Hardware

• Touchscreen Displays– Six Displays in 3 X 2 Grid– TouchScreen interface with resistive touch

surfaces – 1024 X 768 resolution

• Six Shuttle Computers– For Image Generation and Host Computers– Operating System is Linux

25

Agenda

Project Team

Relevant Prior Work

Project Scope

Questions and Issues

26

Primary Goals

ITS InteroperabilityITS InteroperabilityITS InteroperabilityITS Interoperability

Execute ITS exercises using LTP configuration instructions Execute ITS exercises using LTP configuration instructions provided by the DTECS based on SCORM sequenced LSF input.provided by the DTECS based on SCORM sequenced LSF input.Execute ITS exercises using LTP configuration instructions Execute ITS exercises using LTP configuration instructions provided by the DTECS based on SCORM sequenced LSF input.provided by the DTECS based on SCORM sequenced LSF input.

Embedded Trainer CompatibilityEmbedded Trainer CompatibilityEmbedded Trainer CompatibilityEmbedded Trainer Compatibility

Prototype a framework in which a SCORM course can include Prototype a framework in which a SCORM course can include virtual training events in the embedded or facility based setting.virtual training events in the embedded or facility based setting.Prototype a framework in which a SCORM course can include Prototype a framework in which a SCORM course can include virtual training events in the embedded or facility based setting.virtual training events in the embedded or facility based setting.

27

Proposed Architecture

28

Initial Phase I Concept

• Develop initial course for skills applied on the C2V testbed– Support lesson SCO– C2V ITS scenario represented with an LSF object– DTECS retrieval of compatible LTP file

• Demonstration consisting of two executions– Beginner student diagnosed as such as a result of the initial

support lesson– More advanced student, for whom a more advanced

scenario will be retrieved and delivered

• Potential additional major goals for Phase II– Capture ITS assessment output in Learner Profile– Present remedial exercises

29

Guiding Principles

• Leverage current and preceding efforts– DTECS, LSF, LTP, etc.

• Compare notes / collaborate with other prototype efforts

• Minimize new course development– Reuse existing scenarios for the testbed– Focus development efforts on developing or extending IPA

concepts of interest to JADL Co-Lab

• Link the ITS world with the DL world!

30

Major Tasks and Schedule

(from proposed 12 month schedule)

31

Agenda

Project Team

Relevant Prior Work

Project Scope

Questions and Issues