Home

BOEING2 Database RePo

Boeing Project 2

Status: Active

Vision

Goals (ordered by priority)

1. Implement learner trajectory dashboard - production level visualization and layouts; includes main visualization (a), and supplementary visualizations of student performance/proficiency data (b)

   • Learner Trajectory Network basemap
     • Linear network layout (highest priority) - visualize individual students interactions and transitions between course modules;
     • Temporal-coordinate layout (stretch) - visualize student with additional temporal dimension; comparison of multiple students.
     • Force atlas layout
   • Supplementary student/cohort visualizations
     • Learner Performance and Participation Heatmap
     • Statistical visualizations of student activity and time (individual to group comparison) (e.g. box-plots)
     • Track proficiency trajectory across assessment instruments (e.g. line graphs)
     • Visualization of cohort activities (e.g. scatter plots)

2. Create an dynamic learner trajectory network - A network visualization of individual student's interactions with and transitions between course modules, which allows a user to explore data and animate a student's activity in LMS over time.

3. Evolving Architecture - visualization architecture should evolve to add new production visualizations as research questions and/or data sets emerge;

   • Works with existing e-learning technology standards - LTI and Caliper standards (see documentation links)
   • Supplementary data sets on module learning objective and cognitive load.

4. Provide tools for data extractions - data filters parameters should create subsets of data for a student that may be extracted for re-use in analysis or learning model.

Links

Essential links for this project.

• GitHub Repositories

  • edx-studentcourseanalytics GitHub Repository (SOW 1)
    • Documentation of the edX Student Course Analytics Pipeline (Working Document) (BOX)
  • GitHub Repository
  • Project Board (on GitHub)
  • Project Board (on ZenHub)

• CNS Server Directories and Structure

  • Data for SOW 1 project: \\smb.cns.iu.edu\projects\research\17-Boeing\
  • Data for SOW 2 project: \\smb.cns.iu.edu\projects\research\18-Boeing\
  • Both projects use the same project organizational structure for accessing data
    • Project Administration: .\admin\
    • Data processing scripts: .\scripts\
    • Raw unprocessed edX course data: .\data\edx[course_ID][date]\
      • edX Course State Data (course database): .\state\
      • edX Event Logs: .\events\
    • Processed data: .\data\sow1-PNAS-processingAnalysis\
      • Processed course structure: .\course\
      • Lists of student cohorts (edX IDs: .\userlists\
      • Extracted student event logs: .\studentevents\
      • Processed student event logs: .\studentevents_processed\
      • Analysis results (aggregated data sets & visualizations): .\analysis\

• Outputs

  • Demo Site
  • Staging Site
  • Production Site
  • Web Site

Meeting Notes

Live, editable meeting notes are maintained on OneNote, and may be retrieved by visiting OneDrive cloud or syncing OneNote desktop to the notebook. Team members are free to view and update the meeting notes and minutes. Relevant meeting recordings and scanned sketches will also be preserved to a Box Directory.

Meeting Notes

• Boeing Additive Manufacturing Group - Meeting Notes
  • 2018-05-04 Meeting Notes

BOX Directories

• 18-Boeing2-AdditiveManufacturing
  • IRB Directory
• CNS Restricted BOX Directories
  • 17-Boeing-RESTRICTED-ACCESS (SOW 1)
  • 18-CTSI-Boeing2-IU-RESTRICTED (SOW 2)
    • CNS Boeing SOW 2 - Specification
    • RA Document

LMS Documentation, Data Standards, and Related Work

edX Research Documentation and GitHub Repositories

• edX Research Documentation
• edX Research Documentation: Events in the Tracking Logs
• MITx Data Request Checklist
• edX Organization GitHub
• edx-analytics-pipeline GitHub repository
• edx-analytics-data-api GitHub repository
• edx-analytics-dashboard GitHub repository

Canvas LMS GitHub Repository

• Canvas LMS (Open)

Relevant e-Learning Standards

• Common Education Data Standards (CEDS)
• Caliper Analytics
  • IMS Caliper Certified Providers
  • Caliper Analytics Implementation Guide
• Learning Tools Interoperability (LTI) Standard
  • How LTI Works

Unizin - A consortium of universities that use Canvas and develop data warehouse and ecosystem

• Unizin Common Data Model
• Unizin Community Portal
• Learning Analytics Community of Practice Archive - Presentation Archive for Unizin LA CoP. Shows scope of university development Canvas related development projects.

Learning Analytics Dashboards

• LTI Integration + Caliper MediaEvent Metric Profile (Dashboard)

Project Timelines

The Project Timelines page provides information on the overall Boeing visualization and analysis project timeline to provide an overview of the current project goals and accomplishments. Individual sub-projects will be managed in the Boeing-2 Projects portal; larger coding projects.

Overall Project Timeline and Milestones

• 2018-05-25 - Initial prototype of animated linear learner trajectory; demo ready for mid-June Boeing Researcher and MITx meeting
• 2018-05-25 - Secure MITx Data Use Agreement, and acquire data course data for remaining AM & SE courses;
• 2018-06-08 - Process log data from all edX courses
• 2018-06-29 - Create edX course research database for Additive Manufacture course
• 2018-07 - Cohort analysis work for early data Additive Manufacturing course
• 2018-10 - Virtual Co-presentation of results to Boeing Management (4Q 2018, TBD)*
• 2018-10-01 - Submission of research paper of results
• 2018-11-15 - Project end date - all deliverables due

Roles

The roles for people assigned to the Learner Trajectory Visualization project.

• Project Manager - Michael Ginda
• Product Owner - Michael Ginda
• Scrum Master - Bruce Herr
• Team Members - Blue Dino
• Stakeholders -
  • Katy Borner,
  • [Michael Richey, Boeing](Michael Richey, Boeing),
  • MITx Pro
• Support Team - CNS Support

External Collaborators

Creativity Labs/ @ IU Team

• PI/Researcher - Dr. Kylie Peppler, Director of Creativity Labs
• Research Assistant - Ethnographer - Joey Huang, phD student with Center for Research on Learning and Technology
• Research Assistant - Instrumentation - Sophia Bender, phD student with Center for Research on Learning and Technology
• Scheduler, Admin. Assistant - Janis Watson, email [email protected] OR [email protected]

Penn Center for Learning Analytics. @ UPenn

• PI/Researcher - Dr. Ryan Baker, Director of the Penn Center for Learning Analytics.
• Scheduler, Admin. Assistant - Danna, email: [email protected] The roles for people assigned to this project.