Capabilities

Content

• 544 chapters across 11 subspecialty areas
• Pre/post-test
• Bullet lists followed by expanded discussions in expandable/collapsible boxes
• Video that displays and plays in-line
• In-line figures and tables
• Linked educational content throughout; full-text book chapters, journal articles, etc, open in new window
• Lists of recommended readings and videos with links to full text or video file at end of chapter
• Specialty society content linked at end of chapter; currently ASSH content in the Hand section
• Full text links in references for AAOS publications and third-party content for which we have permission to link; PubMed links for remainder of references

Study Schedule

• 2-year schedule
• Schedule is comprised of weekly assignments, 96 weeks over 2 years (4 “off” weeks built in per year
• AAOS creates default schedule
• AAOS default schedule can be used out of the box or can be customized:
• Current functionality:
  • Programs can customize which chapters they want to include in each weekly assignment
  • Weeks can be reordered as desired by “dragging and dropping” within the calendar
  • One calendar per program
  • Future functionality (July 2023)
    • Scheduling in blocks of weeks
    • Multiple calendars per program – no limit, can have as many active calendars as needed
    • Assignment function – capability to assign specific schedules to specific residents (individual schedule assignments, cohort schedule assignments, etc)
    • Schedule library – ability to save previously created schedules for cloning and repurposing

Performance Dashboard

• Accessible through link found in “My Dashboard” in ROCK platform
  • Program Activity Report
    • Time filters
      • Defaults to 30 days
      • Can filter by predefined set of time (7 days, 30 days, 60 days, etc)
      • Can use calendar to define specific period of time
    • Summary and Key Indicators
      • High-level look at activity in platform for program
        • Who is in the platform by PGY
        • Average post-test score by PGY
        • Average questions answered by PGY
        • Highest/lowest performing topic by PGY
      • Resident Summary
        • High-level look at individual resident activity
          • Average pre/post-test scores
          • Total number of tests taken
          • Total number of questions answered
          • Time spent in assessments
          • Overall improvement from pre- to post-test
        • Performance by Topic
          • Comparison data that shows how the program is comparing to other programs in the platform
          • PGY filters allow a look at how a PGY cohort is comparing to their PGY cohort peers in the platform
        • Resident Activity Report
          • Accessible by clicking on the arrow found under the “View Details” column in the individual resident summary section
          • Residents have access to their individual report
            • Summary and Key Indicators
              • Number of exams taken
              • Average post-test score
              • Number of pre/post-test questions taken
            • Assessment Details
              • Detailed look at individual assessments taken:
                • Date completed
                • Pre-/post-test scores
                • Improvement
                • Time spent in assessments
              • Performance by Topic
                • Comparison data that shows how the individual resident performance compares to performance of peers in platform
                • Looking into adding data about how the individual resident performance compares to peers in program
              • Analytics Roadmap:
                • Time spent on site and time to chapter completion
                • Interface that shows resident progress and completion of assignments
                • Resident and program progress over time
                • Integrated performance reporting - ROCK, ResStudy, OITE

Custom Assignment

• Feature that allows for additional assignments outside of the study schedule
• Can be used for remediation, to reassign content delivered through the study schedule, or can be used to deliver content outside of the platform
  • Ability to assign individual chapters within the platform
  • Ability to assign individual videos within platform
  • Ability to assign content outside platform by adding link to content
  • Ability to select specific residents to receive assignment – can be on an individual resident level, a group or residents, or the whole program
• Assignments Library allows for saving Custom Assignments to clone and repurpose at a later date