QIC
  • Home
  • Services
    • Current Projects
    • Powered by QIC
  • About
  • Blog
  • Careers
  • Contact
  • Home
  • Services
    • Current Projects
    • Powered by QIC
  • About
  • Blog
  • Careers
  • Contact

QIC's Blog

Design Heuristics for Developing an Effective Human-Agent Co-Learning Tool

2/13/2023

0 Comments

 
The USAF has funded the development of an AI-driven co-learning partner that monitors student learning, predicts learning outcomes, and provides appropriate support, recommendations, and feedback. As a trusted partner, AI co-learning agents have the potential to enhance learning though the challenge is developing an evolving agent that continually meets the learner’s needs as the learner progresses toward proficiency. Taking a user-centered design approach, we derived a series of heuristics to guide the development of an AI co-learning tool for adoption and sustained use then mapped technical feature recommendations onto each heuristic.  
 
United States Air Force (USAF) Tactical Aircraft Maintainers are responsible for ensuring aircraft meet airworthy standards and are operationally fit for missions. Aircraft maintenance is the USAF's largest enlisted career detail, accounting for approximately 25% of their active duty enlisted personnel (US GAO, 2019). The USAF has successfully addressed maintenance staffing shortages in recent years, but the challenge has shifted to a lack of qualified and experienced maintainers (GAO, 2022). To address this issue, the USAF is seeking innovative ways to increase maintenance training efficiency, such as using artificial intelligence (AI) in the training environment (Thurber, 2021). Specifically, the USAF has funded the development of an AI-driven co-learning partner that monitors student learning, predicts learning outcomes, and provides appropriate support, recommendations, and feedback (Van Zoelen, Van Den Bosch, Neerincx, 2021). The AI co-learning agent goes beyond being a personalized learning assistant by predicting learning outcomes based on student data, anticipating learner needs, and adapting continuously to meet those needs over time while maintaining trust and common ground. 

As a trusted partner, AI co-learning agents have the potential to enhance learning by dynamically adapting to student needs and providing unique analytical insights. The challenge is developing an evolving agent that continually meets the learner’s needs as the learner progresses toward proficiency. Our literature review uncovered that designing an effective AI co-learning tool for initial adoption and sustained use requires observability, predictability, directability, and explainability (Bosch et al., 2019). Establishing trust and common ground are important factors that can impact the learner’s confidence in the agent and influence tool usage. Taking a user-centered design approach, we derived a series of heuristics that guide the development of an AI co-learning tool based on the identified factors. We then mapped technical feature recommendations onto each heuristic, resulting in 10 unique and modified heuristics with associated exemplar feature recommendations. These technical features formed part of the design documentation for an AI co-learning tool prototype. 
​

The research-driven design heuristics will be presented along with the technical feature recommendations for the AI co-learning tool. The audience will gain practical insight into designing an effective human-AI co-learning tool to address training needs. The application goes beyond the immediate USAF need to other services, such as the U.S. Navy, where maintainer staffing has declined gradually (GAO, 2022). 



NDIA 2023 Human Systems Conference
March 1-2, 2023, Arlington, VA


March 1, 11:00AM, Design Heuristics for Developing an Effective Human-Agent Co-Learning Tool
Picture
0 Comments

    RSS Feed

    Authors

    These posts are written or shared by QIC team members. We find this stuff interesting, exciting, and totally awesome! We hope you do too!

    Categories

    All
    AI
    Conference Highlights
    Human Behavior
    Leadership
    Measures
    Performance Support
    Presentations
    Project Management
    Team Communication
    Welcome!
    XR

    Archives

    March 2023
    February 2023
    January 2023
    December 2022
    November 2022
    September 2022
    February 2022
    January 2022
    October 2021
    September 2021
    August 2021
    June 2021
    May 2021
    March 2021
    February 2021
    November 2020
    October 2020
    September 2020
    August 2020
    July 2020
    June 2020
    May 2020
    April 2020
    March 2020
    February 2020
    January 2020
    September 2019
    August 2019
    July 2019
    June 2019
    April 2019
    March 2019
    February 2019
    December 2018
    October 2018
    September 2018
    July 2018
    June 2018
    May 2018
    March 2018
    February 2018
    January 2018
    November 2017
    October 2017
    September 2017
    July 2017
    June 2017
    March 2017
    January 2017

 All Rights Reserved. Quantum Improvements Consulting, 2023