Programs are design to allow you to build specific learning plans or cohorts for members of your organization. This can be used to build and roll out a training course, organize your members into cohorts and track their progress and training separately, or can be used to help to use Yoodli with your LMS.
There are three main concepts to a program:
Status, which defines if the program is a draft, is active, or is archived
Groups of members assigned to an organization
Scenarios, which define the learning path
The status of the program defines how administrators and members can interact with it
Draft programs are only visible to administrators
All programs are created in a draft state. Draft programs can be modified in any way, but don't yet have members directly assigned to them.
When you've setup your scenarios and assigned groups to a program, you may then publish it
Published programs are visible to administrators and all members in the program.
Members in the program will see reminders in Yoodli to complete their program, and after each step of the program will be notified of what to do next.
Within the program, you will now be able to see and search a list of all members in the program and see their progress and analytics
Published programs may no longer have their learning path changed, but groups can still be added and removed from the program.
If a program is complete, you may the archive it
Archived programs are no longer visible to members and can no longer be participated in.
Archived programs are retained to allow you to review analytics, completion statistics, and other similar information.
Archived programs may no longer have their learning path changed, but groups can still be added and removed from the program. This will have no impact unless the program is re-published
You may re-publish a archived program at any time. Members will resume where they left off in the program
Some additional notes about programs:
Adding and removing groups to a published or archived program may take a few minutes if a large number of members are in those groups
Programs may be duplicated via the "..." menu. Duplicating a program creates a new draft program with the same scenarios and groups assigned to it
Programs can be deleted via the "..." menu. Deleting programs is not recommended unless the program was made as a mistake as deleted programs are not recoverable. For programs that are now complete, we recommend keeping them in an "Archived" state.
Building a learning path using scenarios
With programs, you build a learning path out of scenarios. You can learn more about building Scenarios here.
The learning path you build are ordered steps members need to go through to complete the program. Each step, for now, must be a scenario practice. However, for each step you can set specific completion requirements. There are 4 types of completion requirements:
Attempts requires members to complete that number of attempts of the program
Score requires members to achieve a given score
See below for more information about how scoring is done
Sharing requires members to share the recording after achieving one of the above requirements
Grader approval requires an assigned human grader to verify the AI feedback
Grader's will be able to both update the scores given by the AI, as well as leave notes on the AI feedback
If grader approval is required, sharing must also be required. Members will be required to share their attempt with their graders
A step in the program is considered complete if:
The Attempts or Score requirement has been achieved
and, if sharing is required, the attempt is then shared
and, if grader approval is required, the grader completes grading and member's the score remains above the required score
Scoring is controlled by the goals assigned to the scenario. You're able to both choose what goals (including custom goals, if included in your Yoodli plan) to score members on, and how to weight each goal in the rubric. On this screen you can also drag and drop the goals to determine the order they'll show up in for your members. Yoodli will do the math for you to add the results up to give a final score.
Tips:
To keep Yoodli as judgement-free as possible, we recommend enabling both the attempts and score requirements. That way members can always complete program steps after a few attempts
If you enabling sharing as a requirement, as an administrator you'll be able to easily see a member's shared attempts in your program view
The same scenario can appear multiple times within the learning path. You can use this feature to do things like take a "baseline" score by requiring a single attempt on the first program, have your members go through some learning exercises, and then having the scenario appear again to see how members have improved
Programs member experience
Programs are integrated into the member experience to ensure members know what they should be doing within Yoodli to complete their assignments.
Programs appear on the home page for all members in a program, for example:
Pressing "Continue" will jump members straight to the scenario they should be practicing. After completing their practice, they'll be provided a notice of how they did on the scenario and provided a quick action button to jump straight to the next step.
For members who have to take additional actions to complete their scenario, this quick action menu will let them know what to do next and provide a one-click option to take that required action.
Members are also able to see a breakdown of all of their assigned programs, and can view the program to see their attempts and how they've done on it.
Requiring Grader Approval
As part of creating steps in your program, you can choose to require grading by selected evaluators for members to pass that step.
The grading workflow works in the following way:
As part of setting up your program, you can now select Evaluators who will be responsible for grading user's practices when required
In some cases, Yoodli supports assigning per-member evaluators via integrations. Please contact your Yoodli team members if you're interested in this option.
Members will practice their scenario, and be required to achieve either the required attempts or score
One they hit that goal in the practice and if grading is required, members will then be prompted to share their practice for grading. This is required for them to pass this step in the program
Evaluators will receive an email notification and will be able to enter into a "grading" mode in the practice analysis. There they will be able to update the scores given by the AI, and will be able to leave feedback associated with the AI feedback, to provide their own perspective or correct the AI if they disagree with the feedback it provided
Evaluators can then complete their grading by pressing "I'm done", at which point the member will be notified of their final score and next steps depending on if they succeeded or failed based on the target score.
Once submitted, the scores can no longer be updated. Evaluators can always update the feedback they provided however
Using programs with your LMS
Programs are meant to work well with your LMS is you're using one. We recommend thinking about programs as a parallel to your LMS learning path in Yoodli, allowing you to more easily manage permissions and scenarios, track completion stats and learners progress, and run a successful training.
Here are the recommended steps to get started:
Build your learning plan in your LMS and choose where you'll want to insert Yoodli scenarios
Build your scenarios in Yoodli. Make sure to assign the right rubric and Coach Bot to give the best possible feedback.
Create a program in Yoodli. Add the scenarios you built in order, and assign members to the program via groups
Use the "..." on each scenario to copy a practice link, and insert those links into your LMS
Start your program and watch as your members work their way through their learning plan