As part of your organization, you can download reports to understand how members are using and learning with Yoodli. Reports are generated upon request and take a few moments to get ready. Note that data in reports may be up to 1 hour out of date, so they are best used not for seeing real-time changes but instead for tracking usage and progress over a past period.
Organization and Group Reports
You can access general organization and group level reports from within the "Members" and "Groups" views. There are 3 reports that are available, each with the following information in them.
Organization / Group User Engagement Report
This report provides a basic overview of how often members are engaging with Yoodli. Each report will contain one row per member.
Report includes:
Email
Name
Sign up date
Practices started
Completed practices
Shared practices
Practices with comments
Comments given
Average practice mins
Last practice date
Organization / Group User Goal Improvement Report
This report provides an overview of how members are improving against goals with scenario rubrics. Each report will contain multiple rows per member, one for each goal they've practiced against.
Report includes:
Email
Name
Sign up date
Goal
Last practice or upload date
Count of practices that included this goal
First goal score
Max goal score
Latest goal score
Organization / Group Feature Use Report
This report provides an overview of how members are using the many different features within Yoodli. Each report will contain one row per member.
Report includes:
Email
Name
Sign up date
Presentations Completed
Interviews Completed
Roleplays Completed
Average minutes per practice
Uploads
Yoodli for Video Calls recordings
Average minutes per video call
Desktop App Recordings
Average minutes per desktop app call
Organization and Group Roleplay Goals Report
This report helps provide a simplified overview of how users have improved on goals through practicing a roleplay, with a single row per roleplay and goal
Report includes:
Organization ID
Roleplay ID and title
User email, display name, and ID
User signup date (ISO 8601)
Goal or rubric item display name
Number of attempts started for this goal
First score percentage (based on earliest recording date)
Maximum score percentage achieved
Last score percentage (based on latest recording date)
Average score percentage for this goal
Organization and Group Roleplay Attempts Report
The report is our most in-depth report, perfect for BI use cases. It provides a row per user per roleplay per goal per attempt, giving the most in-depth data to analyze for trends and usage data
Reports include:
Organization ID
Roleplay ID and title
User email, display name, and ID
User signup date (ISO 8601)
Speech share ID
Goal or rubric item display name
Attempt start and end timestamps (ISO 8601)
Number of seconds recorded
Goal score (floating point, out of 100)
Goal numerator and denominator
Scenario Reports
Scenario reports are available from the "..." menu within your scenario library. While Yoodli recommends using Programs to get the best tracking of using improvement over time as part of a learning program, scenario reports can allow you to use scenarios without programs and still see how members are progressing over time.
Scenario Engagement Report
This report provides an overview of members who have engaged with this report.
Report includes:
Email
Name
Scenario Title
Attempts
First Score
Max Score
Last Score
Average Score
Minutes Recorded
Program Reports
Programs are built to provide much more of the analytics and usage reporting live within the programs experience dashboards or via the "Export CSV" option. However, some report options are provided for data that's not easy to see otherwise.
Program Scenario Step Report
Like the scenario report, this captures the number of members who have engaged with this scenario but limits the data to just members participating in the program.
Report includes:
Email
Name
Attempts
Completed (1 for if the step has been completed, 0 for if the step is incomplete)
First Score
Max Score
Last Score
Average Score
Minutes Recorded
Scheduled Reports
Scheduled Reports let you automate the delivery of Yoodli data on a set schedule. This makes it easier to work with your data in external tools or data warehouses.
Why use Scheduled Reports
If you regularly analyze Yoodli data outside the platform, downloading reports manually can be repetitive and time-consuming. Scheduled Reports save time by automatically sending the data you need, when you need it.
What kind of reports can I Schedule and where?
Org admins can set up automated report deliveries, specifying both the report type and where it should be sent (e.g., a secure data destination).
The reports you can choose from include:
User Engagement
Goal Improvement
Feature Use
Member Reports
Roleplay Goals Reports
Roleplay Attempts
The destinations you can send to are:
Email
S3
GCS
Azure Blob Storage
How to set up Scheduled Reports
Go to Org Settings
In Advanced Settings click "Create New" in Schedule Reports
Click "Create Report"
You have 3 reports to choose from, Member, Groups, and Roleplay
Member Reports are User Engagement, Goal Improvement, Feature Use
Group Reports are the same but you will choose which groups are exported.
Roleplay Reports will include the information in Scenario Reports
Choose where to export
Depending on where you export you will need the following information:
S3
S3 supports two approaches for data export: Access Key/Secret Key based access, or providing Yoodli's service account access to your buckets
Access Key/Secret Key is simplest. Create a user with access to your bucket (no console access is required) and provide Yoodli with the following information
Access Key ID
Secret Access Key
Region
Bucket Name
Object Key Prefix
Using Yoodli's service account
For organizations that require no access keys to be used, you can grant Yoodli’s AWS bucket writer permission to write to your bucket instead. This uses AWS’
AssumeRolefunctionality to grant Yoodli’s AWS bucket writer the permissions to write to your bucket. To set this upCreate a IAM user, which Yoodli's account will assume. The role should have permissions similar to the following
{"Version": "2012-10-17","Statement": [{"Effect": "Allow","Action": ["s3:PutObject",],"Resource": "arn:aws:s3:::customer-bucket-name/*"},}]}
You also need to create a Role Policy to allow the Yoodli bucket writer to assume your IAM user.
sts-external-idis a secret passphrase that you will give to Yoodli to allow only our writer to assume your IAM user role.{"Version": "2012-10-17","Statement": [{"Effect": "Allow","Principal": {"AWS": "arn:aws:iam::850995565764:user/yoodli-reports-service-prod"},"Action": "sts:AssumeRole","Condition": {"StringEquals": {"sts:ExternalId": "sts-external-id"}}}]}
On our reports page role, you will need to give us the following information: the ARN of the IAM user to assume and the external ID acting as the secret passphrase
Email
Email Address
GCS
Upload JSON credentials file (This can be obtained in the Google Cloud web console by navigating to the IAM page and clicking on Service Accounts in the left sidebar. Then, find your service account in the list, go to its Keys tab, and click Add Key. Finally, click on Create new key and choose JSON.)
Bucket Name
Object Prefix
Azure Blob Storage
Storage Account Name
Container Name
Tenant ID
Client ID
Client Secret
Once you have completed this form click, "Save". You will be sent a report initially as a test to verify all the information is correct. Check your destination for this report. You will be notified of an error if a report has not been sent.
Still need help?
Contact [email protected] or click the messenger at the bottom right to chat