Skip to main content

Organization Reports

Learn about how you can get reports on usage and progress of members of your organization

Derek Sessions avatar
Written by Derek Sessions
Updated over a week ago

As part of your organization, you can download reports to understand how members are using and learning with Yoodli. Reports are generated upon request and take a few moments to get ready. Note that data in reports may be up to 1 hour out of date, so they are best used not for seeing real-time changes but instead for tracking usage and progress over a past period.

Organization and Group Reports

You can access general organization and group level reports from within the "Members" and "Groups" views. There are 3 reports that are available, each with the following information in them.

Organization / Group User Engagement Report

This report provides a basic overview of how often members are engaging with Yoodli. Each report will contain one row per member.

Report includes:

  • Email

  • Name

  • Sign up date

  • Practices started

  • Completed practices

  • Shared practices

  • Practices with comments

  • Comments given

  • Average practice mins

  • Last practice date

Organization / Group User Goal Improvement Report

This report provides an overview of how members are improving against goals with scenario rubrics. Each report will contain multiple rows per member, one for each goal they've practiced against.

Report includes:

  • Email

  • Name

  • Sign up date

  • Goal

  • Last practice or upload date

  • Count of practices that included this goal

  • First goal score

  • Max goal score

  • Latest goal score

Organization / Group Feature Use Report

This report provides an overview of how members are using the many different features within Yoodli. Each report will contain one row per member.

Report includes:

  • Email

  • Name

  • Sign up date

  • Presentations Completed

  • Interviews Completed

  • Roleplays Completed

  • Average minutes per practice

  • Uploads

  • Average minutes per video call

  • Desktop App Recordings

  • Average minutes per desktop app call

Organization and Group Roleplay Goals Report

This report helps provide a simplified overview of how users have improved on goals through practicing a roleplay, with a single row per roleplay and goal

Report includes:

  • Organization ID

  • Roleplay ID and title

  • User email, display name, and ID

  • User signup date (ISO 8601)

  • Goal or rubric item display name

  • Number of attempts started for this goal

  • First score percentage (based on earliest recording date)

  • Maximum score percentage achieved

  • Last score percentage (based on latest recording date)

  • Average score percentage for this goal

Organization and Group Roleplay Attempts Report

The report is our most in-depth report, perfect for BI use cases. It provides a row per user per roleplay per goal per attempt, giving the most in-depth data to analyze for trends and usage data

Reports include:

  • Organization ID

  • Roleplay ID and title

  • User email, display name, and ID

  • User signup date (ISO 8601)

  • Speech share ID

  • Goal or rubric item display name

  • Attempt start and end timestamps (ISO 8601)

  • Number of seconds recorded

  • Goal score (floating point, out of 100)

  • Goal numerator and denominator

Scenario Reports

Scenario reports are available from the "..." menu within your scenario library. While Yoodli recommends using Programs to get the best tracking of using improvement over time as part of a learning program, scenario reports can allow you to use scenarios without programs and still see how members are progressing over time.

Scenario Engagement Report

This report provides an overview of members who have engaged with this report.

Report includes:

  • Email

  • Name

  • Scenario Title

  • Attempts

  • First Score

  • Max Score

  • Last Score

  • Average Score

  • Minutes Recorded

Program Reports

Programs are built to provide much more of the analytics and usage reporting live within the programs experience dashboards or via the "Export CSV" option. However, some report options are provided for data that's not easy to see otherwise.

Program Scenario Step Report

Like the scenario report, this captures the number of members who have engaged with this scenario but limits the data to just members participating in the program.

Report includes:

  • Email

  • Name

  • Attempts

  • Completed (1 for if the step has been completed, 0 for if the step is incomplete)

  • First Score

  • Max Score

  • Last Score

  • Average Score

  • Minutes Recorded

Scheduled Reports

Scheduled Reports let you automate the delivery of Yoodli data on a set schedule. This makes it easier to work with your data in external tools or data warehouses.

Why use Scheduled Reports
If you regularly analyze Yoodli data outside the platform, downloading reports manually can be repetitive and time-consuming. Scheduled Reports save time by automatically sending the data you need, when you need it.

What kind of reports can I Schedule and where?
Org admins can set up automated report deliveries, specifying both the report type and where it should be sent (e.g., a secure data destination).

The reports you can choose from include:

  • User Engagement

  • Goal Improvement

  • Feature Use

  • Member Reports

  • Roleplay Goals Reports

  • Roleplay Attempts

The destinations you can send to are:

  • Email

  • S3

  • GCS

  • Azure Blob Storage

How to set up Scheduled Reports

  1. Go to Org Settings

  2. In Advanced Settings click "Create New" in Schedule Reports

  3. Click "Create Report"

    1. You have 3 reports to choose from, Member, Groups, and Roleplay

    2. Member Reports are User Engagement, Goal Improvement, Feature Use

    3. Group Reports are the same but you will choose which groups are exported.

    4. Roleplay Reports will include the information in Scenario Reports

  4. Choose where to export

Depending on where you export you will need the following information:

  • S3

    • S3 supports two approaches for data export: Access Key/Secret Key based access, or providing Yoodli's service account access to your buckets

      • Access Key/Secret Key is simplest. Create a user with access to your bucket (no console access is required) and provide Yoodli with the following information

        • Access Key ID

        • Secret Access Key

        • Region

        • Bucket Name

        • Object Key Prefix

      • Using Yoodli's service account

        • For organizations that require no access keys to be used, you can grant Yoodli’s AWS bucket writer permission to write to your bucket instead. This uses AWS’ AssumeRole functionality to grant Yoodli’s AWS bucket writer the permissions to write to your bucket. To set this up

          • Create a IAM user, which Yoodli's account will assume. The role should have permissions similar to the following

            • {

              "Version": "2012-10-17",

              "Statement": [

              {

              "Effect": "Allow",

              "Action": [

              "s3:PutObject",

              ],

              "Resource": "arn:aws:s3:::customer-bucket-name/*"

              },

              }

              ]

              }

          • You also need to create a Role Policy to allow the Yoodli bucket writer to assume your IAM user. sts-external-id is a secret passphrase that you will give to Yoodli to allow only our writer to assume your IAM user role.

            • {

              "Version": "2012-10-17",

              "Statement": [

              {

              "Effect": "Allow",

              "Principal": {

              "AWS": "arn:aws:iam::850995565764:user/yoodli-reports-service-prod"

              },

              "Action": "sts:AssumeRole",

              "Condition": {

              "StringEquals": {

              "sts:ExternalId": "sts-external-id"

              }

              }

              }

              ]

              }

          • On our reports page role, you will need to give us the following information: the ARN of the IAM user to assume and the external ID acting as the secret passphrase

  • Email

    • Email Address

  • GCS

    • Upload JSON credentials file (This can be obtained in the Google Cloud web console by navigating to the IAM page and clicking on Service Accounts in the left sidebar. Then, find your service account in the list, go to its Keys tab, and click Add Key. Finally, click on Create new key and choose JSON.)

    • Bucket Name

    • Object Prefix

  • Azure Blob Storage

    • Storage Account Name

    • Container Name

    • Tenant ID

    • Client ID

    • Client Secret

Once you have completed this form click, "Save". You will be sent a report initially as a test to verify all the information is correct. Check your destination for this report. You will be notified of an error if a report has not been sent.


Still need help?

Contact [email protected] or click the messenger at the bottom right to chat

Did this answer your question?