This article explains how to use Differences in Brilliant Assessments to report on the gap between segmentation groups, iterations, roles, or benchmarks, including how to display, chart, and comment on score differences.
Significantly increase the value you deliver in your reports by being able to highlight Differences.
On this page
What You Can Compare
This functionality allows you to report based on the difference between:
- Two segmentation groups or segmentations — for example, in a 360, you may compare competence in a skill and importance to the role of that skill.
- Two iterations to highlight improvement or change over time.
- Two roles — for example, in a 360, you may compare the subject's perception of their capabilities with that of their managers.
- The respondent's result and benchmarks — the result can be an individual or a cohort, and any benchmark (all respondents or based on a classifier) can be used.
What You Can Do with Differences
This functionality allows you to:
- Report a score difference (actual score (Likert style) or the percentage, positive or negative).
- Chart differences using all available chart types (actual score (Likert style) or the percentage, positive or negative).
- Comment on a score difference at any level of granularity with rating text (assessment, section, subsection, or segmentation).
- Name a score difference, usually with top and bottom functionality (e.g. "your biggest improvements").
Setup for Reporting Based on Differences
Differences are specified to be used by picking it as a display type on merge strings within your report.
| How to | Using the Merge Manager | Parameter | Notes |
| Show the difference between two Segmentation Groups as an Actual (Likert) score or percentage. |
From "Display" select Difference Between Segmentations or Difference Between Segmentations % From "Options" select Base Segmentations |
|
Calculate the difference for the actual score or percentage between two Segmentation Groups or Segmentations. If the Segmentation score is higher than the base Segmentation Score, the result will be positive; if it is below, the result will be negative. If Example merge string: {BarHorizontal[SegG=xx SegmentationNo=ALL RatingType=xx Metric=DiffSegPC Base-SegG=xx Height=880 Width=600 Label=Y YAxisMin=-100 YAxisMax=100 YAxisInc=20]} |
| Show the difference between two Iterations as an Actual (Likert) score or percentage. |
From "Display" select Difference Between Iterations or Difference Between Iterations % From "Options" select Base Iteration |
|
Calculate the difference for the actual score or percentage between two Iterations. If the Iteration score is higher than the base Iteration Score, the result will be positive; if it is below, the result will be negative. |
| Show the difference between two Roles as an Actual (Likert) score or percentage. |
From "Display" select Difference Between Roles or Difference Between Roles % From "Options" select Base Role |
|
Calculate the difference for the actual score or percentage between two Roles. If the actual Role score is higher than the base Role Score, the result will be positive; if it is below, the result will be negative. |
| Show the difference between the score and the Benchmark as an Actual (Likert) score or percentage. |
From "Display" select Difference to Benchmark or Difference to Benchmark % From "Options" select Benchmark |
|
Calculate the difference between the score or percentage and the Benchmark. If the actual score is higher than the Benchmark Score, the result will be positive; if it is below, the result will be negative. |
The only setup required for reporting on differences is when you want to have text or colors based on Ratings. In this case, usually you will have a Rating Type and Ratings dedicated to reporting on difference ratings. These will often use more granularity than other ratings and allow for negative ratings. For example:
Note: The rating to be used is selected as the "next higher" using mathematical rules, so while a positive difference of (say) 15% will use the rating with a maximum score of 20%, a negative difference of (say) -15% will use the rating with a maximum score of -10%.
Example: Comparing Differences Between Roles
When you want to show differences between roles (e.g. in a 360 assessment comparing how "Yourself" rated versus how "Others" rated), you need to specify both the role being displayed and the base role to compare against. This is done using the Identifier and Base-Identifier parameters in your merge strings.
Tip: The Identifier parameter specifies the role whose scores are being displayed, while BaseIdentifier specifies the role to compare against. The difference is calculated as: Identifier score minus Base-Identifier score. A positive result means the displayed role scored higher than the base role.
Showing a Score Difference Between Roles
To display the actual (Likert) score difference between "Yourself" and "Others" for a segmentation
{RatingScore.ActualPoints[Metric=DiffReportId SegmentationNo=xx Identifier=Yourself BaseIdentifier=Others Decimals=2]}
This calculates: Yourself's score minus Others' score.
Tip: Replace Yourself and Others with the actual role names configured in your assessment. Replace xx with the appropriate Segmentation number from your assessment setup.
Comments
0 comments
Please sign in to leave a comment.