Nov 2019 - Introduced Benchmarking, Classifiers, Assessor functionality, Open assessments, Rich and multiple texts merged into feedback and cohort reports, Chart improvements, Segmentation groups, Advanced ratings, Randomized questions and question pools

Included in the 2020 Release:

Benchmarking

Benchmarking allows you to specify benchmarks that can then be reported in Feedback and Cohort reports.  They are based on all previous responses for an assessment and are refreshed nightly. For each benchmark, an average response score, section scores, subsection scores, and segmentation scores are calculated and available for reporting. 

As well as "all responses" you can define benchmarks based on Classifiers (see the next feature).  If you, for example, had classifiers of job roles and geographies, you could show benchmark scores for responses from the same role and the same geography as the respondent.   Feedback and cohort charts can show any number of benchmarks alongside the response (or responses in a cohort report).    

Multiple assessments can be included one benchmark provided they are structured exactly the same, i.e. the sections and subsections are aligned.  This means that multilingual assessments or copies created for different brands can optionally be rolled into the same benchmarks. 

How to set up Benchmarks 

Classifiers

You can define any number of Classifiers, they have multiple uses

1. They are accessible from both the Response header and with the questions and answers in the response itself, which will then, in turn, pass through to all of the reporting.
2.  Benchmarks can be established for classifiers allowing for benchmark reporting at a detailed level.
3. Cohort Reports can be broken down by classifiers instead of the current Role.  This means that in one report you could have charts broken down on different criteria.

Once you have defined a classifier it can be input through the Response Add/Edit function, the CSV Upload or as parameters on your URL if you are initiating an assessment using an External ID.   

Read more on setting up Classifiers

Assessor Functionality

Assessor functionality was designed for these use cases.

1. In a training assessment, sometimes answers need to be text rather than multi-choice questions.  In this scenario, the assessor would usually score the answer and may add some comments.
2. In Risk, IT, Cybersecurity and similar assessments there may be text answers or complex scenarios that need a "human" assessor to comment on and/or score the respondent's answers before the report is produced. 
3. When using an assessment as a request for information, there may be a need for more detail in the answers. Using an open assessment, an assessor can ask the respondent for more detail.  The response can pass back and forward between the parties until the assessor is satisfied.
4. An assessor may not need to access the response, but just be sent a report when a response is completed.  That report can be the same  as the one sent to the respondent or different (see Multiple Feedback Reports below) 

Read More about setting up Assessors

Open Assessments

You can now specify that an Assessment is Open, allowing the respondent, or multiple respondents multiple accesses to the response. Interim reports can be produced if an when required.

Rich Text merged into Feedback and Cohort Reports

The previous restriction that only plain text could be merged into Feedback and Cohort reports has been removed.  Now they can all be rich text, meaning you can have formatting like bolding, underlining, bullet points, URLs, etc.  It is complementary to the formatting on the merge string.  This includes the ability to merge images.

All ratings text and answer text input boxes have been upgraded to have full HTML capabilities.

Applies to Rating Text, Subsection Rating Text, Segmentation Rating Text, and Answer Report Text

Multiple Feedback Reports on a Response

You can now have multiple feedback report templates attached to one assessment.  These may be in different formats and each report can be separately defined as to who it is visible to or sent to.  This feature is also used for Interim reports that can be generated as part of the assessor functionality.  Rather than uploading Report Templates through the Assessment Edit function there is now a separate Reports Menu item on the Assessment List.

Additional Chart Types and Graphics Improvements

Horizontal Bar Charts, Multi Horizontal Bar Charts, Polar Charts Multi Polar Charts, Bar in Bar and Area Charts have been introduced.  You can now specify both the height and the width of any chart.  If only the height is specified the graph will be proportionate - to ensure current graphs remain unchanged.  We encourage you to start using the width parameter and use the height when you want to allow extra or less space. For all Multi type charts, you can now override the Chart colors from the report (for single mark type charts you can override the chart colors from within the system as before).

All of the graphics types are listed in this overview 

Segmentation Groups

You can now group segmentation and report the groups separately.  As you can have an unlimited number of segmentations and groups - it means you can be accumulating any number of different measures and reporting them within one assessment.

Segmentation Groups are maintained as part of the Segmentations forms

Segmentation Text

Previously segmentations could only be reported numerically.  Now you can output text based on their rating for each segmentation. Combined with Segmentation Groups adds a huge new dimension to the feedback and cohort report building options.

Segmentation Rating Text is maintained in the Segmentations forms

Multiple (5) Texts are now available for all Rating Texts and Answer Report Text.

Previously we have 3 Text available for Answer Report Text Only.  We now allow Five texts to be entered everywhere where Rating Text and Answer Text can be entered.  Typical uses of this feature are:

• the ability to build executive summaries with a lot less detail
• the ability to build action lists, based on ratings and/or answers.
• the ability to separate out in the report areas that are working well from areas that there is an opportunity for improvement.
• to complement the ability to build multiple reports on one response or cohort, potentially targeted at different audiences.  

Applies to Rating Text, Subsection Rating Text, Segmentation Rating Text, and Answer Report Text

Advanced Ratings extended to Text. 

Previously additional rating types defined through advanced ratings form could only be reported numerically.  Now you can output text based on their rating for different rating types.  An example use of this would be when you want to rate different subsections or sections under different criteria.  Maybe a high number is positive in one context and negative in another.

Advanced Ratings are maintained in the Rating forms

Randomized Questions and Question Pools 

You can now have the system randomize the presentation of questions on the responses at a Section or Subsection level.  Question pools, where you specify the number of questions to be randomly selected from the questions loaded is available at the subsection level.

Randomized Questions and Question Pools are set up on Sections and Subsections