Evaluation¶
This evaluation phase streamlines the Quality AI evaluation process to drive better customer experience where the QA manager sets up the evaluation criteria for users or agents. Each QA and contact center has different operation procedures based on logical or functional groupings.
For better handling of the evaluation criteria, this evaluation stage is divided into the following two sections:
- Evaluation Forms
- Evaluation Metrics
Evaluation Forms¶
The Evaluation Forms are designed to check adherence to individual questions. They are a collection of metrics that let you score, audit, and interact (for Conversation Intelligence and Auto QA Scoring). Once these forms are created, you can assign them to the QM auditors as assessments for review compliance.
The Evaluation Form includes chosen metrics with customizable weights totaling 100%. The Evaluation Forms are configured and assigned to respective Channels and Queues for audit. Each queue in the Chat and Voice channels can host only one evaluation form.
You can access the Evaluation Forms by navigating to Contact Center AI > Quality Management > Configure > Evaluation Forms.
Note
To create and configure evaluation forms, the Auto QA setting must be enabled first.
The Evaluation Forms has the following options:
- Name: Shows the name of the Evaluation Form.
- Description: Shows a short description of the form.
- Queues: Shows the forms assigned and not assigned in the queue.
- Channel: Shows the assigned form channel mode: Voice or Chat interaction. Only one form is allowed for the audit.
- Created By: Shows the form creator's name.
- Pass Score: Shows the set pass score percentage for the specified assigned forms and the Channel selected.
- Status: Allows you to enable or disable the scoring for the individual Evaluation Form.
- Search: Provides a quick search option to view and update the Evaluation Forms by name only.
Add New Evaluation Form¶
You can access the Evaluation Metrics by navigating to Contact Center AI > Quality Management > Configure > Evaluation Forms > New Evaluation Forms.
Steps to create a new Evaluation Form:
- Click the +New Evaluation Form button in the upper-right corner to configure the most commonly used evaluation form. The following screen appears, allowing you to add a new evaluation form.
Note
It is mandatory for the agents to attain the minimum pass score set by the Supervisor. If the pass score is not met for a given interaction, it will be evaluated as Fail.
The following table describes the Evaluation Forms details:
Add New Evaluation Form | Description |
Settings: This section allows you to configure the settings for the New Evaluation Form. | |
Name | Enter the name for the new evaluation form. |
Description | Enter a short description for the form, which is optional. |
Select Channel | Select a Channel mode (Voice or Chat). |
Define Pass Score | Set the minimum pass score percentage for the agent. |
Evaluation Metrics: This section allows you to add the evaluation metrics that are already configured and can be assigned to Evaluation Forms for the queue. | |
Add Evaluation Metrics | It allows you to search and add evaluation metrics and weightage against them based on the metrics.
For example, if there is more than one Evaluation Metric, the total percentage must be set to 100% for all the evaluation metrics based on their weightage.
Note: If the channel selected is Chat, only metrics relevant to the Chat channel will be displayed. Metrics related to Speech and Playbook metrics with playbook channels set as Voice will not be shown. |
Assignments: This section allows you to add the assignment queues for the respective Evaluation Forms. | |
Queues | Allows you to search and add required assignment queues for the Evaluation Forms that you can access.
Note: Each Queue can only have one Evaluation Form per channel. |
- Click Create to Add New Evaluation Form to the queue for review.
-
In case, if you are changing the existing channel mode from Voice to Chat or vice-versa which is already added, then the following dialog box appears.
Note
Upon changing any of the existing Channel modes like Voice to Chat or vice versa, will delete the earlier existing speech-based metrics in the Evaluation Form, which has to be updated again across the remaining metrics along with weights.
-
Click Confirm to update the Channel.
Edit Evaluation Form¶
Steps to edit the existing Evaluation Forms:
-
Right-click to select any of the existing Evaluation Form (Name). The following screen appears to edit the required fields.
-
Click Edit to update the Evaluation Form dialog box fields. The following dialog box appears to update the required fields.
-
Edit the required fields that you want to update.
- Click Update to save the changes.