Working with reports
You can use SpeechSense reports to analyze dialogs between agents and customers and evaluate agents' performance. Build a report:
- Evaluation form: To analyze several evaluation parameters.
- Comparison: To compare multiple evaluation parameters over time.
- Details: To analyze changes in a single evaluation parameter over time.
If you want to use a reason, topic, or dialog outcome as a filter or evaluation parameter, use a neuroparameter in your report.
Building the Evaluation formreport
-
Open the SpeechSense home page
. -
Go to the space you need and select a project.
-
Go to the Reports tab.
-
Click Create report → Evaluation form.
-
In the window that opens, click
Add parameter. -
Set up the evaluation parameter:
-
In the Evaluation parameters field, select the appropriate parameter and specify a value or a range of values for it.
Evaluation parameters are used as criteria for assessment of agent performance. For more information about the parameters and how to generate a report based on them, see Evaluation parameters.
If you want to select a reason, topic, or dialog outcome as an evaluation parameter, use a neuroparameter.
-
In the Weight field, enter a percentage value.
Weight indicates how critical a parameter is for agent performance evaluation. The higher the parameter's weight, the greater its value in the report. The total weight of all evaluation parameters must equal 100%. For more information about weight and its use, see Evaluation parameter weight.
-
(Optional) In the Parameter name in report field, specify the name that will be used to caption the parameter on the chart and in the table. By default, this name matches the Evaluation parameters field value.
-
-
If you need to add more evaluation parameters, click
Add parameter. -
Specify how to group the report data. For example, you can group by product, agent, or customer. Different grouping settings produce different data cross-sections.
-
Select the report generation period.
-
(Optional) Use the
button next to the Period field to select the filters to screen dialogs for the report. For more information about filters, see Filtering in the report.If you want to pick dialogs by their content, use a neuroparameter as a filter.
-
Click Create report.
-
To reuse the report, click Save report. Specify its name and, optionally, a description.
The report will be available in the selected project in the Reports tab.
Switching between Evaluation formreports and dialogs
A report enables you to directly switch to the list of dialogs that meet the criteria specified in the report. This way, you can get more details about dialogs and analyze their specifics.
To switch from a report to a dialog list:
- Build an Evaluation form report.
- In the report chart, click the rectangle of the evaluation parameter you need. This will open a list of dialogs according to the active filters and the parameter you selected.
- Go to the dialog of your choice. Its page will show detailed info about the dialog, e.g, the agent's performance data in the form of dialog summary, agent and customer tags, transcript of the audio recognized using SpeechSense.
Building a Comparisonreport
-
Open the SpeechSense home page
. -
Go to the space you need and select a project.
-
Go to the Reports tab.
-
Click Create report → Comparison.
-
In the window that opens, click
Add parameter, and select the one you need.For more information about the parameters and how to generate a report based on them, see Evaluation parameters.
-
Specify what data you want to get: total of evaluation parameter values, average, minimum, or maximum value of the evaluation parameter.
In the Comparison report, you can only select numerical evaluation parameters. If you select a tag as a parameter, the total, average, minimum, or maximum number of times the tag was assigned to dialogs will be counted for the specified period.
-
To add more evaluation parameters, click
Add parameter. -
Specify how to group the report data. For example, you can group it by agent, customer, or dialog subject. The list of available grouping options depends on the connection metadata. You can get different data slices based on the way you group data. The grouping you select only affects how the data is displayed in the table.
-
Select the report generation period.
-
(Optional) Use the
button next to the Period field to select the filters to screen dialogs for the report. For more information about filters, see Filtering in the report.If you want to pick dialogs by their content, use a neuroparameter as a filter.
-
Click Create report.
-
To reuse the report, click Save report. Specify its name and, optionally, a description.
The report will be available in the selected project in the Reports tab.
Building the Detailsreport
-
Open the SpeechSense home page
. -
Go to the space you need and select a project.
-
Go to the Reports tab.
-
Click Create report → Details.
-
In the window that opens, click
Add parameter. -
Select the evaluation parameter whose changes you want to view.
For more information about the parameter and how to generate a report based on it, see Evaluation parameter.
-
Specify what data you want to get: total of evaluation parameter values, average, minimum, or maximum value of the evaluation parameter.
In the Details report, you can only select numerical evaluation parameters. If you select a tag as a parameter, the total, average, minimum, or maximum number of times the tag was assigned to dialogs will be counted for the specified period.
-
Specify how to group the report data. For example, you can group it by agent, customer, or dialog subject. The list of available grouping options depends on the connection metadata. You can get different data slices based on the way you group data.
-
Select the report generation period.
-
(Optional) Use the
button next to the Period field to select the filters to screen dialogs for the report. For more information about filters, see Filtering in the report.If you want to pick dialogs by their content, use a neuroparameter as a filter.
-
Click Create report.
-
To reuse the report, click Save report. Specify its name and, optionally, a description.
The report will be available in the selected project in the Reports tab.
Applying a neuroparameter in a report
A neuroparameter is a dialog property. SpeechSense uses it for semantic analysis to determine whether a dialog matches this property. Let's assume you specified a particular topic as a neuroparameter. SpeechSense will check whether that topic was mentioned in the dialog.
Note
This feature is in the Preview stage.
To apply a neuroparameter to dialogs in your reports:
-
Open a list of evaluation parameters or filters. In the list, select Neuroparameter.
-
In the Neuroparameter setting window that opens, specify the period to pick the dialogs from. Add filters as needed.
As the result, you will see the number of dialogs in the selection for the report. To apply a neuroparameter, you need at least 100 dialogs. There are no restrictions on the maximum number; however, if the selection contains more than 1,000 dialogs, not all of them will be analyzed. SpeechSense will randomly select only 1,000 dialogues for analysis.
If there is not enough or too much data in the selection, adjust the period and your filters. This will change the number of dialogs in the selection.
-
Under Criteria, select the criteria for the service to analyze: Reasons, Topics, or Outcomes.
-
Put the cursor to the row of the selected criterion and wait for options to appear.
SpeechSense will semantically analyze all dialogs in the selection for the report. The service automatically highlights the reasons, topics, or outcomes of all dialogs (depending on which criterion you selected).
-
Select one of the suggested criterion values.
If none of them are suitable, enter your own. In this case, the specified property will not depend on the choice between reasons, topics, or outcomes.
-
Click Find.
After that, SpeechSense will analyze dialogs again and find out which ones meet the specified criterion. The service will put the results of the analysis in two columns: one with dialogs that match the specified neuroparameter and the other one with those that do not. Only one of the two mentioned groups can be added to the report.
-
If the suggested dialog grouping is not satisfactory, change the neuroparameter. The dialogs will then be regrouped.
You may need to change the criterion more than once.
-
Once you are satisfied with the dialog grouping, specify which group is to be used.
For example, if your criterion is Topics, click one of the two buttons:
- Containing topic to use only dialogs on the specified topic.
- Not containing topic to use dialogs on any topic other than the specified one.
With that done, you can add more filters and parameters and build your report.