The Usage Report visualizes the scenario creation status and test execution results in your workspace. You can check test pass rates, execution counts, and scenario statistics within a specified duration using graphs and numerical values, which helps in analyzing test automation trends and discovering areas for improvement.
How to use
Viewing report and setting duration
Click Usage Report in the sidebar on the left side of the Autify Nexus screen.
From the Duration drop-down list at the top right of the screen, select the period you want to aggregate.
You can select from 7 days, 14 days, 30 days, 60 days, or 90 days.
If you select Custom, you can specify any start and end date from the calendar (up to 180 days).
Key metrics available
At the top of the screen, you can check the following metrics indicating the health and scale of the workspace.
Metrics related to scenario creation
Scenarios created: The total number of scenarios newly created within the period.
Average steps per scenario: The average length (number of steps) of created scenarios.
Scenarios over 200 steps: The number of relatively large scenarios that require special attention for maintenance.
Scenarios containing shared groups: The number of scenarios using "Shared Step Groups".
Metrics related to test execution
Overall pass rate: The percentage of successful tests among those completed within the period.
Total executions: The total number of completed test executions.
Successful executions: The number of times the result was "PASSED".
Failed executions: The number of times the result was "FAILED".
Detailed analysis with charts and statistics tables
At the bottom of the screen, you can perform detailed analysis using graphs and statistics tables.
Overall pass rate chart: You can check the trend of the success rate by week using a line graph.
Test results by status chart: You can check the breakdown of results such as success, failure, and internal error using a bar graph.
Scenario statistics: A list of execution counts and success rates for each scenario. The success rate is color-coded (green for over 70%, yellow for 35-70%, and red for under 35%), allowing you to intuitively grasp the status.
Updating and exporting data
Updating data: If you want to retrieve the latest data, click the refresh icon () at the top right of the screen. The time of data retrieval is displayed as "Last refreshed".
Saving report: If you want to save or share the report, click Export at the top right of the screen. The current display content will be downloaded in PDF format.
Notes
Data reflection: Data on the report is not updated in real-time. To check the latest status, make sure to click the refresh icon.
Tests in progress: Tests currently running (RUNNING) or waiting (QUEUED) are not included in the aggregation. Only completed tests are reflected.
Deleted data handling: Deleted scenarios and test results are excluded from the report.