website logo
⌘
K
Introduction to Qualetics
Getting Started with Qualetics
Creating your account
Connecting your data
Data Streaming
Data Objects
Example Data Events & Objects
Automatic Data Capture
Custom Event Data
Error Monitoring
SDK For Data Streaming
JavaScript
Angular
React
React-Native
Rest API
Android
Qualetics for WordPress
Analytics
Activity Analytics
User Analytics
Exception Analytics
Features Overview
API Key Management
Features for Insights
Dashboards
Quick Look
User Management
User Groups
Dynamic Home Pages
Docs powered by
Archbee
Analytics
Exception Analytics

Quality Index

11min

Summary

The Quality Index is a single metric calculated from a set of analytics that assesses the overall quality of a software application based on data from user experiences. It provides a wholistic measure of overall software quality based on user activity and is presented on a 10-point scale. The Quality Index is a combination of five different metrics: Severity of Issues, Total Users Impacted, Frequency of the Issue Occurrence, Total Context Impacted, and Total Number of Issues. This analysis provides real-time alerts to improve software quality proactively and offers an opportunity for incremental revenue generation by unearthing insights on user behavior to come up with new solutions or product experiences. The Quality Index is available to embed into web pages or blog posts and may be downloaded as a PDF document or Excel sheet. It has standard filters such as Action, Actor, Context, Start Date, and End Date, and optional filters available.

— AI Generated

At the heart of software quality analytics is the Quality Index which derives a single metric calculated from a set of analytics that assesses the overall quality of a software application based on data from user experiences.



Quality Index
Quality Index



What does it show?

Thumbnail View

A wholistic measure of overall software quality based on user activity from all accounts and users over a specified period of time based on a 10 point scale that ranges from -5 to +5.



The thumb indicator on the top left of the graphic indicates whether Quality Index score has improved, declined, or stayed the same. The number on the upper right shows the percentage change and graphicall whether it's improved, declined, or stayed the same from the same period of time immediately preceding the time range selected. 



Further, the color coding indicates the quality level of the software being analyzed, red indicating a poor score of -5 to -1.66, yellow indicating an average score of -1.66 to +1.66, and green indicating a strong score of +1.66 to 5.

This metric is an overall measure derived from a combination of 5 different metrics -

  • Severity of Issues
  • Total Users Impacted
  • Frequency of the Issue Occurrence
  • Total Context Impacted
  • Total Number of Issues

Detail View



Quality Index parameters
Quality Index parameters


This visualization gives a wholistic description of the overall software quality for the entire ecosystem of accounts and users through an overall score out of 10 for each of the parameters contributing to the index rating.



In an ideal scenario, each of the parameters should score as close to 0 (zero) to ensure that the Quality Index metric score is as close to +5 in such a scenario.

Parameter Descriptions

Error Types -

  • This provides a single measure indicating the overall severity of the range of issues experienced in the software.
  • The range includes all issues classified as minor, major, or critical spanning error/defects, latency, and friction points.
  • Given that the metrics range from -5 to +5, lower values (below 0) indicate high severity levels of issues detected, higher values (0 or above) indicate lower severity levels of issues detected, which in turn indicates a better software quality.



Users Impacted -

  • This displays a measure of the total number of users impacted by the issues indicative of low software quality due to bugs, errors/defects, latency issues and/or friction points.
  • Given that the metrics range from -5 to +5, lower values (below 0) indicate high number of users impacted while higher score values (0 or above) indicate lower number of users impacted , which in turn indicates a better software quality.



Error Frequency -

  • This indicates the Frequency of the Issue Occurrence or how often issues (errors/defects, latency issues and friction points) are occurring thereby lowering a superior user experience.
  • Given that the metrics range from -5 to +5, lower values (below 0) indicate high frequency of issues while higher score values (0 or above) indicate lower frequency of issues, which in turn indicates a better software quality.



Context Impacted -

Context is a Qualetics user-defined label meant to define a functional part of your software experience. For instance, in a retain application "Checkout" could be a label that describes every action taken in your software experience related to the steps associated with purchasing everything in your car.



  • Total Context Impacted then is a measure indicating how many discrete parts of your user experience are impacted by issues.
  • Given that the metrics range from -5 to +5, lower values (below 0) indicate more features of your application are impacted while higher score values (0 or above) indicate lesser features of your application are impacted, which in turn indicates a better software quality.
  • The lower the value the worse as it indicates greater parts of your user experience being impacted by issues. The higher the value the better as it indicates less of your user experience is impacted by issues.



Number of Issues -

  • This is a measure of the total number of Issues (errors/defects, latency issues and friction points) detected.
  • Given that the metrics range from -5 to +5, lower values (below 0) indicate high number of issues while higher score values (0 or above) indicate lower number of issues, which in turn indicates a better software quality.

Parameters with Pop Up Displays



Error Severity with pop up display
Error Severity with pop up display

  • This gives a description of the Severity of Issues parameter because of bugs/defects/latency issues/friction points due to low software quality with pop up display of the various categories of issues.
  • The lower the number of errors, either critical errors or major errors or the minor errors, the better will be the quality index metric thereby higher will be the software quality.
Users Impacted with pop up display
Users Impacted with pop up display

  • This gives a description of the Total Users Impacted parameter with pop up display because of bugs/defects/latency issues/friction points due to lower software quality.
  • The lower the number of users impacted the better as the better will be the quality index metric which means higher the software quality.



Frequency of the Issue Occurence with pop up
Frequency of the Issue Occurence with pop up

  • This gives a description of the Frequency of the Issue Occurrence parameter with a pop up display of the issues per hour because of bugs/defects/latency issues/friction points due to low software quality.
  • The lower the number of issues occuring per hour, the better will be the quality index metric which means the higher the software quality.
Context Impacted with pop up
Context Impacted with pop up

  • This gives a description of the Total context Impacted parameter with a pop up display because of bugs/defects/latency issues/friction points which affect more features/functionalities of the app/solution due to low software quality.
  • The lower the context impacted value the better as this means that less number of features are dysfunctional and leads to a higher value on the quality index metric which means higher the quality of software.
Number of Issues with pop up
Number of Issues with pop up

  • This gives a description of the Total number of Issues parameter with a Pop up display because of bugs/defects/latency issues/friction points due to low software quality.
  • The lower the total number of issues the better as this will lead to a higher value of the quality index metric, which means higher is the software quality.



Visualized View

Quality Index Visualized view with additional filters of context, action, actor, and date filter
Quality Index Visualized view with additional filters of context, action, actor, and date filter

  • This gives us a description of the scores of all the parameters which combine to make up the overall quality index score.
  • This is a visualized view.
  • There are additional filters available here such as Context (app features), Action (what was the user doing when a bug/defect was encountered), Actor (who is/was the user), and a date range during which the software quality analysis was performed.
  • Not only this, you may go ahead do a lot with this visualization.
  • You have the option to embed this visualization into a webpage or a blog post or share it with any of your users.
  • You may also subscribe to a condition where you get alerts when a certain condition is met or not met.
  • In addition, you may download this view as a PDF document or an Excel sheet or simply save this as a favorite view based on a specific search input, or date per se.
  • Also, using the API link, you may integrate this chart into your app based on the permissions available.

Analyze View

  • This gives us a description of the scores of all the parameters which combine to make up the overall quality index score.
  • This is an analyzed/tabular view.
  • There are additional filters available here such as Context (app features), Action (what was the user doing when a bug/defect was encountered), Actor (who is/was the user), and a date range during which the software quality analysis was performed.
  • Not only this, you may go ahead do a lot with this visualization.
    • You have the option to embed this visualization into a webpage or a blog post or share it with any of your users.
    • You may also subscribe to a condition where you get alerts when a certain condition is met or not met.
    • In addition, you may download this view as a PDF document or an Excel sheet or simply save this as a favorite view based on a specific search input, or date per se.
    • Also, using the API link, you may integrate this chart into your app based on the permissions available.
Quality Index Analyzed view with additional filters of context, action, actor, and date
Quality Index Analyzed view with additional filters of context, action, actor, and date


How can this insight be used?

  • All of the above mentioned insights serve as real-time alerts for you to improve your software quality proactively so you can offer a superior user experience to your app/product/solution users.
  • This will ensure that users stick to the platform which, in turn, will open up not only incremental Revenue generation opportunities along with resultant profitability but also unearth insights on user behavior to come up with new solutions or product experiences.

Available Filters

  • Attributes Filter
  • Conditions Filter
  • Option to Add Attributes and Conditions to filter

Standard Filters

  • Action
  • Actor
  • Context
  • Start Date
  • End Date

Available Features

  • Embed Insights
  • Comments
  • Subscriptions
  • Export Options
  • API Integration
  • Dashboards
  • Features Overview
  • Favorites









Updated 24 Jul 2023
Did this page help you?
PREVIOUS
Software Quality Overview
NEXT
Users Summary
Docs powered by
Archbee
TABLE OF CONTENTS
What does it show?
Thumbnail View
Detail View
Parameter Descriptions
Parameters with Pop Up Displays
Visualized View
Analyze View
How can this insight be used?
Available Filters
Standard Filters
Available Features
Docs powered by
Archbee
Copyright @ 2022 All Rights Reserved | Qualetics Data Machines Inc.