Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • All Test cases should be linked with a Story (to get In Sprint Automation Percentage value).

  • if custom fields are used to identify regression and in-sprint test cases, check the custom fields related to it on the setting screen of PSKnowHOW. 

  • Regression KPI can either be set up by Label or Customfield and is not dependent on Sprint.

  • Only those Test Cases which are to be automated will be considered for calculation and check the corresponding setting.

  • Test Execution Percentage and Capacity to be updated manually from the settings > upload.

...

Azure Boards Limitations

Expand

Area

Behavior

Guideline

Sprint Status

Last available sprint of the project will show as CURRENT as long as subsequent sprints are not defined, even when the sprint’s end date is out of sync with the calendar date

Projects using Azure Boards must create future sprints in advance to avoid data discrepancies

KnowHOW will generate sprint snapshots based on the Sprint Status only, i.e., a sprint will be considered as Active as long as the status is CURRENT in Azure Board, irrespective of the end date of the sprint

Area Path

If workitems are tagged across different area paths and the area paths are not included in the WIQL, KnowHOW will not fetch those as they don’t satisfy the criteria

At KnowHOW, project boards should be configured in such a way that it requires minimal updates

Scope Changes

Daily snapshots are formed at KnowHOW during an active sprint.
The final snapshot is frozen on closure of the sprint.

KnowHOW compares the latest snapshot with the previous day’s snapshot to determine the following scope changes

  1. Workitems added

  2. Workitems removed

Snapshot captured on Day 1 of the sprint is considered the Initial Scope of the sprint

The sprint snapshots will not get update based on changes that happen after the sprint is completed

Scope Completion

 

KnowHOW compares the latest snapshot with the previous day’s snapshot to determine the following

  1. completed workitems

  2. not completed workitems

 

Spilled issues

 

Not supported

KPI Level Practise Guide -

...