DevOps Value Stream Management is a rapidly growing field in Agile software delivery, as it recognises that the trick to delivering valuable software, is to treat value delivery as an end-to-end process that requires mapping and optimising for the best outcomes.
Indeed, Gartner only started covering Value Stream Management as a discipline in September 2020 with the publishing of its first Market Guide in the space: https://www.gartner.com/en/documents/3991130/market-guide-for-devops-value-stream-management-platform
As the name suggests, effective Value Stream Management requires identifying (mapping) and managing individual software delivery value streams. Metrics are central to effective management, to track and drive the desired value delivery.
But in keeping with Agile principles, it is vital that the Value Stream metrics chosen engage both teams and managers. Measurement in Agile delivery has always been a contentious area and as such should not be a top down exercise (imposed on teams) – rather it should be a bottom-up exercise driven by the teams themselves.
So what are the Top 5 Value Stream metrics that engage both teams and managers alike?
Criteria for choosing our Top 5 Value Stream metrics
We have chosen the following criteria to select our Top 5 Value Stream metrics:
- Firstly and most importantly, the Value Stream metrics chosen track the core underlying objective of Agile software delivery (and Value Stream Management) – “the early and continuous delivery of valuable software” (Agile Manifesto Principle Number 1), https://agilemanifesto.org/iso/en/principles.html.
- second, the Value Stream metrics selected are valuable to teams and managers alike so that Value Stream Management is an adopted principle by all – rather than a management concept separated from the day-to-day reality of software delivery within the teams themselves
- the metrics are meaningful when considered at team level and when aggregated across teams
- and finally, the Value Stream metrics are simple to understand and if tracked, very quickly drive significant improvement in Agile software delivery effectiveness.
Our Top 5 Value Stream metrics
In no particular order, here are our Top 5 Value Stream metrics that make an immediate impact on your Value Stream Management (i.e. effective Agile delivery of valuable software). As would be expected, they closely match commonly used Agile metrics.
Time to Value (Lead Time)
Lead Time is a core Value Stream metric as it is a basic measure of your organisation’s Agility and ability to deliver value at pace. It measures your velocity, or the time taken to develop an increment of software (value).
Lead Time refers to the overall time to deliver an increment of software from initial idea through to deployment to live – i.e. the complete end-to-end software delivery life cycle (SDLC). Whilst Cycle Time is a subset of the overall delivery time, typically measured as the time from the start of work (development) until deployment to live (traditional Cycle Time) or from code commit to production (sometimes referred to as Code Cycle Time).
A Lead Time can be calculated for any increment of work – e.g. story, task, bug.
The example below shows Lead Time for stories and so relates to the time taken to deliver new features (value). As the chart shows the total Lead Time is 11 days which is actually very good and represents the time taken for a ticket (story) to leave the backlog until deployment to live.
Example software delivery Lead Time summary chart – Plandek Value Stream metrics dashboard
Example Lead Time status review chart – Plandek Value Stream metrics dashboard
As shown in the expanded view of Lead Time in the Lead Time Status Review chart above, analysis of Lead Time should become an integral part of effective Value Stream Management.
The chart shows the active and inactive status groups and the time stories spend in each status across the total 11.3 day Lead Time.
In the example above, the inactive statuses such as ‘Ready for Development’ account for a relatively large proportion of the overall Lead Time (5.6 days), hence there is friction in the process and there is scope to reduce the overall Lead Time and thereby increase software delivery velocity (and speed of value delivery).
Deployment Frequency is another fundamental measure of an organisation’s value delivery (when viewed alongside the other critical Value Stream metrics described here).
A core objective of Value Stream Management is the ability to develop and deploy live small software increments rapidly. Deployment Frequency is a Value Stream metric that tracks that base competence and is a powerful Value Stream metric around which to focus effort at all levels in the delivery organisation.
Example Deployment Frequency metric view
Delivered Story Points or Delivered Value Points
Delivered Story Points is often considered a problematic Value Stream metric due to the potential inconsistencies in the calculation of story points and how much effort they represent. However, as a basic measure of output and how that is changing over time, it is a powerful Value Stream metric around which to align.
Indeed, some organisations may have gone further and work in Value Points rather than story points – with each Value Point aligned with the perceived value of the story under development. In this instance the Value Stream metric becomes Delivered Value Points.
There may be concerns of teams ‘gaming’ the metric with story point/value point inflation, but as with all Value Stream metrics, they should be viewed in context by experienced folks who know the teams well. And if this is the case, they can still give an excellent view of how the delivery organisation is progressing over time.
Example Delivered Story Points metric view
Escaped Defects is a simple but effective Value Stream metric of overall software delivery quality (which is inversely correlated with the delivery of value).
It can be tracked in a number of ways, but most involve tracking defects by criticality/priority as per the example below.
Example Escaped Defects metric view
When these four simple Value Stream delivery metrics are viewed together, the Agile DevOps practitioner can get a good balanced view of how their Value Stream Management is progressing.
Importantly, the Value Stream metrics can be tracked over time, making sure that an improvement in one metric (e.g. Lead Time) does not lead to a detrimental effect on another metric (e.g. Escaped Defects).
In addition, the relationship between Lead Time and Deployment Frequency can be closely watched. Very often teams are able to reduce their Lead Time, but this does not translate into quicker value delivery, due to bottlenecks in the integration and deployment process.
Our final Value Stream metric in our Top 5 is Flow Efficiency. Flow Efficiency looks at the proportion of time tickets spend in an ‘active’ versus ‘inactive’ status and is a great Value Stream metric for teams.
The Flow Efficiency analysis (see Figure 7 below), enables Team Leads to isolate and analyse each ‘inactive’ status in the workflow and consider if there is scope to reduce or eliminate it.
The analysis shows the relative size of each ‘inactive’ status opportunity in terms of time spent in the inactive state and volume of tickets affected.
Figure 7 – Example Flow Efficiency metric
Typical opportunities to remove inactive bottlenecks include time spent with tickets awaiting definition (e.g. Sizing) and tickets awaiting QA. Where waits for QA are considered excessive, Delivery Managers can reconsider QA resource allocation by team.
About the author
Charlie Ponsonby is co-founder and Co-CEO of Plandek (www.plandek.com) based in London.
Plandek was recently recognised as a top nine global vendor by Gartner in the fast-growing ‘DevOps Value Stream Management Platforms’ space and is used by enterprise clients globally to improve the effectiveness of their software delivery capability.
Plandek provides a cloud-based analytics platform to help software delivery teams deliver quality software, faster and more predictably. It works by mining data from delivery teams’ toolsets (such as issue tracking, code repos and CI/CD tools), to provide actionable and intelligent insight (including Value Stream metrics) across the end-to-end software delivery process.