Get a 14-day free trial on Haystack

First Principles of Engineering Metrics

What metrics should software engineering teams track?

All departments from Sales, Marketing to Product reports metrics to the CEO, except for Engineering Department!

I have worked with +1000 engineering teams helping them create a mature software engineering department.

In this blog, I’ll go over the first principle of metrics and which metrics you should be using.

How other departments select their metrics?

What is the purpose of this department existing?

The answer to this question becomes clear by inverting the problem.

What work does a department needs to stop doing for them to get fired?

Let’s answer this for other departments.

Sales Department

What work does sales department needs to stop doing for them to get fired?

Answer: If a sales team stops selling, they’ll get fired.

There is absolutely no sales team that will not get fired if they stop selling. We got our answer.

Now we need to invert it back to get the metric we should be tracking.

What should I track for a sales team?

Answer: Amount they sold (Revenue)

So far so good. Let’s do another example with Marketing department.

Marketing Department

What work does marketing department needs to stop doing for them to get fired?

Answer: Stop bring leads

This is a correct answer, but it’s missing. What if marketing department is bringing very bad leads? They’ll still get fired. So we need to add one more layer. They need to bring leads, but also ensure these leads can be turned into customers. If we add this to our answer we get

Improved Answer: Stop bringing qualified leads

Now let’s invert it again

What should I track for a marketing team?

Answer: Marketing qualified leads (MQL)

[callout-component type='info']
Each department track dozens of metrics from Win Rate to Response Time. These metrics are called Leading Metrics.

- Leading metrics tell a small part of the whole story.
- Leading metrics are helpful to understand how we can optimize our operations further.
- Every department should track leading metrics, with the purpose of improving the main metrics.
[/callout-component]

What should engineering departments track?

Let’s ask the same questions.

What work does engineering department needs to stop doing for them to get fired?

Answer 1: Stop delivering code

Answer 2: Deliver code that doesn’t work

Answer 3: (optional) Deliver code too late

So if we reverse these we’ll answer the purpose of the engineering department.

Breaking this down further

Speed: Deliver

Quality: Deliver working code

Predictability: Deliver working code on-time

Engineering team are hired for these 3 responsibilities.

[callout-component type='info']

An engineering team succeeds if they deliver working code on time.

[/callout-component]

Now we know what an engineering team should track

  • Speed
  • Quality
  • Predictability

Executives - now you know what to look for your teams.

Team members - now you know what the business hired you for and how to show case your hard work.

To learn more on tactical advices about "what metrics should an engineering team track?" feel free to email me kan@usehaystack.io

[callout-component type='info']

Note:

- Some engineering teams do not have a requirement for on-time.
- Tracking predictability is more useful for organizations with deadlines. (ex: sales led organizations where not delivering equates to lost deals)
- For all other types of organizations, predictability is a leading metric rather than the main metric.

[/callout-component]

Kan Yilmaz - CTO of Haystack

  • I have worked with +300 organizations and +1000 engineering teams from leadership coaching to tactical advices for the teams.
  • If you are looking for an advisor - email me at kan@usehaystack.io

You might also like

Want to drive better software delivery?