The 7 Software Development Wastes – Lean series Part 7 – Defects


When one looks at all the wastes, defects has to be the most obvious one. The cost and repercussions of finding defects varies depending on where in the cycle they’re found. Defects found early on in the development life-cycle are way less costly to resolve than defects found later on in the cycle; the most expensive being when applications are already in-production.

Additionally, depending on when the defects are found, defects can and do trigger other wastes like task switching, relearning etc.

Defects can be very costly for an organization. So the trick with defects is that you need to 1) Prevent them from happening in the first place and 2) Find and fix them as early in the development life-cycle as possible.

So what can you do to prevent them from happening in the first place?

  1. Keep your stories small, and unambiguous.
  2. Ensure that each story has well defined acceptance test criteria (assisted by input from the customer).
  3. Ensure that your code is well tested. Adopting good Test Driven Development habits will pay back in spades.
  4. Pair programming and code reviews are excellent ways in which to prevent bugs from being created in the first place.
  5. The more you automate the better. So automated functional testing is a good way to automate the functional test plan and get results fast and to ensure that new code changes aren’t breaking other parts of the code.
  6. Ensure staging environments mimic production as closely as possible.
  7. Make sure that as you find new defects, you add unit tests to your test suite to keep your unit testing current.
  8. Finally, document your code well.

An interesting quote from Mary and Tom Poppendieck’s book called Implementing Lean Software Development,

“If software routinely enters final verification with defects, then it is being produced by a defective process”

…. which needs to be fixed. So…

Step 1. Prevent the bugs from happening in the first place by “mistake proofing” your code
Step 2. Do whatever you can to find the bugs early on in the process while the code is fresh in the developers minds – i.e. ensure you have good functional test plans and test tools.
Step 3. Ensure a proper staging (or test environment) that mimics production environment as closely as possible
Step 4. Get the software into the hands of customers as quickly as possible, so good Agile practices help here.
Step 5. If you find defects, ensure they never happen again by keeping your unit tests current.

Photos from AgileEE 2009 in Kev, Ukraine

Few days ago I was honored to speak about Agile Planning on Agile Eastern Europe conference that happened in Kiev on 18th and 19th of September. I promised many people to share the conference photos, so here is a slideshow. I also added some pictures of the Kiev and its people to help you feel the atmosphere and showcase my great photo talent If you prefer looking at photos one by one, you can find them in this flickr collection.

I hope you’ll like the pictures.

The dirty secret of pair programming

Pair programming is one of the more controversial extreme programming practices. Having two people work on the same piece of code at the same time looks very unpractical and inefficient to someone not familiar with this practice. Pair programming proponents like me are usually quick to point out the benefits like improved quality, less rework, better communication and better knowledge sharing within teams but I think the biggest reason pair programming works is usually kept quiet.

People work harder when there is someone looking over their shoulder.

I’m going to be completely honest with you here. When I work alone I spend a considerable amount of time surfing the web, reading email, twittering (you can follow me at @mendelt) getting coffee and talking to coworkers. This means I’m spending less time working but it also means I’m constantly interrupting myself during the time I am doing work making me even less productive.

Now we don’t tell our managers this because it wouldn’t do anyone much good, the problem is a bit more complex than just people slacking off. What I’ve observed is most people have a hard time pacing themselves. We do really focused work for five minutes and then take a break. Unfortunately breaks have a habit of taking more time than they should and productivity goes out the window.

To solve this problem we need a way to maintain a sustainable pace. Pair programming is a way to do just this. Forcing yourself to explain what you do to your pair is a great way to maintain a sustainable pace and work a bit harder.

The Problem With Planning

Agile Software Development Made Easy!  The Problem With Planning.Hi, this is Kelly, from Agile Software Development Made Easy!

I think I’ve been pretty successful in my career. But if I was better at planning, I wouldn’t have achieved half the things I’ve achieved in my career! In fact, I wouldn’t even have started some of them…

In reality, there are some things you can plan, and some things you can’t. The trouble is, in most organisations we’ve come to expect a plan. And to meet it whatever happens. And that’s just not realistic.

Doing detailed planning pre-supposes you know where you want to go and aren’t going to be influenced too much by what happens in the meantime – or at least not without a substantial amount of re-planning. This, at least in my experience, has a tendency to give project managers tunnel vision at times.

Now don’t get me wrong – I’m not suggesting for one moment you embark on a project that doesn’t have a clear and robust vision. And I’m not suggesting for a moment you embark on a project where you have no idea how to achieve it and whether it’s a reasonable (although hopefully challenging) goal with the available resources. And forming that into an outline plan to provide some markers to aim for is certainly a good idea, but ideally it’s a high level roadmap rather than a detailed plan.

Coming from a traditional software development environment, I realise this sounds slightly mad. And I must admit it takes a certain amount of maturity and experience to recognise that you can’t really plan in detail up-front if you want to retain any flexibility, as the real requirements, risks, issues, priorities and opportunities all tend to emerge when you start to build and see the software in action.

Most organisations are not be ready to accept such a radical idea – the idea of acknowledging you don’t really know what you want – certainly not for sure – and you don’t really know what you’re going to get for your money, or when. So, as a minimum, a clear vision and outline plan are essential, but be careful to keep them to a high level.

Rather than a detailed plan, I prefer to see a strong vision, a strategy, goals, and a roadmap (high level outline plan). The tactics to achieve this, for example the precise features and all the tasks to deliver them, can vary along the way and are best not articulated up-front. This enables the team to discover the details when they are in a better position to do so, and allows them to change direction rapidly in response to changing circumstances.

This, when you think of it, is the very meaning of agile


Photo by tanakawho

The 7 Software Development Wastes – Lean series Part 6 – Delays


Interestingly, this weeks blog covers the 6th waste – Delays – as identified in Lean. How appropriate after the long delay since my last blog post on Task Switching. Herein lies an example of what Delays in software development can cause.  Delays introduce discontinuity and trigger additional wastes already covered like Relearning. It’s important in any process, including software, to have continuity. This reduces cycle time and minimizes other wastes like Relearning, Task Switching etc.

Focus on the end-to-end process, not individuals

It’s important to identify Delays early on and try to rectify them as soon as possible in order to maximize team productivity. It’s interesting… I have been reading many interesting threads on the Agile forums lately about measuring developer productivity, team productivity etc. Managers/executives have us focus our efforts and attention on individuals instead of looking at the end-to-end process to find the real issues that address productivity and enhance team effectiveness.

It’s actually unbelievable to me that organizations get trapped like this. Always thinking that Developers are the bottleneck. If we learn from what Lean teaches us, simple value stream mapping can uncover the real gems that can increase productivity.

Reducing delays between sprints

It’s important to ensure that the value stream is tuned for maximum efficiency where there are little to no delays at any point in the process. For example, yesterday someone posted a question on one of the forums asking if it’s possible to not have delays between sprints. Well of course it is possible but it takes hard work to get this right. You have to ensure that the backlog is properly groomed. So you need an effective PO who understands the market, the client etc. You need well written stories. You need estimates from developers early so the PO can make decisions ahead of the planning meeting. It’s all about designing delays out of the system so that there are smooth hand-offs at all the transition points. And it’s worth mapping this end-to-end process and identifying delays at each of these points.

Common Delays

So what are some of the more common delays you can look for and what can you do to avoid them?

1. Project approvals – waiting for projects to get approved is the most cardinal of all sins as this usually has handfuls of developers sitting around twiddling their thumbs and is a blatant disrespect for peoples time. Coupled with this is the fact that waiting causes dissatisfied and disgruntled employees and only serves to ruin the culture in an organization

2. Waiting for a proper prioritized list of requirements – so that work can get started.

3. Waiting for resources to become available – generally impacts projects significantly. This one is not necessarily an easy one to solve as there are generally budgetary concerns. But this then begs the question – is the company taking on too much? You can’t be successful if you’re not focused and properly staffed.

4. Change approval processes – well you don’t want to hear my opinion on this. Suffice to say, these processes need to be eliminated entirely. And all Agile processes inherently solve these problems. Shortening Sprints helps big time.

5. Increases in work-in-progress – The more work-in-process, the more developers have to wait before they can deploy their code to production.

6. Delays getting client to sign-off on acceptance tests – We have a services business and we find that this is a huge problem for our organization. Not getting sign-off is just a liability for the company as you’re not getting paid until you get sign-off

Take the time to assess where delays are occurring and I can guarantee you that the effort spent doing this is hugely beneficial to your productivity, efficiency and overall bottom line.

If you’re not moving you’re not agile

Lately I’ve seen a couple of doom scenario’s scetched out for agile. It seems agile is dead or at least dying at the hand of the PMI. I don’t want to bash the authors of these articles. I respect them and agree with most of their arguments but not with their conclusions. Agile is changing, sure, but it’s not dying, we’re all about embracing change right?

At it’s core agile isn’t a process or a methodology, it’s a set of principles with a framework of practices to support them. One of the most important principles is about change, not just in our requirements but in our process, our organization and even in change itself. Agile is about improving your process, trying out new things checking them against our principles and core values and keeping what works.

Agile has never stopped evolving. We’ve been incorporating ideas from other fields into our set of practices like kanban and self organizing teams. And we’ve been trying out new ideas, we’re going from TDD to BDD, we’re branching out into agile software architecture with SOLID principles and emergent design. One thing that’s important to notice is that many of the new ideas in agile aren’t actually very new and come from other area’s.

With that in mind it’s not really strange to see agile practices being taken up in other environments too. Not every organization is willing or able to support the constant evolution required for real agile implementations so they do the next best thing and pick up our established ideas and practices. We’ve been supporting this ourselves for some time by supplying pre-packaged sets of practices in the form of Scrum, DSDM or Xp frameworks. And forces outside the agile community have been doing this too. Agile Rup has been around for some time and now the PMI is also picking up agile ideas.

It’s easy to bash these agile hybrids as not being true to ‘our’ principles and somehow inferior and dangerous to ‘our’ movement. But I think the real danger comes from somewhere else.

The real danger is stagnation. If we start rejecting ideas because of where they come from we start slowing down. Don’t bash the PMI because they use our practices out of context but learn from them just like they are learning from us. Take what we can use and grow. Don’t let agile become the bearded conservative old fart that we set out to replace.