It’s Alive!

My new Agile scope management tool is now live!

It’s called Tactyle, in reference to its emphasis on touching and interacting with the content of your project.  Other key design principles include:

  • simple, effective, and fully-automated Earned Value – in keeping with my blog posts in recent years
  • suitable for fixed price and/or fixed scope – again, in keeping with this blog
  • based in the Story Mapping paradigm (it’s not a database, it’s not a kanban board; it’s just totally a Story Map)
  • designed to have the direct “tangible-ness” of index cards (more so than any other tool I’ve seen – IMHO) while also being authentically digital
  • low-friction (i.e. quick and easy to use)
  • deliberate simplicity (to the point that there are only two screens in the whole product)

You can find videos, documentation, and the product itself at www.tactyle.net.

I’ve been using it myself for about 4 months (to manage it’s own development).  I hope you find it as useful, and addictive, as I have.

Looking for beta testers for agile tool

After years of thinking about it, and months of actually developing it, I’m now looking for beta testers for a brand new agile tool.  If you like the sound of “Story Mapping + Big Visible Charts + Simplicity”, send me an email (address here), and I’ll reply with a link to the product.  If you like this blog, then you’ll like the tool (I hope!) because it reflects the concepts and “philosophy of agile” which I blog about here.

(And yes, development of the tool does explain the relative silence on this blog in recent months! ;-)

Encyclopedia Article now on Sale

After some delay, my Encyclopedia Article on Earned Value is now available here.  The article aims to be

An accessible and comprehensive introduction to Earned Value (EV). [It] makes extensive use of graphical charts, instead of mathematical formulae, and is suitable for readers with no prior knowledge of the subject. Key topics are the fundamental principles of EVM, its history and current usage, and special considerations for applying it to software development projects.

Enjoy!

Key Resources

Here’s a brief summary of the key Earned Value resources on this blog:

  • Earned Value in two sentences: Earned Value in a Nutshell
  • Introduction, from a Agile perspective: Agile Charts
  • Introduction, from a classic Earned Value Management (aerospace/DoD) perspective: Software Tech News article (was also re-printed in the PMI’s Measurable News)
  • A comprehensive 30 page article, compatible with both the agile and traditional approaches to Earned Value.
  • Video: “An animated graphical introduction to Earned Value” -  I’ll be publishing a link shortly.  Check back here in July or subscribe to this site’s RSS feed to be notified when it becomes available.
  • “Starter kit” spreadsheet (released with the kind permission of my employer): Starter Kit
  • Guidelines for successfully using the starter kit: Rules of the Green Line
  • Finally, if you’re interested in an agile project management tool with automatic earned value, check out Tactyle.  I designed it according to the principles described in this blog.

Converting Apples to Oranges

There are two common errors when forecasting the final cost of a project.  One is to compare actual cost with planned cost.  The other is to compare actual progress with planned progress.  Both are wrong. 

Earned Value teaches us that the only valid measure is to compare actual cost with actual progress.   This may seem a bit like “comparing apples with oranges” – we seem to be comparing things that are not the same.  The trick is, before we compare them, we convert them both to the same numerical units.   That’s what makes the comparison possible and enables all the predictive goodness of EVM.

(Thanks to Glen Alleman for inspiring this brief post, with his comments here).

Agile 2011 Keynotes Look Good

The three keynote presentations for Agile 2011 have been announced.  I’m thrilled to see that two of them are on the people side of agile, rather than the technical side.  Barbara Fredrickson will speak on how positive emotions feed a virtuous circle in the workplace, and Linda Rising will talk about how viewing ourselves as “changeable” produces better outcomes than viewing ourselves as “fixed”.  I believe the latter point is essential, if we are to truly value people and their interactions over processes and tools

I’m also thrilled to see that one of these speakers, Barbara Fredrickson, comes from outside the agile community. I’m a firm believer that agile can learn a lot from outside the agile community, so it’s great to see that happening at our largest conference.

Conversation with the Situation – a Software Example

As I posted recently, professionals in many fields work by having a “conversation with the situation”.  What does this really mean, in software development?  To answer that question, I’ve decided to share a recent design episode from a system I’m working on.  I’ll try to capture the full “conversation with the situation” – both my side of the conversation, and also how the situation “talked back”.

The design problem at hand is actually very small, just two user interface controls – a slider and a button – but this post is long.  That’s kind of the point, to illustrate that even simple things involve a non-trivial amount of “discussion” with the situation at hand.

Background

I’m building a scope management tool for agile teams.  This post is about one very small part of it: the portion of the user interface that controls zooming in and out.  Like Word, Excel and virtually every “document” centric application, mine will have a slider near the bottom right corner to let the user zoom in and out.  But unlike Word and Excel, my app suffers from two unique design constraints:

  • The space available for the zoom controls is a square.  It is much taller, but also much narrower, than the zoom controls which most other apps slot into their status bars.  (Mine doesn’t have a status bar.)
  • My app needs a really easy way for users to “toggle” between being zoomed in to see detail, and zoomed out to see the big picture.  If I can’t make this easy… well I wouldn’t even want to use the app myself!

My initial design sketch looked  like this:

initialZoomSketch

My Conversation with the Situation

Here’s how it unfolded as I did the coding.  In the left hand column I’ve listed the actions I took.  In the right hand column, I have represented the situation’s “back talk” – the unexpected things that I learned as I went along.

Action Reflection/observation

Part 1: Implement the Slider
Began by dropping a “Slider” control into the square of available screen real estate
Wow, that square is really small.  It makes the slider really short.

When the “+” and “–” buttons are added, it will need to be made even shorter, in order to make room for them.

Wonder if I could put the + and – buttons above the slider, instead of to its left and right.
After looking a bit harder at what I’ve got so far, I realise that putting them above would force the slider down, and cut into the space that I need for the button.
Decide to omit the “+” and “-“ buttons, and let the slider have the maximum width available.
So what about the “100%” label, where can it fit?

Incidentally, why does it have to say “100%”?  That’s not much use.  Why not display the current value instead of simply labelling the 100% point!

Try putting the current value literally right on top of the slider.  Make the text grey to reduce its visual impact.
That looks ugly.

But hey, aren’t I working in a UI technology that supports partially-transparent controls? Yes!  Can I use that?

Try putting the label at the bottom, as normal black text, with a partially-transparent slider over the top.
Yes.  That’s nice.

(And, as a bonus, it looks kind of cool when the number changes as you drag the slider.)


Part 2: Fine-Tuning the Slider
I run the app again, and play round with the slider.
I find something I don’t like – I can drag the slider around, but then how do I get it back to 100%?  It doesn’t automatically snap to 100%, so I end up with 90-something, or something-just-over-100.  It’s annoying.
Look up the documentation for the slider control, to see what my options are.
I can make it snap to, say, multiples of 10%.  That will let the user easily get it back to 100%.

But, if I turn on the snap setting, then this particular slider control actually prevents the user from dragging it to any place between the 10% “snap” points.  It seems wrong to have a slider than doesn’t actually slide.

Come up with my own solution.  Instead of using the built-in snap feature, I will let the user drag the slider wherever they like, but if they click on it, I’ll make it snap towards their click, onto the nearest 10% boundary.

Takes a few lines of code.

Works as expected.

I’m concerned that the click functionality is counter-intuitive tho.  Decide to leave it as is for now (since I don’t want to spend any longer on a what is actually a minor point).  Decide to keep an eye on usability as I test the app in the future, and make changes if necessary.


Part 3: Add “Auto Zoom”
Put the auto-zoom button into the UI.

Add the word “auto” and a basic “minus” magnifying glass.

Fire the app up again to take a look.

I see a problem.  I have designed the auto-zoom button for cases where the document is very large (that’s when the user will need to  zoom out for an overview).  But my test document, which I use while running the app during development, is very small.  I look at it and realise, “What does auto zoom out mean, in a document so small that you don’t actually need to zoom out”?
I consider whether I might hide or disable the button on small documents.
But, if you can’t see the button when your document is small, won’t it seem weird when a button suddenly appears as your document grows?  How will you know what it is supposed to do, if you have never seen it before?
Back to the drawing board…  Can I come up with some kind of behaviour that will make sense no matter what the size the document?  Something that can be always enabled…

(My original thoughts involved an algorithm to compute the zoom out percentage – hence the name auto-zoom.  But, the algorithm only made sense on large documents.)

I decide to go for something simpler, the button will always toggle out to 33% of the current zoom level.  E.g. if you are at 100%, it will take you to 33%.  If you are at 120%, it will take you to 40%.

I try it.

I like the result.  It seems easier to understand than my original idea, and appropriate (enough) for all document sizes.

Part 5: Icon for the Auto Zoom
But there is still a problem.  The minus-in-a-magnifying glass icon just isn’t working for me.  We never normally see that icon on it’s own, it’s normally paired with the plus-in-a-magnifying-glass icon.  In my app, it looks confusing sitting there all by itself.
In a flash of so-called inspiration, I create an icon for the button, that shows a document getting smaller (zooming out)
It’s rubbish.  Totally un-intuitive. (A fact that I confirm by asking my wife what she thinks the icon means.).
Why so unintuitive…?
I realise that the problem is simple.  The icon shows the document getting smaller.  But, when you zoom out by 33% you don’t necessarily see a smaller document.  The document still extends to the edge of the visible screen – the only change is that there is less outside the screen.

So basing the icon on document size is wrong, because the user doesn’t see the document change size.

What does the user see?  They see the text change size. So I make a new icon, this time showing a change in font size.

Success!  That feels intuitive to use. (And it passes a 30-second “spouse usability test”.)

Here’s the end result:

NormalZoom

When you click the button, the app jumps to zoomed out, and the icon changes to this:

ToggledZoom

Click it again, and it toggles back to the first state (with your original zoom level, whatever it was)

[Update 5 months after initial posting: I have made more changes since writing this blog post.  The conversation with the situation continued, even after I thought it was finished ;-) ]

Done

That’s it.  My conversation with the situation (or my internal design monologue, if you prefer) in designing one small part of the UI.  I hope it helps to demonstrate several points:

  1. We do a lot of this, when we build software.  My simple example here has 14 cycles of action and reflection, and that’s just for two UI controls – and those 14 cycles don’t include the smaller act/reflect cycles involved in actually coding the functionally.  In this case the coding consisted of hooking up these two controls to the rest of the UI, so they did actually make zooming happen.  I did that coding as I worked, but have glossed over it in this post.
  2. Notice that, even before I started these 14 cycles, I had already done a so-called “design”.  I had done gone though about 3 iterations of hand drawn sketches, finishing with the one at the top of this post.  I had also designed the algorithm that would compute the right “auto zoom” level for large documents.  Everything on this page happened after finishing “design”.  That is normal. When a good software engineer does a professional job, he or she has a detailed conversation with the situation while they are coding.
  3. A good conversation with the situation includes asking yourself questions like, “How will the user feel about using this?”, “Is it still working out OK?”.  It also includes being observant and noticing variants of the problem which were not explicitly thought about before – e.g. “What does auto-zoom mean in a small document?”.  Finally, it includes responding to pleasant surprises, such as my realisation that I could solve the space problem by making the slider partially transparent.
  4. Imagine if I had not had this conversation with the situation, and had simply implemented the original design, exactly as it was.  I would have ended up with something that was correct in theory, but annoying and confusing in practice.  Does that remind you of anything?  Most bespoke enterprise software, perhaps? ;-)

FAQ

Was I being too picky, doing all this for just two UI controls? Well, this example is from a personal project.  In my day job, I don’t recall putting so much attention into UI design – because that is not the priority for the business customers I deal with.  Instead, most of our “conversations with the situation” relate to business logic. Those conversations are both more important, and more intricate, than the example on this page.  Unfortunately they’re much harder to write about because they’re so abstract.

What about communication problems? Yes, in most real-world situations there may be information that falls through the cracks between the customer and the developer.  This makes it all the more important for the developer to be alert to possible gaps and inconsistencies.  I.e. to continue the conversation with the situation as they code the solution.  In the example on this page, I am both the customer and the coder, so there were no communication gaps – and yet look how many action-reflection cycles were still required even after perfect (lossless) communication!

Isn’t this just a lack of foresight on my part? The suggestion is that, if I’d had better foresight when thinking through the design, less “conversation” would have been needed during coding.  Well, yes, and no.  “Yes” because, if I’d had perfect foresight then the conversation would indeed have been reduced.  But “no” because no-one actually has perfect foresight.  All the resources I quote here, and doubtless many others too, confirm that this kind of “conversation with the situation” is completely normal and necessary for designers and other professional people.  If there is anything usual about this page, it’s simply that software engineers don’t normally write down examples of their thought processes.

Isn’t this just the normal feedback cycle of agile development? Again, yes and no.  It is certainly part of the same concept. Firstly, the difference that I see is that the “conversation with the situation” is much more fine-grained than, say, running an acceptance test or demonstrating the software to the customer.  The conversation with the situation covers lots and lots of tiny details (and big things too).  For some of those details, the developer may indeed go back to the customer to discuss them.  I suspect there’s a degree of experience and judgement involved in asking the customer when necessary, without drowning them in a deluge of micro-decisions.  Secondly, the conversation with the situation is very much in keeping with the side of agile that Alistair Cockburn describes as “looking around, taking initiative, and doing ‘whatever is necessary’”.  Finally, I would emphasise is that a conversation with the situation is almost the opposite of a blind rush to “complete” a user story as quickly as possible.  Conversation is thoughtful.  It may, and sometimes will, take you in unexpected directions for the good of the product.  It will almost certainly result in better usability and fitness for purpose.

Does it take more time, and so cost more money? Maybe, but probably not as much as you might expect.  Why?  Because good quality conversations with the situation, at coding time, tend to reduce the defect count later.  So the conversation pays for itself to some degree, in terms of fewer problems later on.  It also improves the overall value of the software, by improving it’s usability and fitness for purpose.  After all, which is really more expensive – a $100k system that your staff hate and can’t use efficiently, or a $120k system that makes their jobs efficient and satisfying?

Final Word

I received some lovely feedback from a customer, after we ran a project that included lots of conversations with the situation.  The customer’s system administrator said:

Almost every day, another staff member asks for access to the system.

Isn’t that great?  A custom-built business application so satisfying to use, that it “went viral” amongst the staff.  What a change from clunky systems imposed on users against their will.

10 Years Agile – a perspective from outside the room

Recently Alistair Cockburn invited 32 agile practitioners to join him at the Snowbird ski resort, for a retrospective on the agile movement as a whole.  I followed the event via Twitter, sitting under a sun umbrella here in the southern hemisphere, reading the tweets from the snow.

The event was both a celebration of the first 10 years of agile, and an attempt to answer three questions which Alistair circulated before the meeting:

  1. What problems in software or product development have we solved (and therefore should not simply keep re-solving)?
  2. What problems are fundamentally unsolvable (so therefore we should not keep trying to “solve” them)?
  3. What problems can we sensibly address – problems that we can mitigate either with money, effort or innovation? (and therefore, these are the problems we should set our attention to, next.)

There was clearly much to celebrate from the past 10 years of agile, but when it came to the future, there seemed to be concerns in several areas: the slowness with which good practices are adopted in some quarters; the risk of losing momentum now that there is no longer a common “enemy” (as heavy process was, when agile began); and a perceived lack of strength, clarity and consensus in the group’s answer to Alistair’s third question – “what next?”

Reflecting on those concerns, here are my “ah-has” from my virtual participation:

Gradual Change is Normal (Part 1)

Mike Cohn wrote a great post likening agile to Object Orientation.  Eventually, OO was taken for granted, and people stopped talking about it.  He suggests that agile will go the same way, and I agree.

However, these things can take a really, really long time. Here’s an example, that extends Mike’s OO one: By the late 90’s, OO had blossomed so much that the premier OO conference, OOPSLA, moved away from its original goal of making OO practical and understandable.  OOPSLA’s work was done.  But, at the turn of the century, there were still a lot of people who weren’t using OO.  Legions of VB6 developers making business apps on the Microsoft platform were not using OO at all.  Slowly, over the decade that followed, OO seeped into the Microsoft development community.  Languages were replaced and improved, and starting in about 2007 we saw wide adoption of Object-Relational Mapping and a variant of Smalltalk’s decades-old Model-View-Presenter pattern.  (Yes, Microsoft played a role in the timing, but so did changing sentiment within the developer community.)

There are two key things to note from this example:

  • We are currently seeing (real) OO go mainstream in the Microsoft community –  about a decade after it went mainstream in most other parts of the development community.
  • This happened without any industry association driving it.   There was no equivalent to the Agile Alliance, cajoling Microsoft developers into using Objects.  There was no need for such a body, because OO had become adequately embedded in the industry’s  consciousness back in the 90s.  It was like a virus that had infected enough  of the population that it could no longer be eliminated.  Slowly, over the decade that followed, it reached the rest.

So don’t sweat it. Agile isn’t going away.  It will continue to influence people, and to be embraced by new users, long after the early adopters have taken it for granted and stopped talking about it.

Gradual Change is Normal (Part 2)

In a post on his delightfully-named blog, Jonathan House wrote the following after the Snowbird event:

Does Agile really make a difference? – Not so much a question that showed up at the conference, but one that kept running around in my head, kicking over garbage cans and spray-painting the cat. … It’s clear we’ve made excellent progress over the past 10 years, but it’s still not so clear to me why businesses aren’t beating down the door to really adopt Agile throughout the enterprise …

Jonathan, I’m fairly sure this is not a reflection on agile.  It is reflection on business.  Business leaders often fail to follow advice, even when they actually agree that the advice is good.  I don’t say this out of personal dissatisfaction; it is a well-researched fact.  There’s even a book on the subject, called The Knowing-Doing Gap by Jeff Pfeffer and Bob Sutton.  (I mentioned Pfeffer and Sutton in my Agile Roots talk.  As an agilist and geek, I find their work extremely credible and relevant).

I am convinced that you are observing not a failure in agile, but a significant problem in business in general.

(Having said that, it wouldn’t hurt if we in the agile community could familiarize ourselves with how the more self-aware sections of business community do already understand agile, just with different words and under different names.  It will be much more polite, and therefore more likely to succeed, if we listen before we lecture).

Diversity is Good

I think some people who were following the Snowbird event may have been disappointed at an apparent lack of consensus.  I know I was, at first.  But then I remembered that diversity is good.  Think of the importance of genetic diversity in populations of animals; remember how the messy diversity of capitalism out-performed Soviet central planning; and think back to the diversity of the original 17 signatories to the Agile Manifesto – a diversity which was alive and well both before and after they signed the Manifesto.

By having a range of people, with differing interests and priorities, the agile community is much more likely to successfully address the many and varied challenges of the next decade.

I think the point with diversity is not just to accept it, but to actually encourage it.  Good agile, particularly by experienced practitioners, will be situationally specific.  I suspect this point has not fully seeped into the overall consciousness of the wider agile community.  Perhaps one of the tasks for the next 10 years is to promote the acceptance of “situationally specific agile”, and to help people learn (i.e. practice) how to do it.

There is Plenty to Do

Several people pointed out that agile lacks a clear “enemy” now.  When agile started, heavyweight process was the enemy. But today there is no clearly-identifiable external enemy.  So what is the point of the agile movement now?

David Anderson seemed to reflect the mood of the group when he wrote:

The mission now is incremental improvement. It’s evolution, education and improving levels of maturity, rather than a revolution. The enemy is now within. The enemy is as Joshua Kerievsky put it “all the crap I see out there” despite 10 years of Agile methods.

David Anderson went on to write

I don’t believe the Agile movement knows how to operate without something to revolt against. Agile came, it served its purpose, it had a positive effect. What next? Perhaps it is time to move on?

Is the really nothing more to do?  Nothing more but combating the enemies within, of complacency and poor execution?  I can see the logic of what Joshua and David (and others) are saying, but please, please don’t let it be true!  There is so much more to do.  Here are just a few topics that come to mind:

  • The spread of agile beyond software (as per Jonathan House’s comment above, and others on the day)
  • Jeff Patton’s story mapping and feature thinning – two wonderful techniques which deserve to become much more prominent in agile’s second decade
  • Advancement of knowledge/skill in Ri-level/situationally-specific agile
  • Philippe Kruchten’s herd of elephants (elaborated/commented on here by Scott Ambler)
  • Really paying attention to “Individuals and Interactions”.  For 10 years we’ve been getting this first point of the Agile Manifesto round the wrong way!!  So you can’t tell me there’s nothing left to do ;-)  James Coplien phrased it well in his outstanding reflection on the first 10 years: “We have test scripts and jUnit trumping individuals and interactions”.
  • Sharing our failures as well as our successes, as several people mentioned on the day
  • Contracts for agile projects – currently, only a partially-solved problem at best.

We’ve only been doing knowledge work in teams for a short part of human history.  The previous millennia did not prepare us well for the last few decades of complex, abstract, co-operation in non-trivial teams.  So of course this is still more to learn.

Summary

We need to keep thinking, keep talking and keep learning.

We need to keep agile’s sense of humanity – of valuing, respecting and caring for people in the workplace.

We need to retain and treasure the global and local communities of practitioners, which the agile movement has created.

We need to keep all these things, even though there is no longer a common enemy to unite us.  We need to learn to operate in an agile community that doesn’t just accept, but actively promotes, its own diversity.

I recently stumbled across a quote from the French poet Stéphane Mallarmé:

to define is to kill, to suggest is to create

Let us not define our future.  Let’s suggest it.

Earned Value Starter Kit

At the end of my talk on Earned Value, I’ve been giving away the “Earned Value Starter Kit” that we put together at Optimation.  It is a fairly simple spreadsheet, which makes it easier to get started with ‘lite’ Earned Value. In case you miss out on a copy, you can download it here.

Thanks to the folks at work for making this freely available.