03 January, 2011

Tying up some loose ends

I think it is time for a follow-up on my experience of applying Thread-Based Test Management (TBTM). In October last year I blogged about my attempt at setting up my tests for a new project using TBTM.

It was a smaller project, with me as the only tester which gave me a lot of freedom to try new things, and I actually did what I set out to do! First I created my mind map, or fabric. I added all test activities I could think of to the fabric as threads. Using different colours and icons I visualised the priority of the threads. The first version of the fabric as it looked before I started testing I kept as my test plan, and this I sent to the external customer. To my joy the mind map version of a test plan was quite well received!



Thereafter I started testing. I would typically be working on two or three threads at the same time, and I would not "tie off" or finish a thread, but rather do some testing and then come back to the same thread later, after having worked on some other threads too. This way I ended up digging into the details of most threads at the same time, rather than focusing on one test task and "completing" it before moving on. As my testing progressed I kept updating the fabric. The visual presentation of the current status turned out not only to be a great help to me, but also to the developer I worked with. In the end, he would actually only use the fabric to see what work remained and not our usual defect reporting system.

I had planned to write daily status reports, but instead I actually ran my tests as unfinished, not time-boxed SBTM inspired sessions and wrote session reports. It turned out I needed the reports to keep track of what I was doing. For test charters, I drew a lot of activity diagrams.

When all testing I had time to do was done I had a fabric with a lot of green threads and unfortunately some red too. I took my "final" fabric and used it as my test report. Together with some clarifying notes it constituted all test documentation the external customer received.

My conclusion after this experiment is that for me personally I think a hybrid of SBTM and TBTM is the way to go. I do feel the need to work on things in parallel whereas I usually do not feel the need to time-box, but on the other hand I really like my session reports. I will continue to work like this - it has been exploratory, controlled (in the good sense) and well documented (in the sense of "as needed"). Oh, and I left very few defects for the customer to find and they were all of low priority...

4 comments:

  1. Hi Christin,

    Lovely thoughts; thanks for sharing.

    I’d talked about how Markus Gärtner displayed his Inspectional Testing technique previously in a recent testing session I’d attended. You can read about it here http://www.bettertesting.co.uk/content/?p=645

    In fact I'm also a big than of mind mapping & very curious about TBTM. Having seen your original post declaring your intent to try it I was very keen to see your follow up post of how useful you had perceived it to be.

    You state the developer preferred this to traditional methods of reporting. How many developers do you work with? Also is it just yourself as a tester in your company?

    The reason I ask is with traditional models in place sometimes it takes a bit of discussion and push for change. Perhaps you’re lucky like myself in that you get a bit of a free role to try new ideas?

    I'd also be very keen on seeing an example of the finished mind map. It could be edited for legal reasons if needed. I think it would be of great benefit not only to myself in seeing your approach, it would also benefit the rest of the community that are interested in the concept of TBTM.

    Good stuff, thanks for sharing.

    Cheers,

    Darren.

    ReplyDelete
  2. Interesting reflections. I'm still experimenting with TBTM myself. Looking forward to more of your ideas.

    /Martin Jansson

    ReplyDelete
  3. Reply to Darren:

    Thanks for commenting, and thanks for the reading tips - Inspectional Testing is a new concept to me, but I am already liking it!

    I'm planning to publish my finished mind map later this month, once I have cleaned it up a bit. In this particular project I worked with a single developer, but there are about five developers and two testers (me included) at the company.

    Since the department I work in is still fairly new, it is easy to implement new idea, and with the high pace of our projects, visual representations that are easy to grasp tend to be very well received.

    I will definitely look into Inspectional Testing more!

    /Christin

    ReplyDelete
  4. Christin, that's excellent news, I'm really looking forward to seeing the mind map.

    Thank you for sharing your personally experiences with new ideas & methods. This is the kind of content I love! Stuff that I can look at & consider for my own workplace.

    ReplyDelete