Pages

Monday, 10 August 2015

Sympathetic testing


One of the reasons I like BBST courses is that there is a focused reading on a topic. There are questions asked about a document. You might have read the document before but one seems to learn more when there is a focused reading of the same document under time pressure. In the Test Design course, I learn about "Sympathetic Testing". There seems to be an excellent document explaining how to learn an application. The focus is on learning about the application and not testing the application.


I decided to learn about the application ClipX in a similar manner to how Mike Kelly learnt about the Magnifier tool. The first tour described was the 'Feature Tour' where the focus is to move through the application, getting familiar with all the controls and features one comes across.

I installed the application ClipX from http://download.cnet.com/ClipX/3000-2384_4-10315451.html
Based on the Mike Kelly's blog post, I prepared this mindmap.
Application Tours
The next few hours, I will be focusing on the application tours. Let me start with the feature tour.
When I was installing the application, I found one interesting behavior. The 'Run the application now?' popup appeared even before the progress bar on installation window was complete.
Click here to view the partial report of the feature tour. I did not do a complete feature tour.

What did I learn from this exercise?
It was a different experience to focus on learning about the application and not hunt for bugs.

Rich model
As the focus shifted from "Can I test for this bug" to "What else this product can do", I learnt about the product in detail. The additional information will help me frame better tests and target each of the areas I learnt. This also helps me in relating a test on a single feature to its effects on other feature. The rich model helps me think of the big picture.

Better bugs
As I learn more about the overall application, I ask questions related to the design of the application. If I were to concentrate on a single feature, my question might be limited to the particular feature. Looking at the bigger picture, I can find bugs related to the absence/presence of a particular feature. I can question the very existence of a feature instead of a bug in a feature.

Risk - Coverage - Priority
I can talk to my stakeholder with my initial report and ask for the areas to be tested. Based on my initial tours, I have an idea of how a test might affect the other features. How risky is a particular feature? What percent of coverage would be achieved in terms of features? Which feature demands highest priority testing? I have a better answer to such questions after this exercise than before the exercise.

Learn in five minutes
After I finished prepared the report, I realized that few of my tests could have been avoided if I had seen other features before. The next time, I will quickly go through most of the options within five minutes and then focus on tours.

I am still learning to do sympathetic testing well. Have you experienced Sympathetic Testing? What do you think? How do you learn about the application? How much time do you spend?

No comments: