Feature not a part of the app: Worth test it then?

0

Posted by Amit Kulkarni [Admin] | Posted in , , , | Posted on 2/06/2012 07:45:00 PM




Testers are not just to find bugs to provide a valuable suggestion, or point out a thing which is not a part of the application from the start. I always try to keep these things in mind when I test an application whether it is a web based application or mobile app. The reason for always keeping track of what is changed is helpful to determine to find more loop holes in the application. Sometimes developers just forgot to remove a feature which should not be a part of the overall app, but what if the app shipped and gone live. The user will try to use it and ultimately they will complain. For others, the option would be to just roll back to previous version for stability.


Recently I was testing a mobile app, which I love these days. So, I sort of keep track of before updating to the latest build in order to have good interactive experience.  I found out that there is a feature which should not be a part of the app, now this is just come from intuition as I could not find any mention of the same in requirements, where it is mentioned that this feature will be a part of the app in this build. So the first question? Is it worth to test then? But what if it not mentioned explicitly but as a tester I need to make sure that I test it so that I could cover up things which are not written in the requirements, as James Bach would call it as an unwritten requirements.


It turned out that I will test it, and at the same time question the developer whether this is a part of the app, as the app supposed to make its way to store in few weeks. So, if the developer has failed to catch this, as a tester this is my responsibility to make sure that I am on a right way by letting them know that what I have seen. Though I decided NOT to focus too much on the feature at this moment, as first I need to cover up other parts of the app, and as the feature itself is new in app, so it is kind of first understand about it, and then come up with ideas. So, after exploring other part of the application and raising some issues, I decided to move on to the new feature. I checked the help section of the app, so somewhat sure that either this has been incorporated by mistake, or there is no update on this in help section. I used my previous experience, and found out what the feature is all about. The feature pretty much causing issues with other parts of the application, so I thought of spending not much time on it before I get to hear from the developer.


I got to know from the developer pretty soon that the feature is incorporated by mistake and should not be there. I am glad that I did not spend too much time on testing that feature as that would have not given sufficient amount of time for me to test other parts of the app. 


The takeaway over here for testers is to keep eyes open and find out for such anomalies first and raise your hand for questions! 



Br.,


Amit


Started writing this blog on 02/06/2012 at 07:05 PM IST and completed the blog at 07:44 PM IST

Reactions: 

A year gone by, a year ahead!! [Happy New Year - 2012]

0

Posted by Amit Kulkarni [Admin] | Posted in , | Posted on 1/01/2012 12:00:00 AM


With almost approximately one and half hour left when we enter the new year, I just thought of put a closure note for this [2011] year.

This year has gone by, well almost quite a good and a busy one. There were quite a few things that could not be discussed in "public" but my sincere thanks to those who walked with me. For some of the walks, I could not be there with you but I hope you understand it. 








Looking forward to this year ahead with the same excitement!!

Happy New Year 2012, folks!!!!!! Enjoy!!!! 


Br.,


Amit

Started writing this blog on 12/31/2011 at 10:35 PM IST and completed the blog at 11:12 PM IST

Reactions: 

Sunday Jinx with some false claims.

2

Posted by Amit Kulkarni [Author] | Posted in , , , , , | Posted on 9/04/2011 10:18:00 PM

Few days back I downloaded an app to be very specific a game [Chess game] on my BlackBerry device. The main purpose behind the download to see how many claims made by the game owner are correct, many were correct. Okay, not bad. Let's explore the game a bit now to see few more claims. I visited "puzzle" section where the user can solve the puzzles based on the set condition [if and only if those were fulfilled] then you crack the puzzle, and ultimately declared that you won, I mean you were able to solve the puzzle. So for first few tries I was informed that I have exceeded the number of conditions set, so I need to either try again or quit, the puzzle. 


The puzzles were interesting and have set conditions so it is not that easy to actually read what move to make next, it may possible though that even after making correct moves, the app says you have exceeded the *defined* set of conditions, and ultimately leads you to start all over again. I find that part not much convincing, I mean ONLY if I could make the moves which falls under the category [the algorithm] set then only I could be able to crack it, huh? Anyways to continue with the jinx which I set for myself earlier I decided to see how it work out, I mean I am not that bad chess player either, so that should not be much worry. And yes the puzzles have variations too, it means that every time if you make a move and fail, and follow the same set of moves then it may not yield in the same moves by the app, not yours, of course. This leaves the user wondering the app [or the set algorithm] have the luxury to change the moves but the user is expected to expose or rather follow the same set of moves to crack the puzzle, but it turn out other way round, that is later, not now. I was solving the puzzles and now I understand the bit of logic in there so could easily move on to the next one. 


Some claims that made me wonder:
  •  User could make two different set of moves and still be declared as winner 
  •  User makes correct moves but the app says "FAILED", try again.
  •  User follow the same set of moves after first attempt, but the moves by opponent are different this time
  •  User makes correct moves and there is no way they are not correct, app says it does not follow the defined set conditions
Not to spoil my jinx I noted them down and decided to move ahead, there is no point in stopping by when I can not discuss that in person, with the game owner [developer]. :)

As I move on to next levels the puzzles getting more interested and at the same time, somewhat tough, but I decided I am on for it. Here the *claims* for some of the puzzles made by the app owner didn't justify themselves, and I could see a way to sneak through without even following correct set, or even correct number of steps.


Examples: The app says the puzzle will have 3 moves and then mate, white moves first, which is mine. 


So the example looks okay there is no problem with that but I could finish the puzzle in 2 moves but as mentioned it requires 3 moves, right? Then how could I finish off the puzzle in 2 moves, what happen to defined conditions in this case, or am I that smart to complete it in 2 moves. As the app didn't specify clearly or there is this ambiguity that 3 moves != 2 moves, right?  Or even you didn't mention that it could be less than 3 moves also, as the message clearly states that I should be taking 3 moves, at least.
3 moves, white makes


If that would have been the case of one puzzle then I would not mind that much, but I could repeat the same fist for others too.  By 3 moves it certainly means that if one has follow 3 steps in order to complete the puzzle, and that too, those steps should fall in the defined conditions mentioned internally, that is not known to the user, of course. 


Oh! I blocked the clear view of the board for you, I'll get it sorted out that one for you. It would give clear picture to see that one and who knows you may finish off the game in 1 move. :) 
Board View - My Moves
I set it up for you too, now it gives clear view for you, I marked the moves that made by me in "red" arrows, so those are ONLY 2 moves, and I am yet to figure out why would I make another move. It is so dead that, and yes by the way the move black makes does matter, but I could always beat this in 2 moves, and yet to figure out where should I go in order to make my 3rd move. 


Anyways just to keep the story short I am yet to hear from the owner [developer] of the game, as I reported it via using "Report a problem" link, as I feel, some user may spend that precious time just to figure out where is my 3rd move? Oh, no I could not finish it off in 3 moves, I quit. 

Update: Added few more screenshots after I made the moves and in response moves, as it could be seen in both the screenshots that I could complete it in 2 moves. For move details please view the top right hand side of the screenshots. [Update details: 02:10 PM IST]
1st set of Moves
2nd set of Moves

Br.,


Amit

Started writing this blog on 09/04/2011 at 09:30 PM IST and completed the blog at 10:18 PM IST
One update in total on 09/05/2011 - added few more screenshots for more clarity.

Reactions: 

A Friday RANT

0

Posted by Amit Kulkarni [Admin] | Posted in , , , , , , | Posted on 8/27/2011 04:20:00 PM

The intriguing part of Mobile testing is the more you delve into it the more you enjoy, and find out the ways that could help you shorten the time.

So recently I have added an android device to my kitty so that gives me an experience of comparing how two or more devices will behave for the same application in their own environment. I mean it appears nowadays that if there is website then over the period of time it is get re-written so that it will work with Mobile devices.  That is part one. But because there are these OSs that are competing against each other to show that which one is good or bad. That is altogether different topic of discussion.

As a normal user it took time for me too to get adapt with the new device. But it was well worth time spent in understanding the core parts. I was not in hurry at all to get adapted with the new device but it just that a tester in me didn't took that long to adapt. 

When I was used to then I decided to have a same application in all the devices that have [I was expecting the app should be available for all of them in their respective markets or so].  It was not that tough part to find out common app that is available for all app, so I found one.

The next step of course to have that installed on all the devices that I have. Some patterns that I observed [starting with installation of the app itself]:


  • The size of the installer [Does it vary too much?]
  • The time it took to install [Does it work out more or less same for all?]
  • The user interaction whilst installation [Does user have much control on this?]
  • The option presented to the user when installation is completed
  • And finally, the user is able to run the app

Just curious to see results for some of these questions and I was not surprised much though. Other than the part which I hate most about BB resetting the device. As the app is installed on difference devices so I was expecting a bit of things missing here and there.

The most interesting part to run the app and just work out a bit with them on different devices. I set a time frame to just work on the app for few minutes or so on every device just to figure out how the whole user experience. Not bad when I start off. I was not trying to do any kind of analysis or so, neither I was trying to test the same app on different devices for compatibility as that was not the goal, for this run.

I was more interested in things like:
  • Transition time [Experience from one device to another, and time to get adapt to]
  • Interaction with the app on touch screen device, as against to one having physical QWERTY keypad. 
It was a bit of RANT that I ran as I just wanted to see how well a user in me get adapted with same app, on different devices.


Br.,

Amit

Started writing this blog on 08/27/2011 at 03:20 PM IST and completed the blog at 04:00 PM IST [scheduled post]

Reactions: 

My Guest Blog Post on in-built feature for logs for Mobile Application

0

Posted by Amit Kulkarni [Admin] | Posted in , , , , , | Posted on 8/04/2011 09:39:00 PM

Wrote a guest blog post for Bernard Lelchuk and it went live yesterday on his blog. The details for the blog could find out at : Log @ your help

Br.,

Amit

Reactions: 
Subscribe to: Posts (Atom)