Skip to content

Acceptance Testing: What, Why and How

October 11, 2007 by Vaibhav

What is acceptance testing?

Acceptance testing is a black-box testing performed on a software prior to its delivery. It involves running a suite of tests on a completed system (ref: Wikipedia). These test suites are made up of multiple tests or test cases. Each test case consists of a sequence of steps to perform which emulate the use case that is being tested; it also contains input data (if required) as well as the expected output. The result of a test case is either a pass or a fail.

WHY?

Although acceptance testing traditionally takes place at the end of development or major milestones, in agile software development acceptance testing needs to be performed at the user story level. There are several reasons for why this is important:

  • A passed test case becomes a measure of completeness of a user story; that is, a user story cannot be considered complete till it has passed all acceptance tests associated with it.
  • Even though there is thorough unit testing performed, this is not enough. Unit tests, by their nature, test for a localized used case and are not concerned about the overall system.
  • When we have iterations longer than a couple of weeks, it becomes easy to loose focus on initial agreements; acceptance test cases made for each story at the beginning of each iteration help the developers to keep things within the expectations.
  • Acceptance test cases can serve as an excellent guide to developers to better interpret the requirements from a user story

The Acceptance Test Case

An acceptance test case has the following primary objectives:

  • The Product Owner should be able to verify and validate that the user story has been implemented as it was supposed to.
  • The developers should be able to check if what they have developed is in accordance with the requirements.
  • We do no development that cannot be verified.

An acceptance test case is a human level test which determines whether the product meets the expectations of the end user.

HOW?

When creating acceptance test cases, the following points (some obvious) should be covered:

  • All scenarios of the User Story should be covered in the test cases, and the expected outcome mentioned so that a tester can verify each function and use case.
  • The acceptance test case needs to be at a broad overview level and not have details such as field validations, etc. because those will be covered by unit test cases.
  • The test cases should precisely define the steps and their sequence that the tester should take; the inputs; and the expected outputs.
  • When testing a non-UI based module, an acceptance test case can be an automated test case which also records the response. This will allow you to examine the output and see if it is acceptable.
  • The acceptance test cases need to be reviewed and approved by the Product Owner in order to ensure that the coverage is complete.

Once test cases are created and approved, they should be given to the developer prior to start of development work. This allows the developers to get better understanding of the requirements as compared to what they might otherwise understand from just the User Story. This implies that the test cases need to be made before the actual development starts.

There are some tools for running these kind of test cases automatically, but it is very common to have a group of testers run these manually. How do you manage acceptance testing? What tools and best practices do you use?

About the Author:

Comments

User Acceptance Testing

July 29, 2008 by Adron (not verified), 6 years 12 weeks ago
Comment id: 1733

Great entry. I was helpful.

Interesting But when should

December 18, 2008 by Anonymous (not verified), 5 years 44 weeks ago
Comment id: 2132

Interesting
But when should testers write scenarios?
If the answer is after sprint planning meeting, then developers should wait while tester write the test case and approve it?

Actually, the test cases

December 18, 2008 by Vaibhav, 5 years 44 weeks ago
Comment id: 2133

Actually, the test cases should be written as soon as we have user stories available. This can be an ongoing exercise as the Product Backlog is filled up.

Even if you don't do that, the developers can 'begin' their work and consult the test case part of the way into their development. It doesn't take too long to write an acceptance test case for a typical story.

re: When

December 18, 2008 by Ilja Preussre: (not verified), 5 years 44 weeks ago
Comment id: 2134

"But when should testers write scenarios?"

The answer is, to use a phrase from Lean Software Development, "at the last responsible moment". Which in this case is as shortly before they are needed as possible - shortly before the iteration the features will get implemented.

Writing them earlier would be wasteful, for at least two reasons: you are investing work into things that

- don't pay back soon, and
- have a high probability of experiencing change before they even have a chance to provide value (they might not even be needed at all, because the feature might actually never get implemented)

As an aside, tests shouldn't be written by testers in isolation, but at least in close collaboration with the customer/product owner.

Re:

December 19, 2008 by Anonymous (not verified), 5 years 44 weeks ago
Comment id: 2135

Thank you so much for this useful information.

I am new to the agile methods. Can I ask please if the acceptance tests can not be automated, when we will ensure that they are passed? Is it just before releasing or can be done earlier (in the development)? Please provide explanations as much as you can.

Regards,
Sultan

Who has to write Acceptance Cases?

April 30, 2010 by surya (not verified), 4 years 25 weeks ago
Comment id: 6483

Who has to write Acceptance Cases? Whether QA or BA or Client or PM? Because, just by seeing user stories, its very vague to write Acceptance test cases?

acceptance test plan

July 31, 2010 by panget (not verified), 4 years 12 weeks ago
Comment id: 8030

please post more of the acceptance test plan..i can't understand

Hi Sandra-If you and the team

March 2, 2012 by NOnn (not verified), 2 years 33 weeks ago
Comment id: 21109

Hi Sandra-
If you and the team think it will help then I'd suggest giving it a try. I'd keep it pretty lightweight and use it mostly for discussion along the lines of OK. if we finish this by Thursday (let me put a mark here on the whiteboard) that let's us start the other on Friday and that means we just have to do such-and-such before the end of the iteration next Thursday... I suspect if you try that a few times you'll find that drawing it was useful as a way of providing context to your discussion but that the discussion. not the chart. was the value. comparateur forfait forfait sans engagement forfait mobile illimite sms illimite forfait mobile internet forfait bloque rio bouygues rio orange code rio sfr rio bouygues rio virgin calculer imc portabilite

I am happy to find this post

March 21, 2012 by Anonymous456 (not verified), 2 years 30 weeks ago
Comment id: 21441

I am happy to find this post very useful for me, as it contains lot of information. I always prefer to read the
quality content and this thing I found in you post. Thanks for sharing

Sale h13 Tool Steel

Thus, we will see that they

March 27, 2012 by dweor (not verified), 2 years 29 weeks ago
Comment id: 21510

Thus, we will see that they are a team that does have an extraordinary means and the necessity for us to give support. Grain Milling Equipment

The herbal vaporizer is

May 21, 2012 by Sam O'neal (not verified), 2 years 22 weeks ago
Comment id: 22281

The herbal vaporizer is super easy to be used. First, plug the device and then turn it on. Wait for 3 minutes until it warms up, load the bud, then switch and wait for the bag will be filled with vapor. Pull the air bag off and inhale.

your thorough illustration

July 13, 2012 by Buying Kratom (not verified), 2 years 14 weeks ago
Comment id: 23332

your thorough illustration and explanation needs to be appreciated.
Buying Kratom

The post is written in very a

July 19, 2012 by Anonymous (not verified), 2 years 13 weeks ago
Comment id: 23419

The post is written in very a good manner and it contains many useful information for me.
slideshow on mac

I really loved reading your

July 19, 2012 by Anonymous (not verified), 2 years 13 weeks ago
Comment id: 23430

I really loved reading your blog. It was very well authored and easy to undertand. Unlike additional blogs I have read which are really not tht good. I also found your posts very interesting. In fact after reading, I had to go show it to my friend and he ejoyed it as well!
this cool website about ipod touch

afashion-dresses.com

July 23, 2012 by mudassar (not verified), 2 years 13 weeks ago
Comment id: 23485

afashion-dresses.com Thanks for sharing this useful information! Hope that you will continue with

Thanks for sharing the tips

September 11, 2012 by Thomas (not verified), 2 years 5 weeks ago
Comment id: 23800

Thanks for sharing the tips. I thin your points are worth considering. Hope these help.
http://www.leatherfads.com/mens-Leather-Shirts.aspx

The phases of development

September 18, 2012 by tinuous (not verified), 2 years 4 weeks ago
Comment id: 23930

The phases of development occur continuously in iterative cycles involving creating requirements. 192.168.1.1

You should be quite tolerant

September 24, 2012 by Anonymous (not verified), 2 years 4 weeks ago
Comment id: 24010

You should be quite tolerant when using cell phone lookups. They tend to be a great source of phone numbers.Retro Sleuth reverse phone search

www.bestrecoverysoftwares.com

September 25, 2012 by www.bestrecoverysoftwares.com (not verified), 2 years 3 weeks ago
Comment id: 24018

www.bestrecoverysoftwares.com I would like to appreciate your hard work you did write this post, Thanks for sharing this valuable post.

This is one of the right

November 9, 2012 by misbaharman (not verified), 1 year 49 weeks ago
Comment id: 24556

This is one of the right articles you can gain in the net explaining everything in particular regarding the subject. I thank you for action your abstraction sharing your thoughts and ideas to a lot of readers out there.
Click here

Congratulations! You got

November 12, 2012 by Iphone 5S Accessorie (not verified), 1 year 49 weeks ago
Comment id: 24570

Congratulations! You got yourself an Iphone 5S Accessorie. You finally have managed to buy one of the snazziest purchases of the decade! You sure might have sat there looking at it for a while, gazing at this sleek piece of technological wonder and its high-tech novelty with awe and admiration Groovy! You take it in your hands, feel the smooth material, switch it on, and hold it with pride and great enthusiasm.

Some of what I have written

November 13, 2012 by dainelchristianw (not verified), 1 year 49 weeks ago
Comment id: 24618

Some of what I have written about is state-of-the-art, and you might not even find it on the usual pro-tech or transhumanist websites like kurzweilai.net, hplusmagazine.com or acceler8or.com. e.g. I recently wrote about unsupervised semantic parsing (and indirectly about unsupervised ontology induction), which is a BIG BIG DEAL in A.I. research... but is not exactly the sort of thing you will see discussed on kurzweilai.net, for instance.
Click here

thanks for good article

November 14, 2012 by healthelectron (not verified), 1 year 48 weeks ago
Comment id: 24640

The less your laptop, it will be easier to buy, as it can accommodate a wide range of laptop sleeves. The largest are the most difficult to put into a laptop sleeve, especially because they can participate in most of the messengers and briefcases bag manufacturer

B2B marketplace

November 15, 2012 by shawn07 (not verified), 1 year 48 weeks ago
Comment id: 24665

So many ideas from so many different people around the world. Isn't it great just fantastic. Thanks you for sharing your comments.

B2B marketplace

nice comment

November 16, 2012 by Contextual Link Building (not verified), 1 year 48 weeks ago
Comment id: 24688

It doesn’t matter whether you’re getting

The "Clueless or Clued Up:

November 22, 2012 by Anonymous (not verified), 1 year 47 weeks ago
Comment id: 24829

The "Clueless or Clued Up: Your Right to be informed about contraception" study prepared for World Contraception Day (WCD) reports that the number of young people having unsafe sex with a new partner increased by 111 percent in France, 39 percent in the USA and 19 percent in Britain in the last three years.

bayan giyim-evim şahane-20 dakika izle-chat-20 dakika-evim şahane-evim şahane

It really is good to possess

December 11, 2012 by Anonymous (not verified), 1 year 45 weeks ago
Comment id: 25113

It really is good to possess the capacity to examine a great high quality article with practical specifics on topics that plenty are interested on. The stage that the information indicated are all first hand on reside experiences even guide a lot more. Proceed performing what you do as we really like..!
HP Certification www.exam2home.com/HP.htm
IBM study guide www.exam2home.com/IBM.htm
Juniper exam material www.exam2home.com/Juniper.htm
Microsoft training www.exam2home.com/Microsoft.htm

Fantastic site. Plenty of

January 16, 2013 by josefsmith (not verified), 1 year 39 weeks ago
Comment id: 25516

Fantastic site. Plenty of useful information here. I am sending it to a few buddies ans also sharing in delicious. And certainly, thanks in your effort!
tempurpedic weightless reviews

Rolex Watches

January 21, 2013 by Rolex Watches (not verified), 1 year 39 weeks ago
Comment id: 25938

This table design is quite elegant, 44 mm dial design inspired by old racing dashboard, a strong dynamic to create a retro atmosphere of the cold industrial age.
http://www.qswatches.com/rolex-watches.html

Thanks so much for sharing- i

January 21, 2013 by Boca Raton CPA (not verified), 1 year 39 weeks ago
Comment id: 25942

Thanks so much for sharing- i love acceptance- Boca Raton Accountant

Rolex Watches

January 22, 2013 by Rolex Watches (not verified), 1 year 39 weeks ago
Comment id: 25954

wonderful and this article is very interesting.
Rolex Watches

some genuinely nice and

February 25, 2013 by josefsmith (not verified), 1 year 34 weeks ago
Comment id: 26428

some genuinely nice and useful information on this website , also I think the design holds fantastic features.
what is the best mattress brand

Acceptance testing is a

March 4, 2013 by Anonymous (not verified), 1 year 33 weeks ago
Comment id: 26558

Acceptance testing is a black-box testing performed on a software prior to its delivery. It involves running a suite of tests on a completed system (ref: Wikipedia). These test suites are made up of multiple tests or test cases. Each test case consists of a sequence of steps to perform which emulate the use case that is being tested; it also contains input data (if required) as well as the expected output. The result of a test case is either a pass or a fail.

WHY?

Although acceptance testing traditionally takes place at the end of development or major milestones, in agile software development acceptance testing needs to be performed at the user story level. There are several reasons for why this is important:
e-papierosy
e-papierosy
e-papierosy
e-papierosy
e-papierosy
e-papierosy
e-papierosy
e-papierosy

Really your post is really

April 16, 2013 by Atlanta Roofers (not verified), 1 year 27 weeks ago
Comment id: 27042

Really your post is really very good and I appreciate it. It’s hard to sort the good from the bad sometimes, but I think you’ve nailed it. You write very well which is amazing. I really impressed by your post.

Good ideas. I will share

April 16, 2013 by paper writing (not verified), 1 year 27 weeks ago
Comment id: 27043

Good ideas. I will share them.

I love to read your article.

April 21, 2013 by Link Building Service (not verified), 1 year 26 weeks ago
Comment id: 27117

I love to read your article. This is the perfect blog for those who want to know about this topic. Thanks for posting.That is very interesting Smile I love reading and I am always searching for informative information like this.

Acceptance testing is a

April 23, 2013 by better (not verified), 1 year 26 weeks ago
Comment id: 27142

Acceptance testing is a black-box testing performed on a software prior to its delivery. It involves running a suite of tests on a completed system (ref: Wikipedia). These test suites are made up of multiple tests or test cases. Each test case consists of a sequence of steps to perform which emulate the use case that is being tested; it also contains input data (if required) as well as the expected output. The result of a test case is either a pass or a fail.
1Z0-899 || 000-186 || 000-189 || 000-195 || 000-559 || 000-598 || 000-821 || 000-G40 || 000-M605 || 000-M608

The acceptance test cases

May 4, 2013 by Harryportar (not verified), 1 year 24 weeks ago
Comment id: 27398

The acceptance test cases need to be reviewed and approved by the Product Owner in order to ensure that the coverage is complete. 000-654 || 000-667 || 000-957 || 000-M222 || 000-N35 || 001-ARXConfig || 00M-249 || 00M-648 || 00M-657 || 117-201

000-121 || 000-129 || 000-463

May 13, 2013 by Brett (not verified), 1 year 23 weeks ago
Comment id: 27441

This allows the developers to

May 17, 2013 by ironman (not verified), 1 year 22 weeks ago
Comment id: 27567

This allows the developers to get better understanding of the requirements as compared to what they might otherwise understand from just the User Story. LOT-442 || JN0-370 || JN0-380 || JN0-633 || 70-341 || 70-342 || 70-521 || MB4-873 || MB4-874 || MB5-700

The information provided on

May 21, 2013 by Mike (not verified), 1 year 22 weeks ago
Comment id: 27857

The information provided on this blog is 100% accurate and up-to-date. I am so obsessed of reading this blog that is why I am recommending it to my friends and family members.
buy real facebook likes

I am so glad to see this post

May 31, 2013 by Mike (not verified), 1 year 20 weeks ago
Comment id: 28085

I am so glad to see this post on your blog. It is highly informative and contains latest information on the discussed topic. Keep updating such types of posts on your blog :) !!
amarres de amor

Kruger Park Lodge

May 31, 2013 by Kruger Park Lodge (not verified), 1 year 20 weeks ago
Comment id: 28101

Hurrah! Finally I got a website from where I be able to truly obtain helpful facts regarding my
study and knowledge.Kruger Park Lodge

his article has me looking

June 2, 2013 by Anonymous (not verified), 1 year 20 weeks ago
Comment id: 28167

his article has me looking from the past and only now I found it. Improve the quality of your articles and continue to create a more interesting. Korek Api Gas Fighter Indonesia | Margahayuland

Reply to comment | Agile Software Development

July 28, 2013 by vuelos a india (not verified), 1 year 12 weeks ago
Comment id: 28461

Good day! Would you mind if I share your blog with my myspace group?
There's a lot of people that I think would really enjoy your content. Please let me know. Thank you

good one

July 31, 2013 by Check this out (not verified), 1 year 11 weeks ago
Comment id: 28487

Fantastic article, this is so well explained that even my kids could follow it, thanks and keep up the great work!

nice

July 31, 2013 by Check this out (not verified), 1 year 11 weeks ago
Comment id: 28488

Great information on your site here. I love this post because we can get some useful information from your blog. I expect more post from you guys.Check this out

Post new comment

The content of this field is kept private and will not be shown publicly.
  • Allowed HTML tags: <a> <b> <i> <em> <strong> <cite> <code> <ul> <ol> <li> <dl> <dt> <dd> <img> <br> <blockquote>
  • Lines and paragraphs break automatically.
  • Web page addresses and e-mail addresses turn into links automatically.
  • You can enable syntax highlighting of source code with the following tags: <code>, <blockcode>. Beside the tag style "<foo>" it is also possible to use "[foo]".

More information about formatting options

By submitting this form, you accept the Mollom privacy policy.

Best of AgileSoftwareDevelopment.com