Setting up a product test

Since in the last article we discussed the importance of action standards in product tests, let’s remain with product tests. How does one set up a test design?

It’s quite easy, if one is dealing with just two or three products. In this case, you just test one product after the other; bearing in mind, of course, that you need to rotate the order of products from one respondent to the next in order to prevent positional bias. This procedure of exposing a respondent to a product and having him/her evaluate it before proceeding to the next product is known as a sequential monadic test design.

In practice, a simple rotated test design for three products would look like this:

So, when dealing with few test products, every respondent can test and evaluate every product. However, this becomes impractical when dealing with a large number of test products. In a central location test, you could not expect any respondent to taste and evaluate more than two or three different products. And yet, your client insists on having a large number of products evaluated…

The way out of this bind is a round-robin test design with matched cells, which will allow you to include a large number of products in your test.

Here is an example of a round-robin design:

Although you have only 20 respondents per cell; i.e. combination of tested products, in      the end  each product will have been tasted and evaluated by 80 respondents. And every possible combination of test products would have been accomplished. Your total sample would be 200 respondents.

Round-robin test designs go hand-in-hand with a matched cell approach.  You must ensure that the cells are as similar as possible in terms of respondent demographics; e.g. if you have 10 males and 10 females in the first cell, you should have that precise gender distribution in every cell… Other parameters could include socio-economic class or main brand usage, etc.


  1. Hi there,

    I have read your article on setting up product test.
    We are new enterprising group trying to cut our a niche in completely new product in E. African Market.

    How do we want to bring up new product to the market and are wondering, how do we go about it, especially in:-
    Identifying target market
    Introducing the product to our target
    Set about selling the product.

    Kind regards,

  2. Guneet says:

    Hey Margit,

    Thanku sooo much. You explained things very nicely.

    I have a question for you.

    What if I want to do ranking of my products.

    Can I do it?
    Since every person has not tested my product, can I do preference ranking of all products?
    Lets say I have 4 products, I make pods of 3. Number of combinations at the end = 4C3 = 4

    Each person will test a combination of 3 products.

    What do I do for preference ranking?

  3. soniya says:


    Its a very intersting way of testing many products. Could you help me with he best way to analyse the results? Since every product is not tested by the sam erespondent and we still need a ranking….

  4. When people are sitting at home and desire to find
    something funny to observe, look over the comedy
    movies in the streaming part of Netflix to find something which fits the bill.
    There is often a workaround to the, if you are using an American IP address, then your site won’t observe that you are accessing externally of
    its borders. Could this be the type of movie you
    wish to see around the big screen.

  5. Hassie says:

    Oh my goodness! Impressive article dude! Many thanks, However I am going through troubles with your RSS.

    I don’t understand why I cannot join it. Is there anyone else having
    similar RSS issues? Anybody who knows the answer will you kindly
    respond? Thanks!!

Speak Your Mind