Steve Cuno Add Comment My son Jeff performed his earliest recorded scientific experiment at age five. After hearing about a friend’s punishment, Jeff wondered if washing one’s mouth with soap really did make it impossible to swear. So he walked into our main bathroom, treated his mouth to a generous helping of Dove, and, to his amazement, found he could still say “damn.” A myth was busted, and a healthy skeptic was born. Marketers could learn a thing or two from Jeff. Next time you hear someone say “no one reads copy any more” or “upscale people don’t respond to obnoxious late-night TV spots,” or “if your advertising is truly creative it will sell,” don’t just buy it. Check it out. Test it. You may find that “what you’ve always heard” ain’t, in the immortal words of Porgy, necessarily so. Who knows. Upon completing your experiment, you may, like Jeff, shake your head in wonder and say, “damn.” How to Do Unreliable Research 12/02/2009
According to a new Adweek survey, 50% of respondents say that advertising "rarely" motivates them to switch brands, 11% say that advertising "never" influences their brand choices, and people 18-34 say they are most likely to be "swayed by ads." I suspect there may be some truth in Adweek's conclusions. But, if so, their methodology doesn't establish it. The worst way to learn what influences people is to ask them. People don't know what they do, why they do it, or what makes them do it. But they sure think they know! So, when you ask, they'll give you an answer, and most likely they will mean what they say. Trouble is, they are often mistaken. For a valid, reliable way to learn what influences people, put them in a real situation. Do not let them know that a test is afoot or that anyone is watching. Then note what they do. Our firm recently conducted such a test for the parent company of two national brands that you have heard of. They wanted to know which of the two brands was stronger. We divided their market into three segments. All three received identical offers; the only difference was whether the offers came from National Brand A, National Brand B, or Unknown Brand C. Then, we counted orders. All segments bought at the same rate. We repeated the test and obtained the same results. Post analysis showed that the brand made no difference; only the offer did. I might add that no one in the parent company was pleased. Some had championed one brand, some the other. The finding that neither brand had power offended both camps. Getting to the truth doesn't always make an agency popular. I should also add that this test in no way proved that brands are powerless in general. This was but one case. But it certainly suggests that you should challenge whether your brand has as much power as you'd like to believe. Back to the research. Since I suspect Adweek was on to something, you might ask, why quibble over the methodology? The reason is that I can't be sure of a conclusion, even one that sounds reasonable, that is attained by faulty methodology. When I was in grade school, I heard that mixing yellow and blue paint makes green paint. I verified it by stealing my older brother's water color set (don't tell him—he still doesn't know) and mixing up some green for myself. I could have flipped a coin. Heads, yellow and blue make green; tails, they don't. I might have gotten the correct answer. But there would have been a 50% chance of getting the wrong one. I deal with the science behind fallacious versus reliable research in chapters 8 and 9 of my book Prove It Before You Promote It, so I'll stop here in deference to those who have read the book, and to try and influence those who haven't to buy copies for themselves and all of their friends. Right now, if you please. Steve Cuno | ArchivesJanuary 2012 Looking for older posts? CLICK HERE.
|


RSS Feed






