Split Testing

Was talking to a client and graphic designer yesterday about split testing. Here is a great example of something to test and the reson for it from a newsletter I received this morning.
Dear Direct Response Letter Subscriber:
I have dealt with this complaint before, but it comes up every now and then, and recently, I heard it from a potential client
who wanted to sell Web services to marketing managers at Fortune 500 and middle market corporations.
“Our copy is too simple,” the client said of his web site. “This sounds as if we are talking to small business owners. Our
audience is senior managers at Fortune 500 companies. The tone needs to be much more professional and sophisticated.”
Oh, really? Says who?
One of the biggest misconceptions about writing to CEOs, CFOs, and other senior executives is that they speak some alien language that has only a passing resemblance to the conversational or written English you and I use every day … and that, to sell to this special audience, you have to emulate or copy this special language.
But the reality is: C-level executives put their pants on one leg at a time just like everyone else. They read the same blogs you do … go to the same movies … listen to the same radio stations … watch the same TV shows.
Yes, it’s smart marketing to understand your audience and then write copy that speaks to their specific needs, fears, concerns, problems, and desires.
And you want to tailor the tone and style of your language to your audience to a reasonable degree. For instance, you wouldn’t use off-color language when writing to ministers. Or use equations in differential calculus when writing to factory
workers.
But ministers, chemists, accountants, engineers, computer programmers, while they all may speak the specialized language of their trade, also speak a common language: the English language. And that’s the language you should use when writing your copy.
How do I know I am right? The same way we know anything about direct marketing: through testing.
I have tested “plain English” copy against “high-falutin” copy numerous times over the span of my 34-year career in direct marketing … and 99 times out of 100, the same language that works for “ordinary folks” sells just as effectively to CEOs, Ph.D.s, and yes, even rocket scientists.
It is easy enough to see this for yourself. Study the controls in any market, for any kind of product. Collect as many e-mails and direct mail pieces as you can that you know to be strong controls, because they have been mailed repeatedly.
Now divide them into two piles: those written in plain English vs. those written in jargon, big words, or “high falutin” language. If you have collected a dozen samples, I guarantee that the number in the “plain English” pile will be 12 or 11 … no fewer than that … proving my point.
I once interviewed more than a hundred CEOs, including those at many Fortune 500 companies, to ghostwrite a book
Leadership Secrets of the World’s Most Successful CEOs (Dearborn). Without exception, they were all plain-speaking men and women, using direct, straightforward, conversational language in their written and oral communication – even those in computers and IT.
The world’s most respected writing authorities all agree that good writing is clear, simple, and direct.
“Clutter is the disease of American writing,” writes William Zinsser in On Writing Well (HarperCollins). “We are a society strangling in unnecessary words, circular constructions, pompous frills, and meaningless jargon.”
And what about my claim that good writing is “conversational”?
“You can’t actually write the way you talk,” writes Rudolph Flesch in The Art of Readable Writing (Harper & Row). “You can, however, put a reasonable facsimile of your ordinary talking self on paper. You can purposely put into your writing certain things that will make it sound like talk.” (He cites contractions as one example.)
One other point: as a chemical engineer myself, I have been writing copy aimed at engineers, scientists, mathematicians, systems analysts, and other “techies” for 34 years. And in all that time, I’ve never been told that the simple, plain English copy I wrote was “too easy to read.”
Of course, you can always test my claim that plain English outpulls “high falutin” language for yourself. Here’s how….
The next time a marketing manager says of your conversational copy, “It’s not professional enough,” offer to do a split test: your version against his.
Then you’ll know definitely what works best for your audience … rather than relying on his (or yours, or my) opinion.
(RG, a colleague, did this with a direct mail package aimed at executives, and his conversational version beat the “professional package” 3 to 1.)
Make sense? Of course. Doing an A/B split test always does, right?
Sincerely,
Bob Bly
P.S. For more information on how to write clear, conversational
copy, visit:
www.writebetterandfaster.com
Bob Bly
Copywriter / Consultant
590 Delcina Drive
River Vale, NJ 07675
Phone 201-505-9451
Fax 201-573-4094
www.bly.com