Archive for December, 2008

Take two (surveys) and call me in the morning

Wednesday, December 31st, 2008

Here’s another one of those customer experience stories that I’ve been shaking my head about for a month or so. It’s also a story about how NOT to do customer research - two marketing stories in one!

I was at my doctor’s office for a visit recently (my third such in as many months…don’t ask) and when I checked in for my appointment I was handed a clipboard with two, one-page surveys attached. The receptionist behind the window (call her Sally for narrative sake) asked that I fill them out while waiting to be called in for my appointment. I asked what they were for. Sally answered that the first was a “phone survey”. Being asked to take a phone survey while standing there in-person naturally confused me so I asked Sally to clarify. She said it was a survey about their phone system. Albeit still confusing, I discerned (on my own) that they wanted feedback on my experience with their interactive voice response (IVR) system when making appointments, getting information, leaving messages etc. The second, I was told, was “some research” one of the doctors in the practice was conducting. She then offered that if I had already completed a “PHQ-9″ survey that I shouldn’t do it again. Having never heard of anything even remotely similar I took the clipboard and sat down.

I began to fill out the surveys. The first was straight forward and asked, from my professional perspective, meaningful questions that related directly to my actual experience. It was short and to the point and took all of a minute to fill out. There were nine quantitative and one final, qualitative question. (Note: this practice’s IVR system is simple and pretty good; as good as these things can get in my opinion…that’s what I told them on question 10.)

I flipped the page to the second survey and started reading. It had only PHQ-9 printed on the header. There was neither a description nor any directions. The first question was my name. The second was, well, very personal. So were the third, and the fourth…all the way to 20! Having a wife who used to rep Prozac for Lilly for a number of years I recognized that the survey was asking about the incidence of the symptoms of clinical depression–a worthy topic for a doctor to be researching for sure.

I paused to consider the subject matter and the fact that my name was requested. I looked at the bottom of the page for the privacy disclosure (remember HIPPA?) Surprised not to find any, I walked back to Sally’s window and asked her specifically what the survey was going to be used for and was my name required. To my first question she answered, “I don’t know, I was asked to hand these out to everyone who checked in.” I then further inquired about which doctor was commissioning it. To this Sally replied, “I don’t know,” and turned back to the work she was doing. So I asked her my second question (is name required) again. Sally turned to me, a bit annoyed, and said simply, “yes”. “What happens if I fill it out without my name?” I countered. And with all the frustration Sally could affect she said, “It won’t be counted.”

As a patient I wanted to ask more questions: won’t be counted toward what? Will my responses be posted somewhere available to the public? Is this part of a larger survey this doctor is participating in? Sally, clearly, wasn’t going to have any of the answers, and the pain I was going to feel in the process of getting them was probably more than any I might receive on the other side of the office door.

As a marketing professional I wanted to ask even more questions: is the survey testing some hypothesis? What is the target sample size? What respondent criteria was the survey designed around? What is the chi-squared? (Not really, but throwing that stat term around always seems to impress our research vendors…maybe it’s having the same effect on you??)

None of us would expect even a professional research administrator to know the answers to the hard core research questions, but certainly Sally needed to be better trained to answer, even simply more informed about, the basic FAQs. This is especially the case with a survey regarding such a private matter (we’re not talking about a post-service questionnaire from Jiffy Lube here!) In about five minutes Sally could have been educated about everything she needed to know in order to answer 95% of the questions she might be asked by patients.

In addition to being left with a very low opinion of the research acumen of my doctor’s office (not to mention my extreme doubts about the efficacy of the research itself), I was disappointed with the customer experience I just had. And yes, although not often referred to as such in a healthcare setting, I am their “customer”. Research can be a very valuable customer touchpoint on a number of levels if administered well. Done poorly, it can have the exact opposite effect. If you’ve deemed your research objectives to be important enough to take your customers’ time and effort, take some of your own time and, if necessary, money to ensure they are free to focus on the topic at hand and are not distracted by poor handling. Your findings will be more accurate and your customers will appreciate it. You will make them happier to be your customer. This is a huge return on a small investment.

-Dave Goldberg

Kind of a chicken and egg thing

Sunday, December 14th, 2008

If you’re like me and you read some of the paper, watch a little TV news and visit a couple of online news outlets every day, you’re probably thinking that we’re all doomed. Everything seems to be going to hell, and quickly. “How can it be THIS bad?” I ask myself often these days. I’m not in denial, I know it’s bad. After all, we are in a recession (and if you hadn’t already realized we were in one, maybe say, because you were in a deep-sea submersible since last winter, a bunch of economists officially told us so a couple of weeks ago. Whew…am I glad they did!) This is my third such event since I started scratching out a living on my own. Based on this vast experience I could tell, evidently before the economists could, that this was definitely one of them, and a bad one at that. But again, how can it be THIS bad? — as bad as I read, hear and see in the media everyday?

With this on my mind pretty much all the time, I was very happy to read an article by David Carr of the New York Times, Stoking Fear Everywhere You Look (December 7th). Here’s the link to the piece. The article was posted on Facebook by my friend and talented professional colleague Tim King (Tim’s own blog can be found here). Carr writes that to a much greater extent than in earlier downturns, we’re inundated with media that allow the doomsday messages to be delivered to our eyes and ears much faster and in many more places. The speed and furiousness of those messages is too much for us and it becomes hard for us to make sense of it all. So we get confused, get panicky and then fall in line and start, in fact, acting like there’s a recession. We buy less, pull our money from the markets, and hide under our desks like they taught my father to do in elementary school after Pearl Harbor (you know, in case the Japanese Navy decided that Springfield, Massachusetts should be their next target). A self-fulfilling prophecy if there has ever been one.

By the way, and not incidentally, I blogged about this very issue a few months ago and suggested that no one panic as the financial markets were collapsing around us. Clearly none of the million (or so) readers of this blog took my direction!! It seems we have all indeed panicked. Here’s the post if anyone wants another chance to comply.

So what came first, a real recession or the reporting of such? Carr, who covers the media business and certainly has an informed perspective on the issue, connects the depths of this recession to the media’s coverage of it to date. After digesting the article I sent the link (again via Facebook) to Eric Blom, a journalist and business editor of the Portland Press Herald, our daily newspaper here in Southern Maine. In my message I asked him what his thoughts were on the issue. Please note: he and I have no professional relationship and he did not respond to me in his capacity as an editor of the paper; rather, as a smart citizen who has something to say about it. I know Eric by reputation and have met him once casually. And as I mentioned we are Facebook “friends”. Eric responded with his own informed, thoughtful and well-written take on this “chicken and egg” question. His entire response is below. I know I’m asking everyone to do a lot of reading here, but reading is good for you (that’s what I tell my kids). I’m interested in your own thoughts on the matter.

-Dave Goldberg

Hi David,

Thank you for sharing that interesting article. It really did spark a lot of thoughts for me, about the changing communications landscape, the role of consumer psychology in the economy and the history of financial downturns.

My conclusion would be different, though, than the one the author arrived upon. To me, modern communications – the proliferation of media, social networking, 24-hour commentary, etc. – is doing one thing: Ripping the Band-Aid of financial recovery off faster than in the past.

Economic problems don’t start because of the public psychology. They have their roots in some real-world problem. A famine. A war. Or, more commonly, greed coming home to roost.

The Dutch tulip bulb craze kicked off an economic decline because, at bottom, tulip bulbs don’t intrinsically have the value that people put on them as an investment. (In February 1637, tulip contracts sold for more than 20 times the annual income of a skilled craftsman.)

Florida real estate speculation, rampant purchasing of stocks on margin and other foolish financial practices kicked off the Great Depression.

And, more recently, the pouring of money into loans that people couldn’t possibly afford caused an explosion in real estate values that couldn’t possibly be sustained. People defaulted, prices declined and we were off to the races.

Of course, the idea that mass psychology drives markets and economies is widespread and has some truth to it. Consumer spending is two thirds of our economy. And people can act irrationally as individuals and as a mob, to the detriment of the collective population and themselves, when frightened.

My dad, for example, sold off all his stock after the Black Monday market collapse. The market recovered within the year, but he’d lost a large fraction of his nest egg.

People used to call sudden economic crises “panics,” as in the Panic of 1893 or 1907. FDR warned us that the only thing to fear is fear itself. People call me every day to say we shouldn’t run stories about how bad the economy is doing because that’s causing (or at least making worse) the situation.

I disagree.

I am aware that when I assign a story, it creates buzz about something, magnified many times: the radio reads from the paper in the morning, the television produces their own version of the story that evening, the wire picks it up, other newspapers pick up on the idea, people tweet about it with friends and share their concern with others via Facebook, IM, texting and conversation over lunch.

But if you look back at history, the thing that really fueled fear and bad decision-making was a lack of information. People didn’t know what was going on or how the system worked. So they really hunkered down.

Recessions of 5, 6 or 7 years were common. We had one in the late 1800s that lasted 23 years. The Great Depression lasted 10.

People weren’t wired back then. People weren’t being bombarded with the bad economic news. In fact, the hot media of the day – newspapers – were often boosterish, actively trying to put a good face on the news because their publishers felt that would help their local economies grow.

Think of the character Jimmy Stewart played in It’s a Wonderful Life. George Bailey has to try to explain the banking system to a crowd of his neighbors making a run on the savings and loan.

Now that everybody has telephones, television sets, radios, Blackberries and the Internet, recessions have been lasting a year or two.

It hurts emotionally to hear about all the problems that exist. People do hunker down, and that slows consumer spending and business investment in the short term.

But it also gives people the motivation to act to correct deficiencies in public policy, stimulate the economy and to find ways to innovate and be entrepreneurial in their own lives.

The constant hand wringing and chatter, as bad as it feels, rips the Band-Aid of recovery off far more quickly than if we still lived in an age when it took months to get a letter from one part of the world to another.

Thank you again for the article and the chance to share my two cents.

I hope you are well and enjoying the holiday season.

Best wishes,

Eric