By Steve Outing
While I do occasionally use the Wall Street Journal iPhone app to look specifically at what WSJ.com has available, on the web I rarely visit the website as a destination (and I am not currently a paying subscriber to either the newspaper or the website). Instead, WSJ.com articles tend to come to me.
That is, I see links to recommended WSJ.com articles on news aggregator sites like Google News or Digg, or in blogs, or in Twitter posts from those I follow, or in my Facebook Newsfeed as recommended by my Facebook friends.
My normal behavior is to click through and read the interesting-looking WSJ.com article. With the recent change by Google to its “First Click” program, I can now read up to 5 articles elsewhere on the site if I choose to click around, before getting to the site’s pay wall. But it’s rare that I go surfing around the rest of the site after reading the article I came for.
This week, I indeed clicked through to a WSJ.com story that I saw linked on a Twitter post, and got presented with a pop-up offer to take a survey about my usage of the site. (I think that appeared as I left the site, but can’t recall for sure.) I took the bait, and was shocked as I answered questions that the survey did not allow me to report my method of using WSJ.com; the data the company will get from it is seriously flawed, because the survey excluded tracking behavior like mine that is widespread among experienced Internet users.
If the link above allows you to take the survey, you’ll see that if you identify yourself as a non-subscriber to both the Wall Street Journal print edition and WSJ.com, the line of questioning will assume that you are a regular destination visitor to the site, and asks things like:
- What days do you typically visit WSJ.com?
- What sections do you typically view on the site?
- How often do you visit the site? … And so on.
By the time I reached the end of the survey, I realized that I was not allowed by the survey to indicate my actual behavior and use patterns. While I typically read several WSJ.com articles a week, it’s entirely unpredictable, because I don’t have a habit of going to WSJ.com, but rather I get haphazardly referred to specific articles on the site that others (individuals or aggregators) have recommended. One week I might read 20 of its articles, the next zero.
In the final field was a free-form comment field where I explained my actual usage of WSJ.com, but the data that I added to the survey results — even though I answered every question accurately and truthfully — gave no clue to my actual behavior with the WSJ brand.
It’s as though whoever wrote the survey questions — or approved them — did not want to have the results show how many web users actually behave. That might work against parent News Corp.’s plans to shove much of its other news properties’ website content behind paywalls.
WSJ.com survey = FAIL.