Thinking Out Loud

March 25, 2014

Be Wary of Surveys, Studies, Statistics

cartoonkjv

Last week a number of Christian websites, blogs and media outlets ran with a story about a research study at the — deep breath — the Center for the Study of Religion and American Culture at Indiana University–Purdue University Indianapolis; with the primary takeaway that the King James Version of the Bible is the most-read in the United States and therefore most-popular English Bible translation.

My reaction when I read this, summarized at Christianity Today, was “What have these people been smoking?” Alas, the study was based in Indianapolis, not Colorado or Washington.

As someone who has devoted a lifetime to various aspects of Christian publishing, these results are so completely counter-intuitive. I guess all those Gideon Bibles in the drawer underneath the motel telephone are getting used after all. Maybe now the King James Only movement can stop campaigning and say, “We rest our case.”

But the study has to do with what version the survey group claimed to be reading. In a library, the book most-read might be the dictionary. Among our aforementioned motel guests, it might be a telephone directory. If they survey dentists’ offices, it might be nondescript magazines from 2007. None of these things turn up on the bestseller lists because nobody is interested in what people use for reference, people want to know what items in print are of significant interest that they cause people to part with their money to obtain them.

Personally, I think time spent follows money spent. I think the sales data, which in most parts of the English-speaking world still supports the New International Version as the top English translation, is of greater interest. I also have a hard time believing that the majority of searches at BibleGateway.com have KJV set as their default.

Has the KJV greatly influenced English and North American culture? Absolutely. We celebrated that in 2011, recognizing the 400th anniversary of the translation that has outlasted most others in the past two millennia. It’s often quoted and my own online searches often revert to KJV because that’s how I memorized the verses as a child.

But it’s time to move on. Studies like this one — all 44 pages of it — only confuse the central issues.

Furthermore, the study is biased in several places. On the topic of where respondents find help and clarification in their Bible understanding, choices are clergy, commentaries, study groups, electronic media and the internet. I’m sorry, but my go-to resource if a passage is muddy is to use other translations. As one person taught me a long time ago, “Let the translators do the work for you.” That’s also the point behind parallel Bible editions and sites like BibleGateway, BibleHub, Biblios, etc.

I also know from decades of anecdotal experiences with teaching people about Bible translations that many people simply don’t know the names of any of them, and if asked, will answer “King James” or worse, “Saint James” because that’s the only answer they can give. Furthermore, the study has been widely criticized for not allowing the New King James Version (NKJV) as an option. The surveyors also showed a rather glaring ignorance for their subject matter by referring to The Living Bible (sic) instead of the New Living Translation (NLT), the version that is currently number one in the bookstore market where I reside.

…But then, here’s the thing. Just days after publishing a news story on the study, the same website, Christianity Today, released Three Ways to Recognize Bad Stats. Ed Stetzer suggested:

1. Be Wary of Statistics in Promotions
2. Be Wary of Stats that Cannot be Verified
3. Be Wary of Stats that do not Line up with Reality

It is the third category in which I place the Bible reading study. I would also like to propose a couple of friendly amendments to Stetzer’s article:

4. Be Wary of Stats Backed by an Agenda

Too many studies, surveys and statistical compilations are presented by people or groups who have predetermined the outcome they wish to see.

5. Be Wary of Stats Designed to Invoke Fear

There are two reasons why people do this. Some rally the troops by suggesting there is a common enemy we face in order to galvanize support for a particular ministry that can stem the tide and reverse the situation. Sadly, some Christian research firms do this in order to sell survey data. If it bleeds it leads. This is best seen in the tension between Barna Research’s David Kinnaman and sociologist Bradley Wright, the latter titling one of his books, The Sky is Not Falling.

I should also say that I don’t fault Christianity Today for the confusion, especially since they write me a weekly paycheck for the Wednesday Link Lists. In the former case, they are simply reporting the study, and writer Sarah Eekhoff Zylstra possibly plays her hand by saying, in the 4th paragraph, “The numbers are surprising;” and then links to a 2011 CT story by — wait for it — Ed Stetzer reporting on the NIV’s dominance. In the latter case, Stetzer is simply being pastoral, warning the CT-readership flock that they can’t believe everything they read.

 

Note to KJV-Only trolls: This is not the blog you’re looking for. Comments will be deleted.

 

About these ads

2 Comments »

  1. “I also have a hard time believing that the majority of searches at BibleGateway.com have KJV set as their default.” I would venture to say that KJV only readers, more than any other Bible reading group, do not have computer or internet access.

    My economics teacher in high school said that while figures don’t lie, all liars can figure. You are right in addressing the way raw data can be manipulated. I guess more to your point is the way the data was obtained. I often lament that the NIV is the best selling Bible in America not because it is necessarily the best translation but the best marketed. Beta was a superior video format to VHS, but they were long on engineers and short on marketing specialists.

    Just last night we saw a nice looking Chrysler minivan parked in front of Applebee’s, with a bumper sticker right across the front of the hood proclaiming the King James Bible to be the only perfect word of God. 1) Bumper stick on the hood, and 2) King James Bible, not version. I was a little surprised they were eating at a place with a bar inside. I know my father would not have.

    Comment by Clark Bunch — March 25, 2014 @ 9:45 am

    • They all use the term “King James Bible” as I’ve been told because “King James Version” acknowledges the existence of the other translations. Denial.

      The latest Beta/VHS distinction would be Tassimo vs. Keurig. I don’t drink coffee, but apparently one brews a better cup while the other has had better marketing in terms of choice of flavors.

      Comment by paulthinkingoutloud — March 25, 2014 @ 6:23 pm


RSS feed for comments on this post. TrackBack URI

Your Response (Value-Added Comments Only)

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

The Silver is the New Black Theme. Blog at WordPress.com.

%d bloggers like this: