The Effects of Transparent Outgoing Envelopes on the Response Rate and Speed in Mail Surveys



Similar documents
Which Letter Worked Best?

Stamped Envelopes and Their Impact on Response Rates

The Effect of Pre-Notification on Mail Survey Response Rates: An Experimental Result

Improving Response Rates in Direct Mail for Fundraisers. Margaret Faulkner and Rachel Kennedy, University of South Australia Abstract

The Effectiveness of Some Techniques for Improving Mail Survey Response Rates: A Meta-analysis

Likelihood of Participating in Mail Survey Research

UNDERSTANDING MAIL SURVEY RESPONSE BEHAVIOR

Question Bank FACTSHEET 2. Methods of Data Collection in Social Surveys

Mail Survey Response Rates Using a Lottery Prize Giveaway Incentive

Survey Research. Classifying surveys on the basis of their scope and their focus gives four categories:

Victimization by Credit Card Fraud and Identity Theft in Kentucky 2008

*HWWLQJ$)RRW,Q7KH(OHFWURQLF'RRU 8QGHUVWDQGLQJ:K\3HRSOH5HDG RU'HOHWH(OHFWURQLF0DLO

Keywords personal interview; interviewer bias; interviewer effects; data quality; response bias

THE EFFECT OF RESPONDENT INVOLVEMENT IN SWEEPSTAKES ON RESPONSE RATE IN MAIL SURVEYS

Techniques for Improving Mail Survey Response Rates

Optimising survey costs in a mixed mode environment

Incentive payments on social surveys: a literature review

Which Design Is Best?

Pediatric Neuropsychologist Certified School Psychologist

Strategies for Increasing Response Rates

1100 Tips for Better Direct-Mail Marketing

A Selection from. Survival Statistics

Writing an Effective Direct Mail Appeal

50 Free Or Cheap Advertising Ideas For Offline and Online Marketing!

Probability of Selecting Response Mode Between Paper- and Web-Based Options: Logistic Model Based on Institutional Demographics

Conducting Surveys: A Guide to Privacy Protection. Revised January 2007 (updated to reflect A.R. 186/2008)

The effect of covering letter personalisation in mail surveys

The AmeriSpeak ADVANTAGE

SHOW Me the Money?: Effects of Preincentives, Differential Incentives, and Envelope Messaging in an ABS Mail Survey

The Effect of Questionnaire Cover Design in Mail Surveys

Cover Letters & Professional Correspondence E-GUIDE

Primary Data Collection Methods: Survey Design

Information for Law Firms On Direct Mail

Prenotification On The Response Rate in an Industrial Mail Survey*

Does the Credibility of the Presenter Influence Acceptance of Content in the Classroom

Spindle Professional

Reaching New Customers With Newsletters An Executive White Paper

AARPBuletinSurvey onidentitytheft. ExecutiveSummary

DIRECT MAIL CAMPAIGN PLANNER. Preparing a successful direct mail campaign. Step-by-step planning guide

Direct mail principles: 101

CASE STUDY: Best Practices A DIRECT SUCCESS: PHOENIX ART MUSEUM'S 1998 DIRECT MAIL MEMBERSHIP CAMPAIGN. I. Background

The Savvy Survey #13: Online Surveys 1

Jaki S. McCarthy. United States Department of Agriculture. National Agricultural Statistics Service

Campaign Management with GiftWorks

NJG 2014 COLLEGE WOMEN S ASSOCIATION OF JAPAN. Graduate Scholarship for Non-Japanese Women to Study in Japan 2014

Non-Profit Direct Mail

Bull s-eye! Planning and Delivering a Winning Marketing Campaign

MONOCLONAL ANTIBODIES

Client Case Studies - Education

The Power of Storytelling: Taking a Sequenced Approach to Digital Marketing

Use of Text Messaging to Increase Response Rates

Angard Staffing Gifts and Hospitality Policy

Leader s Interpersonal Skills and Its Effectiveness at different Levels of Management

What is Market Research? Why Conduct Market Research?

How do you organize the schools you are applying to?

Does Student Philanthropy Work? A Study of Long-term Effects of the Learning by Giving Approach

ARTICLE IN PRESS. Karin Braunsberger a, *, Roger Gates b,1, David J. Ortinau c,2

SOCIETY OF ACTUARIES THE AMERICAN ACADEMY OF ACTUARIES RETIREMENT PLAN PREFERENCES SURVEY REPORT OF FINDINGS. January 2004

OTHER PERSON S ELECTION DAY EXPENDITURES REPORT INSTRUCTIONS GENERAL INFORMATION

Good Practices in Survey Design Step-by-Step

PLEASE SCROLL DOWN FOR ARTICLE

Communications/publications Volunteer opportunities Events Awards PREAMBLE

114 Tips to Raise More Money By Mail

low first offers, exit early, and earn less profit. By A.Brooks and M.Schweitzer Paper found in a list cited on the webpage:

Investigating Human Resource Management Policies of the ICT Labour Market

Business to Business Marketing MKTG 333: TERM PROJECT TERM PROJECT: DEVELOPING A DIRECT MAIL CAMPAIGN

BUSINESS MAIL 1 st CLASS AND BUSINESS MAIL SUMMARY OF INFORMATION

Peter Tuckei, Hunter College; Trish Shukers, Quality Controlled Services Peter Tuckel, Hunter College, 695 Park Ave., New York, N.Y.

Results of the 62nd Opinion Survey on the General Public's Views and Behavior (June 2015 Survey)

Best Use of Direct Marketing

Be Your Donors Favorite Charity:

Virginia 2011 Fishing License Marketing Plan

101 Ways To Use A Virtual Office Assistant

Market Research. What is market research? 2. Why conduct market research?

Statistical Analysis on Relation between Workers Information Security Awareness and the Behaviors in Japan

CASE-STUDY: How I Used Direct Mail In My Funnel To Improve My Conversion Rate by 19%

Direct Mail Tips #3 Classes of Mail, Prices & Postage Payment

The Turkish Online Journal of Educational Technology TOJET October 2004 ISSN: volume 3 Issue 4 Article 2

INSTRUCTIONS. (3) Condition (4) Dollars in MPC to PASS to the Charity

Effective Communications

APA 2003 Poster Session Proposal. Preventing Bullying in Schools: A Community Action Research Approach

Additional Mail Stops Request

Consumer Bill Pay. Quick Step User Guide

Role of Direct Mail in developing the Mail Order business. by Raquel Ferrari Project Manager, Direct Mail

How To: Engineer A Direct Mail Campaign, One That Really Works! Developing Your Mailing List

Marketing Campaign Management: The Next Level of Value-Added Services

HMRC Tax Credits Error and Fraud Additional Capacity Trial. Customer Experience Survey Report on Findings. HM Revenue and Customs Research Report 306

Young Alumni Giving Program Overview May 2007

Response Rate and Measurement Differences in Mixed Mode Surveys. Using Mail, Telephone, Interactive Voice Response and the Internet 1

Motoi Ogura, Takayuki Hachiya, Kakuro Amasaka. Aoyama Gakuin University, Kanagawa-ken, Japan

Descriptive Methods Ch. 6 and 7

How to Develop a Research Protocol

Community Fundraising Event Application Package

Graduate School of Medicine, Kyoto University Guide for Applying to Doctoral Program in Medical Sciences for 2014

MA THESIS AND MA CAPSTONE PROJECT GUIDELINES. MA in Corporate Communication. Communication Studies Department

Measuring the Effectiveness of Encrypted Surveys as a Non-Response Reduction Technique

A/B Testing, Behavior-Based Campaigns, Data Reporting & Analysis. Have Fun!

Family Child Care Homes Who Leave the CACFP: Preliminary Survey Evidence

OFFICIAL ELECTION MAIL GRAPHIC GUIDELINES AND LOGOS. March 2015 Publication 631

Direct Mail. Best Practices

Transcription:

Effects of transparent envelopes in mail surveys 7 Journal of Articles in Support of the Null Hypothesis Vol. 7, No. 1 Copyright 2010 by Reysen Group. 1539-8714 www.jasnh.com The Effects of Transparent Outgoing Envelopes on the Response Rate and Speed in Mail Surveys Hiromitsu Maeda Kobe Shinwa Women s University Shingo Abe Baika Women s University In this study, a mail survey was conducted in order to examine the effects of transparent envelopes (those allowing visualization of contents) on response rate and speed. The experiment was carried out by mailing a questionnaire covered with either transparent outgoing envelope or plain one to 1,000 households, whom were chosen by two-stage area sampling. As the result, the response speed of transparent envelopes was better than plain ones; however, there was little difference on response rates after sending follow-up postcards. This suggests that transparent envelopes, similar to follow-up mailing, may have a reminder effect.

8 Journal of Articles in Support of the Null Hypothesis. JASNH, 2010, Vol. 7, No. 1 Generally, response rates of mail surveys tend to be low. For example, Yu and Cooper (1983) conducted a meta-analysis of survey methods. They reviewed 93 journal articles and found the response rates of mail surveys (47.3%), telephone surveys (72.3%), and interview surveys (81.7%). The validity and reliability of the results of surveys are determined by the response rate, as previous studies have indicated that low response rates provide few credible statistics about the characteristics of the population as a whole (e.g., Fowler, 2002). In order to address this problem, particularly in Europe and the United States, a number of research studies have been directed towards methods of increasing the response rates such as clarifying the effects of multiple factors which might influence the rates (Fox, Crask, & Kim, 1988; Heberlein & Baumgartner, 1978; Yammarino, Skinner, & Childers, 1991) and developing a fixed set of principles for mail surveys as typified by TDM (Total Design Method, or Tailored Design Method; Dillman, 1978, 2000). In this study, the effects of the appearance and style of outgoing envelopes were examined. In a mail survey, unlike other survey methods such as telephone or interview, researchers do not have direct contact with respondents, therefore the appearance of the mailing may be an important factor in the return response. Above all, the outgoing envelope is what a recipient first notices and the appearance makes the first impression and determines whether it is opened or not. If the envelope appears to be from a direct mail campaign, such as solicitations for donations or a commercial advertisement, the recipient is likely to discard it. Thus, the first step in a successful mail survey would be to entice the recipient to open the envelope. Previous studies on the effects of outgoing envelopes mainly focused on the following factors: personalization (Byrom & Bennison, 2000; Kahle & Sales, 1978; Tullar et al., 2004), sponsoring organization ( Asch & Christakis, 1994; Elkind, Tryon, & Devito, 1986; Houstone & Nevin, 1977), form of postage (Brook, 1978; Hensley, 1974; McCrohan & Lowe, 1981), the size of the outgoing envelopes (Halpern, Ubel, Berlin, & Asch, 2002), and envelope teaser, or a short message on the envelopes (Dommeyer, Elganayan, & Umans, 1991). Though several studies showed that these factors have no effect, it is believed that the style of outgoing envelopes is a factor that deserves attention when conducting mail surveys. There are few studies that have examined the influences of transparent or seethrough envelopes, which are defined as envelopes that allow visualization of contents without opening. It is possible that transparent envelopes allow immediate discrimination of a questionnaire from a direct mail campaign and therefore this visualization motivates a response because the recipient sees the incentive, small gift such as a pen, inside the envelope and is less likely to forget to respond. In other words, using transparent outgoing envelopes stimulates the potential to respond. Many stationery companies claim that transparent envelopes increase the response rate of mail surveys and that they are suitable for direct mail campaigns because of the high rate of opening, however, there is no evidence so far to support the claim. In recent years, there has been an increasing tendency for consumers to discard mail without opening it (Direct Marketing Association, 1993). Consequently, it is important and meaningful, from both an academic and practical point of view, to investigate whether transparent envelopes increase the response rate when conducting mail surveys. Method

Effects of transparent envelopes in mail surveys 9 This study was conducted in Itami City, Hyogo Prefecture, Japan, which has 73,999 households with a population of 192,955 (as of April 1, 2005) and it is one of the mediumsized satellite cities of Osaka and Kobe. In this survey, 1,000 households were chosen using a two-stage area sampling from a house map, which contained information of householders names and addresses and which was published in January 2005 on CD-ROM. For the primary sampling unit, an area of town was randomly selected and the secondary sample was a random selection of house numbers. The selected households were then randomly assigned to either the control group, with a plain outgoing envelope, called the Plain Group, or the experimental group, with a transparent envelope, called the Transparent Group. There were 500 households in each group. The survey procedure was as follows. First, pre-notification letters were sent to the chosen households (1,000). People from three households, two from Plain Group and one from Transparent Group phoned in and refused to participate. On April 15, 2005, after pre-notification, questionnaires were mailed to 997 households with an attached deadline of May 16, 2005. Additionally, follow-up postcards was sent on May 2, 2005. After sending the questionnaires, three from each group declined by mailing and there were 25 postal irregularities (Plain Group: 15, Transparent pre-notification: 10); leaving a total of 972 (Plain Group: 484, Transparent pre-notification: 488). A 6-page double-sided questionnaire was printed on fine quality white paper. It included approximately 90 fixed-alternative response items. The purpose of the questionnaire was to examine how people evaluate crime victims. The outgoing envelope included: the questionnaire, a cover letter, an incentive (a ballpoint pen), and a stamped return envelope. The transparent outgoing envelopes used in this survey were clear on one side and unclear on the other side; therefore, the cover letter and incentive were clearly visible. Results In this study, the response rate was defined as the ratio of the number of usable questionnaires to the total number that were mailed out. The response speed was measured by comparing the weekly cumulative response rates between the two groups, using the postmarked date as the standard. Of the 972 mailed questionnaires, 341 were returned. Of these, nine were not included because they were completely blank (Plain Group: 6, Transparent Group: 3). There were 332 usable questionnaires, for a 34.2% response rate. Comparing the two outgoing envelope styles, the response rates were 32.2% (n = 156) for the Plain Group and 36.1% (n = 176) for the Transparent Group. No significant difference was obtained in the response rates between the two groups (z = 1.26, p >.05). Next, the response speed was examined. Three were omitted from the analysis of the response speed, because two of Plain Group and one of Transparent Group in the returned mailings were illegible (legible rate = 99.1%). The weekly cumulative response rates from each group are shown in Table 1. It appeared that the transparent envelopes had an increased response speed until the third week. After sending follow-up postcards, the difference of the response rates between the two groups decreased.

Table1 10 Journal of Articles in Support of the Null Hypothesis. JASNH, 2010, Vol. 7, No. 1 The weekly cumulative response rates of transparent and plain envelope groups Plain Group Transparent Group Difference n (%) n (%) % z p 1st week (April 16-22, 2005) 74 15.3% 90 18.4% 3.2% 1.31.190 2nd week (April 23-29, 2005) 92 19.0% 110 22.5% 3.5% 1.36.174 3rd week (April 30-May 6, 2005) 119 24.6% 145 29.7% 5.1% 1.80.072 4th week (May 7-13, 2005) 149 30.8% 169 34.6% 3.8% 1.28.201 5th week (May 14-20, 2005) 155 32.0% 174 35.7% 3.6% 1.20.230 Total (April 16-May 31, 2005) 156 32.2% 176 36.1% 3.8% 1.26.208 Table 1. The weekly cumulative response rates of transparent and plain envelope groups Discussion The results of this experimental mail survey indicated that the use of transparent outgoing envelopes did not significantly stimulate the survey response. It was hypothesized in this survey, due to the pre-notification letter, that the recipients were alerted to expect the questionnaire. Therefore, regardless of the kind of envelope, no significant differences were seen between the two envelope styles in total response rate. With respect to the response speed, the transparent envelopes had a higher response rate until the third week; however, the differences between the response rates of the two groups decreased after the follow-up postcards were sent. This suggests that transparent envelopes, similar to follow-up mailings, may have a reminder effect. Supposing transparent envelopes functions similar to follow-up mailings, the use of these envelopes in outgoing mailings could dramatically cut down the costs of follow-up mailings. The effects of transparent envelopes on the response behavior of respondents need to be further examined. Future research should investigate the interaction with other factors such as pre-notification and follow-up, to clarify the role of transparent envelopes in mail survey methods.

Effects of transparent envelopes in mail surveys 11 References Asch, D. A., & Christakis, N. A. (1994). Different response rates in a trial of 2 envelope styles in mail surveyresearch. Epidemiology, 5, 364-365. Brook, L. L. (1978). The effect of different postage contributions on response levels and speed of reply. Journal of Market Research Society, 20, 238-244. Byrom, J., & Bennison, D. (2000). The effect of personalisation on mailed questionnaire response rates. International Journal of Market Research, 42, 357-358. Dillman, D. A. (1978). Mail and telephone surveys: The total design method. New York: Wiley-Interscience. Dillman, D. A. (2000). Mail and internet surveys: The tailored design method (2nd ed.). New York: Wiley-Interscience. Direct Marketing Association. (1993). Statistical fact book. New York: Direct Marketing Association. Dommeyer, C. J., Elganayan, D., & Umans, C. (1991). Increasing mail survey response with an envelope teaser. Journal of the Market Research Society, 33, 139-140. Elkind, M, Tryon, G. S., & Devito, A. J. (1986). Effects of type of postage and covering envelope on response rates in a mail survey. Psychological Reports, 59, 279-283. Fox, R. J., Crask, M. R., & Kim, J. (1988). Mail survey response rate: A meta-analysis of selected techniques for inducing response. Public Opinion Quarterly, 52, 467-491. Fowler, F. J. (2002). Survey Research Methods (3rd ed.). Thousand Oaks, CA: Sage Publication. Halpern, S. D., Ubel, P. A., Berlin, J. A., & Asch, D. A. (2002). Randomized trial of $5 versus $10 monetary incentives, envelope size, and candy to increase physician response rates to mailed questionnaires. Medical Care, 40, 834-839. Heberlein, T. A., & Baumgartner, R. (1978). Factors affecting response rate to mailed questionnaires: A quantitative analysis of the published literature. American Sociological Review, 43, 447-462. Hensley, W. E. (1974). Increasing response rate by choice of postage stamps. Public Opinion Quarterly, 38, 280 283. Houston, M. J., & Nevin, J. R. (1977). The effect of source and appeal on mail survey response rate. Journal of Marketing Research, 14, 374-378. Kahle, L. R., & Sales, B. D. (1978). Personalization of the outside envelope in mail survey. Public Opinion Quarterly, 42, 547-550. McCrohan, K. F., & Lowe, L. S. (1981). A cost/benefit approach to postage used on mail questionnaires. Journal of Marketing, 45, 130-133. Tullar, J. M., Katz, J. N., Wright, E. A., Fossel, A. H., Phillips, C. B., Maher, N. E., & Losina, E. (2004). Effect of handwritten, hand-stamped envelopes on response rate in a followup study of hip replacement patients. Arthritis & Rheumatism-Arthritis Care & Research, 51, 501-504. Yammarino, F. J., Skinner, S. J., & Childers, T. L. (1991). Understanding mail survey response behavior: A meta-analisis. Public Opinion Quarterly, 55, 613-639. Yu, J., & Cooper, H. (1983). A quantitative review of research design effects on response rates to questionnaires. Journal of Marketing Research, 20, 36-44.

12 Journal of Articles in Support of the Null Hypothesis. JASNH, 2010, Vol. 7, No. 1 Author Note Hiromitsu Maeda (Faculty of Human Development and Education, Kobe Shinwa Women s University) Shingo Abe (Faculty of Psychology and Children s Studies, Baika Women s University) Support from the Research Foundation for Safe Society to second author is gratefully acknowledged. Correspondence concerning this article should be addressed to Hiromitsu Maeda, 13-1 Suzurandai-Kitamachi 7-chome, Kita-ku, Kobe City, Hyogo Prefecture 651-1111, JAPAN. E-mail: maeda@kobe-shinwa.ac.jp Received: 2.24.2010 Revised: 4.7.2010 Accepted: 4.8.2010