When Should Survey Reminders be Sent Out? An Investigation Into Surveys Analyzing High Schoolers
DOI:
https://doi.org/10.47611/jsrhs.v11i3.2848Keywords:
Survey, Survey Reminders, Reminder Timing, Case study, High schoolAbstract
In the modern day, surveys often have very low response rates. This reveals a need for greater understanding of survey research, in order to enable researchers to achieve high response rates. One relevant facet of survey research is reminder timings, or the amount of time between the survey invitation and the reminder. In this study, the researcher investigated a potential reminder timing, analyzing surveys on high school students to discover the day that people stop responding to surveys. The researcher found that in their dataset, people stop responding to surveys after an average of 3 days of the survey being active. This finding may be relevant to informing survey reminder timings in the future, as effective reminders may be placed at the point people stop responding to surveys. There may be more optimal reminder timings, however. More investigation must be done into the ideal point for survey reminders to generate more solid conclusions.
Downloads
References or Bibliography
Aaronson, D., Park, K.-H., & Sullivan, D. G. (2006). The Decline in Teen Labor Force
Participation. Economic Perspectives: Federal Reserve Bank of Chicago.
Asire, A. M. (2017). A Meta-Analysis of the Effects of Incentives on Response Rate in Online
Survey Studies. Electronic Theses and Dissertations.
Barnhart, B. J., Reddy, S. G., & Arnold, G. K. (2021). Remind Me Again: Physician Response to
Web Surveys: The Effect of Email Reminders Across 11 Opinion Survey Efforts at the American Board of Internal Medicine from 2017 to 2019. Evaluation & the Health Professions, 44(3), 245–259. https://doi.org/10.1177/01632787211019445
Barron, G., & Yechiam, E. (2002). Private e-mail requests and the diffusion of
responsibility. Computers in Human Behavior, 18(5), 507–520. https://doi.org/10.1016/s0747-5632(02)00007-9
Baruch, Y., & Holtom, B. C. (2008). Survey response rate levels and trends in
Organizational Research. Human Relations, 61(8), 1139–1160. https://doi.org/10.1177/0018726708094863
Bauer, L., Liu, P., Moss, E., Nunn, R., & Shambaugh, J. (2019, July 3). All school and no
work becoming the norm for American teens. Brookings. Retrieved December 1, 2021, from https://www.brookings.edu/blog/up-front/2019/07/02/all-school-and-no-work-becoming-the-norm-for-american-teens/.
Beebe, T. J., McAlpine, D. D., Ziegenfuss, J. Y., Jenkins, S., Haas, L., & Davern, M. E. (2012).
Deployment of a Mixed-Mode Data Collection Strategy Does Not Reduce Nonresponse Bias in a General Population Health Survey. Health Services Research, 47(4), 1739–1754. https://doi.org/10.1111/j.1475-6773.2011.01369.x
Beebe, T. J., Jacobson, R. M., Jenkins, S. M., Lackore, K. A., & Rutten, L. J. (2018).
Testing the impact of mixed-mode designs (mail and web) and multiple contact attempts within mode (mail or web) on clinician survey response. Health Services Research, 53, 3070–3083. https://doi.org/10.1111/1475-6773.12827
Biner, P. M. (1988). Effects of cover appeal and monetary incentives on survey response: A
reactance theory application. Basic and Applied Social Psychology, 9(2), 99–106. https://doi.org/10.1207/s15324834basp0902_3
Blumenberg, C., Menezes, A. M., Gonçalves, H., Assunção, M. C., Wehrmeister, F. C., Barros, F.
C., & Barros, A. J. (2019). The role of questionnaire length and reminders frequency on response rates to a web-based epidemiologic study: A randomised trial. International Journal of Social Research Methodology, 22(6), 625–635. https://doi.org/10.1080/13645579.2019.1629755
Brown, J. A., Serrato, C. A., Hugh, M., Kanter, M. H., Spritzer, K. L., & Hays, R. D.
(2016). Effect of a post-paid incentive on response rates to a web-based survey. Survey Practice, 9(1), 1–7. https://doi.org/10.29115/sp-2016-0001
Buchholz, K. (2020). Americans Get Driver's Licenses Later in Life. Statista. Retrieved
January 21, 2021, from https://www.statista.com/chart/18682/percentage-of-the-us-population-holding-a-drivers-license-by-age-group/.
Coopersmith, J., Vogel, L. K., Bruursema, T., & Feeney, K. (2016). Effects of incentive
amount and type of web survey response rates. Survey Practice, 9(1), 1–10. https://doi.org/10.29115/sp-2016-0002
Crawford, S. D., Couper, M. P., & Lamias, M. J. (2001). Web surveys. Social Science
Computer Review, 19(2), 146–162. https://doi.org/10.1177/089443930101900202
Dillman, D. A., Lesser, V., Mason, R., Carlson, J., Willits, F., Robertson, R., & Burke, B.
(2007). Personalization of mail surveys for general public and populations with a group identity: Results from nine studies. Rural Sociology, 72(4), 632–646. https://doi.org/10.1526/003601107782638693
Edwards, L., Salisbury, C., Horspool, K., Foster, A., Garner, K., & Montgomery, A. A.
(2016). Increasing follow-up questionnaire response rates in a randomized controlled trial of telehealth for depression: Three embedded controlled studies. Trials, 17(1). https://doi.org/10.1186/s13063-016-1234-3
Edwards, P. J., Roberts, I., Clarke, M. J., DiGuiseppi, C., Wentz, R., Kwan, I., Cooper, R., Felix,
L. M., & Pratap, S. (2009). Methods to increase response to postal and electronic questionnaires. Cochrane Database of Systematic Reviews. https://doi.org/10.1002/14651858.mr000008.pub4
Fatkin, J.-M., & Lansdown, T. C. (2017). Group size and personalization’s effect on
Facebook message response rates. Information Technology & People, 30(1), 71–80. https://doi.org/10.1108/itp-02-2015-0042
Fincham, J. E. (2008). Response rates and responsiveness for surveys, standards, and the journal.
American Journal of Pharmaceutical Education, 72(2), 43. https://doi.org/10.5688/aj720243
Goyder, J. (1986). Surveys on surveys: Limitations and potentialities. Public Opinion Quarterly,
(1), 27. https://doi.org/10.1086/268957
Göritz, A. S. (2006). Incentives in Web Studies: Methodological Issues and a Review.
International Journal of Internet Science, 1(1), 58–70.
Heerwegh, D., Vanhove, T., Matthijs, K., & Loosveldt, G. (2005). The effect of
personalization on response rates and data quality in web surveys. International Journal of Social Research Methodology, 8(2), 85–99. https://doi.org/10.1080/1364557042000203107
Joinson, A. N., & Reips, U.-D. (2007). Personalized salutation, power of sender and
response rates to web-based surveys. Computers in Human Behavior, 23(3), 1372–1383. https://doi.org/10.1016/j.chb.2004.12.011
Kennedy, C., & Hartig, H. (2020, May 30). Response rates in telephone surveys have
resumed their decline. Pew Research Center. Retrieved December 1, 2021, from https://www.pewresearch.org/fact-tank/2019/02/27/response-rates-in-telephone-surveys-have-resumed-their-decline/.
Klagge, J. (2018). Guidelines for conducting surveys. ResearchGate. Retrieved December 1,
Koitsalu, M., Eklund, M., Adolfsson, J., Grönberg, H., & Brandberg, Y. (2018). Effects of
pre-notification, invitation length, questionnaire length and reminder on participation rate: A quasi-randomised controlled trial. BMC Medical Research Methodology, 18(1). https://doi.org/10.1186/s12874-017-0467-5
Muñoz-Leiva, F., Sánchez-Fernández, J., Montoro-Ríos, F., & Ibáñez-Zapata, J. Á. (2009).
Improving the response rate and quality in web-based surveys through the personalization and frequency of reminder mailings. Quality & Quantity, 44(5), 1037–1052. https://doi.org/10.1007/s11135-009-9256-5
Newell, C. E., Rosenfeld, P., Harris, R. N., & Hindelang, R. L. (2004). Reasons for
nonresponse on U.S. Navy Surveys: A closer look. Military Psychology, 16(4), 265–276. https://doi.org/10.1207/s15327876mp1604_4
Patrick, M. E., Couper, M. P., Jang, B. J., Laetz, V., Schulenberg, J. E., O’Malley, P. M.,
Bachman, J., & Johnston, L. D. (2022). Building on a Sequential Mixed-Mode Research Design in the Monitoring the Future Study. Journal of Survey Statistics & Methodology, 10(1), 149–160. https://doi.org/10.1093/jssam/smaa030
Pickett, J. T., Metcalfe, C. F., Baker, T., Gertz, M., & Bedard, L. (2013). Superficial survey
choice: An experimental test of a potential method for increasing response rates and response quality in correctional surveys. Journal of Quantitative Criminology, 30(2), 265–284. https://doi.org/10.1007/s10940-013-9203-4
Pit, S. W., Hansen, V., & Ewald, D. (2013). A small unconditional non-financial incentive
suggests an increase in survey response rates amongst older General Practitioners (GPS): A Randomised Controlled Trial Study. BMC Family Practice, 14(1). https://doi.org/10.1186/1471-2296-14-108
Pit, S. W., Vo, T., & Pyakurel, S. (2014). The effectiveness of recruitment strategies on
general practitioner’s survey response rates – a systematic review. BMC Medical Research Methodology, 14(1). https://doi.org/10.1186/1471-2288-14-76
Porter, S. R., Whitcomb, M. E., & Weitzer, W. H. (2004). Multiple surveys of students and
survey fatigue. New Directions for Institutional Research, 2004(121), 63–73. https://doi.org/10.1002/ir.101
Sahlqvist, S., Song, Y., Bull, F., Adams, E., Preston, J., & Ogilvie, D. (2011). Effect of
questionnaire length, personalisation and reminder type on response rate to a complex postal survey: Randomised Controlled Trial. BMC Medical Research Methodology, 11(1). https://doi.org/10.1186/1471-2288-11-62
Shults, R. A., & Williams, A. F. (2013). Trends in driver licensing status and driving among
high school seniors in the United States, 1996–2010. Journal of Safety Research, 46, 167–170. https://doi.org/10.1016/j.jsr.2013.04.003
Singer, E., & Ye, C. (2012). The use and effects of incentives in surveys. The ANNALS of
the American Academy of Political and Social Science, 645(1), 112–141. https://doi.org/10.1177/0002716212458082
Steindl, C., Jonas, E., Sittenthaler, S., Traut-Mattausch, E., & Greenberg, J. (2015).
Understanding psychological reactance. Zeitschrift Für Psychologie, 223(4), 205–214. https://doi.org/10.1027/2151-2604/a000222
Van Mol, C. (2016). Improving web survey efficiency: The impact of an extra reminder and
reminder content on web survey response. International Journal of Social Research Methodology, 20(4), 317–327. https://doi.org/10.1080/13645579.2016.1185255
Young, J. M., O'Halloran, A., McAulay, C., Pirotta, M., Forsdike, K., Stacey, I., & Currow,
D. (2015). Unconditional and conditional incentives differentially improved general practitioners' participation in an online survey: Randomized Controlled Trial. Journal of Clinical Epidemiology, 68(6), 693–697. https://doi.org/10.1016/j.jclinepi.2014.09.013
Yu, S., Alper, H. E., Nguyen, A.-M., Brackbill, R. M., Turner, L., Walker, D. J., Maslow, C. B.,
& Zweig, K. C. (2017). The effectiveness of a monetary incentive offer on survey response rates and response completeness in a longitudinal study. BMC Medical Research Methodology, 17(1). https://doi.org/10.1186/s12874-017-0353-1
Published
How to Cite
Issue
Section
Copyright (c) 2022 Sammy Socol; Maura Large
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Copyright holder(s) granted JSR a perpetual, non-exclusive license to distriute & display this article.