JFolder::create: Nem lehetett létrehozni a mappátPath: /var/www/co/media/com_comment/cache

Issues to be addressed:

  • Limits and opportunities of online samples
  • Internal validity and external validity of those samples
  • Statistical analysis of data from online experiments 

Participants: Barna Ildikó, Gulyás Attila, Hajdu Gábor, Janky Béla, Kisfalusi Dorottya, Kmetty Zoltán, Koltai Júlia, Németh Renáta, Simonovits Bori, Stefkovics Ádám


First meeting, .21 October 2016, Pécs

Survey experiments in Hungary

Organizer: Bognár Adrienn

Presenters: Hajdu Gábor, Janky Béla, Koltai Júlia, Restás Péter, Simonovits Bori

Special guest: Murányi Pista 


Summaries of the presented readings by Naszályi Natália (meetings #2-6)


Second meeting, 10 March 2017

External validity of survey experiments based on non-representative online samples

Presenter: Kmetty Zoltán

Summary by Barna Ildikó (in Hungarian)


Presented readings

Mutz, D. C. (2011). Population-based survey experiments. Princeton University Press (Ch 1, 8).

Clifford, S., & Jerit, J. (2014). Is there a cost to convenience? An experimental comparison of data quality in laboratory and online studies. Journal of Experimental Political Science, 1(02), 120-131.

Hauser, D. J., & Schwarz, N. (2016). Attentive Turkers: MTurk participants perform better on online attention checks than do subject pool participants. Behavior research methods, 48(1), 400-407.

Mullinix, K. J., Leeper, T. J., Druckman, J. N., & Freese, J. (2015). The generalizability of survey experiments. Journal of Experimental Political Science, 2(02), 109-138.



Third meeting, 31 March

Mode effects

Presenter: Stefkovics Ádám


Presented readings

Further reading

Heerwegh, D., & Loosveldt, G. (2011). Assessing mode effects in a national crime victimization survey using structural equation models: social desirability bias and acquiescence. Journal of Official Statistics, 27(1), 49.

Hox, J. J., De Leeuw, E. D., & Zijlmans, E. A. (2015). Measurement equivalence in mixed mode surveys. Measurement Invariance, 115.

Lugtig, P. J., Lensvelt-Mulders, G. J. L., Frerichs, R., & Greven, A. (2011). Estimating nonresponse bias and mode effects in a mixed mode survey. International Journal of Market Research, 53(5), 669-686.

Vannieuwenhuyze, J. T., & Loosveldt, G. (2013). Evaluating relative mode effects in mixed-mode surveys: three methods to disentangle selection and measurement effects. Sociological Methods & Research, 42(1), 82-104.

Vannieuwenhuyze, J. T., & Revilla, M. (2013, November). Relative mode effects on data quality in Mixed-Mode surveys by an instrumental variable. In Survey Research Methods (Vol. 7, No. 3, pp. 157-168).

West, B. T., & Blom, A. G. (2016). Explaining Interviewer Effects: A Research Synthesis. Journal of Survey Statistics and Methodology, smw024


Fourth meeting, 5 May

Why do polls keep failing?

Presenter: Németh Renáta


Presented readings

Carlos Alberto Gomez Grajales (2016): Why do polls keep failing? Blog post, 16. November 2016. Statistics Views.

Sturgis, P. Baker, N. Callegaro, M. Fisher, S. Green, J. Jennings, W. Kuha, J. Lauderdale, B. and Smith, P. Report of the Inquiry into the 2015 British general election opinion polls, London: Market Research Society and British Polling Council. (March, 2016)

Clarke, Harold D., Goodwin, Matthew and Whiteley, Paul (2016) Leave was always in the lead: why the polls got the referendum result wrong. LSE European Politics and Policy (EUROPP) Blog.


Further posts







Fifth meeting, 13 June

Effects of question wording, rating scales etc.

Presenter: Kmetty Zoltán

Kamoen, Naomi, et al. "Positive, negative, and bipolar questions: The effect of question polarity on ratings of text readability." Survey Research Methods. Vol. 7. No. 3. 2013.

Krebs, Dagmar, and Juergen HP Hoffmeyer-Zlotnik. "Positive First or Negative First?." Methodology (2010).

Yan, Ting, and Florian Keusch. "The effects of the direction of rating scales on survey responses in a telephone survey." Public Opinion Quarterly 79.1 (2015): 145-165.

Yeager, David Scott, and Jon A. Krosnick. "Does Mentioning “Some People” and “Other People” in an Opinion Question Improve Measurement Quality?." Public Opinion Quarterly (2012): nfr066.


Sixth meeting, 4 July

Question-order effects

Presenter: Kmetty Zoltán

Lee Sigelman: Question-Order Effects on Presidential Popularity

Dominic L. Lasorsa: Question-Order Effects in Surveys: The Case of Political Interest, News Attention, and Knowledge




Sterba, S. K. (2009). Alternative model-based and design-based frameworks for inference from samples to populations: From polarization to integration. Multivariate behavioral research, 44(6), 711-740.

Comments powered by CComment