Relevance & Research Question: The mobile survey participation is currently a relevant phenomenon, worldwide. Mobile devices have different characteristics in comparison to traditional fixed-PCs or laptops. A key difference is the reduced size of the devices and of their screens. The enhanced portability is counterbalanced by some potential risks. Can the screen size affect the quality and the comparability of collected data? And which is the role that the questionnaire optimization can play? Methods & Data: Data were collected in 2015, using the Netquest opt-in online panel for Spain, through a two-wave survey proposing twice the same questionnaire to the same respondents (1,608 panelist). Each panelist was randomly assigned, within a specific wave, to a survey condition (i.e. the device used and the questionnaire optimization, for participants using a mobile device). This research focuses only on mobile device respondents. In order to test our hypotheses, we computed a series of indicators -some based on paradata- related to both the participation process (e.g. the completion time, the answer consistency between waves, etc.) and the survey experience evaluation (perceived difficulty, appreciation, etc.). Results: The device screen size usually does not significantly affect some indicators linked to the data quality/comparability, but can significantly affect variables (such as the survey length or the evaluation of the survey experience) that can determine the respondents’ burden and their willingness in participating again in surveys. However, most of the potential issues linked to the use of small sized devices can be attenuated proposing a questionnaire optimized for the mobile participation. The paper also investigates the interaction between these two variables and the consequences of re-proposing the same survey. Added Value: Despite the widely acknowledged importance of the screen size, only few studies directly analyzed this key variable. Most of them just considered broader and nonhomogeneous categories of devices (i.e. smartphones and tablets) or used a limited set of indicators (mostly completion time). This work aims at using a wider range of indicators and at providing an updated and more precise view, taking into account the exact screen size (in inches) and its interaction with the optimization.

(2017). The Role Played by the Device Screen Size and by the Questionnaire Optimization within the Mobile Survey Participation . Retrieved from http://hdl.handle.net/10446/132242

The Role Played by the Device Screen Size and by the Questionnaire Optimization within the Mobile Survey Participation

Toninelli, Daniele;
2017-01-01

Abstract

Relevance & Research Question: The mobile survey participation is currently a relevant phenomenon, worldwide. Mobile devices have different characteristics in comparison to traditional fixed-PCs or laptops. A key difference is the reduced size of the devices and of their screens. The enhanced portability is counterbalanced by some potential risks. Can the screen size affect the quality and the comparability of collected data? And which is the role that the questionnaire optimization can play? Methods & Data: Data were collected in 2015, using the Netquest opt-in online panel for Spain, through a two-wave survey proposing twice the same questionnaire to the same respondents (1,608 panelist). Each panelist was randomly assigned, within a specific wave, to a survey condition (i.e. the device used and the questionnaire optimization, for participants using a mobile device). This research focuses only on mobile device respondents. In order to test our hypotheses, we computed a series of indicators -some based on paradata- related to both the participation process (e.g. the completion time, the answer consistency between waves, etc.) and the survey experience evaluation (perceived difficulty, appreciation, etc.). Results: The device screen size usually does not significantly affect some indicators linked to the data quality/comparability, but can significantly affect variables (such as the survey length or the evaluation of the survey experience) that can determine the respondents’ burden and their willingness in participating again in surveys. However, most of the potential issues linked to the use of small sized devices can be attenuated proposing a questionnaire optimized for the mobile participation. The paper also investigates the interaction between these two variables and the consequences of re-proposing the same survey. Added Value: Despite the widely acknowledged importance of the screen size, only few studies directly analyzed this key variable. Most of them just considered broader and nonhomogeneous categories of devices (i.e. smartphones and tablets) or used a limited set of indicators (mostly completion time). This work aims at using a wider range of indicators and at providing an updated and more precise view, taking into account the exact screen size (in inches) and its interaction with the optimization.
2017
Toninelli, Daniele; Revilla, Melanie
File allegato/i alla scheda:
File Dimensione del file Formato  
PROCEEDINGS_gor-17_abstractband_web_DTMR_Abstract_wcover.pdf

Solo gestori di archivio

Versione: publisher's version - versione editoriale
Licenza: Licenza default Aisberg
Dimensione del file 401.98 kB
Formato Adobe PDF
401.98 kB Adobe PDF   Visualizza/Apri
GOR2017_DT-MR_RoleScreenSizeOptim_v07_PostConf-DEF.pdf

accesso aperto

Versione: publisher's version - versione editoriale
Licenza: Creative commons
Dimensione del file 729.01 kB
Formato Adobe PDF
729.01 kB Adobe PDF Visualizza/Apri
Pubblicazioni consigliate

Aisberg ©2008 Servizi bibliotecari, Università degli studi di Bergamo | Terms of use/Condizioni di utilizzo

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10446/132242
Citazioni
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact