Home Resources Infographic 3 Tips for better mobile surveys

3 Tips for better mobile surveys

With the average number of mobile survey completes ranging from 30% to 60%, designing for mobile is not optional.

In this most recent research on research, jointly conducted by Dynata, Forsta and MaritzCX, we explore the survey presentation of three commonly used question types: grids, Net Promoter Score, and lists.

Using a multi-cell design, we tested each presentation condition in a survey among 2280 participants. We investigated data comparability, data quality and participant experience.

Did you know…

Smartphone Ownership

98% of Millennials and 95% of Gen X own smartphones, with Boomers not far behind at 85% (Dynata Global Trends Report)

98%

Millennials

23%

Gen X

85%

Boomers

Global Web Traffic

In Q1 of 2019, mobile devices (excluding tablets) generated 49% percent of global website traffic (Statista)

49%

Smartphone only internet

One-in-five Americans are now ‘smartphone only’ internet users at home, up 7% since 2015 (Pew Internet)

Global Web Traffic

Mobile ad spend will top $93 billion in 2019, which is $20B more than TV (eMarketer)

1. Grids

Grids are one of the most commonly used question types, yet we know they are problematic, often receiving high levels of straight-lining (where participants select the same response option for all items in the grid) and survey dropouts.

We tested three ways of displaying grids (standard matrix grid, grid bars and progressive, also known as card sort within Forsta Surveys.

The Recommended Approach

  • No significant score differences across devices
  • Lowest % mobile straight liners
  • Highest completion rates (comparable with grid bars)

2. NPS

Net Promoter Score

(NPS) is a widely used key performance metric to monitor brand health so it’s critical that the data is accurate. This is challenging on mobile as the NP is calculated from a wide 11-point scale.

We tested two ways to display the NPS question; a standard approach using radio buttons and the FocusVision Decipher approach using a grid bar that displays consistently across desktop and mobile devices.

The recommended approach

  • Consistent data across devices

3. List responses

Long answer option lists can have a detrimental impact on mobile survey data. The longer the list, the more likely the response provided is from the top of the list (primacy effect). This is especially challenging when randomization is not an option give the nature of the list.

We tested two ways to display the list question, a standard list displaying all items and open-ended text box lists where participants need to type in their answer(s).

The Recommended Approach

  • Participants select more items in a multi-select question
  • Addresses primacy effects on mobile for fact-based questions
  • Participants type in new ideas / categories not considered by the researcher

Each has their strengths and draw backs, so usage depends on what is most important for the research question at hand.

Webinar

Take your reporting into the future with Forsta

Take your reporting into the future with Forsta Who is Forsta? How did we get here? And where could you go with us? Our demo of Forsta Visualizations will give you a glimpse of how we can help you deliver reports 40% quicker. From easy-to-use online dashboards to exciting PowerPoints, we’re here to help you […]

Read more
Take your reporting into the future with Forsta
Webinar

Make the complex simple

Make the complex simple Surveys with Forsta Plus are easy to create and deploy and deliver engaging respondent experiences. Learn more about our complete end-to-end solution for your survey projects, of any size and complexity. With Forsta Plus, you’ll get– Comprehensive design, deployment and delivery of your survey projects– Reliable management of all reporting requirements– […]

Read more
Make the complex simple
Webinar

MRAs blended technology & services

MRAs blended technology & services Tightening research budgets. Increased use of DIY technologies. Profit margins under relentless downward pressure. It feels like only doom-and-gloom for research agencies. But that’s not true. Demand for research and insight is growing. New methods, tools and data sources are proliferating. And research agencies are uniquely positioned to help organizations […]

Read more
MRAs blended technology & services

Learn more about our industry leading platform

FORSTA NEWSLETTER

Get industry insights that matter,
delivered direct to your inbox

We collect this information to send you free content, offers, and product updates. Visit our recently updated privacy policy for details on how we protect and manage your submitted data.