Research
Abandonment Issues
Survey Abandonment UX Analysis
- Type
- Research
- Year
- 2024
- Reading time
- 1 min
- Tools
- Python, Pandas, Scikit-learn, NLTK, Sentiment Analysis
- Report
- Full paper (PDF) ↗
- Question
- Why do people quit online surveys halfway, and what in the design makes them stay?
- Method
- Logistic regression on word count, input complexity, question position and completion time, plus NLP on open-text feedback from 304 respondents.
- Finding
- Clear instructions, visual appeal and skip logic are the biggest levers. People prefer shorter, more frequent surveys.
- Context
- My B.Sc. Statistics dissertation at St. Xavier’s, Kolkata. The model reached 82% accuracy.
What it shows
- A logistic model of drop-off at 82% accuracy
- Design levers ranked: clear instructions, visual appeal, skip logic
- Open-text feedback sorted by sentiment into what helped and what hurt
Caveats
- One study of 304 respondents
Status
B.Sc. dissertation, 2024
A 1-minute read
Why do people quit online surveys halfway? My statistics dissertation asked 304 respondents and modelled their drop-off with logistic regression over word count, input complexity, question position and completion time, alongside sentiment analysis of what they wrote. The model reached 82% accuracy, and the levers were plain: clear instructions, visual appeal and skip logic, with people preferring shorter, more frequent surveys over one long one.
At a glance
- 82%
- Model Accuracy
- ~25%
- Completion Bump
- 304
- Surveyed Subjects
In product management, studying what users choose NOT to do is as valuable as studying what they do. Forms and digital surveys are critical capture funnels, yet they consistently suffer from high dropout rates. This research treats the user form as a closed statistical system, seeking to build predictive diagnostics to locate friction points and recommend evidence-based design fixes.
By conducting linear and logistic regression models over user response parameters and textual feedback, the research uncovers the primary factors driving form fatigue.
Key Contributions
Predictive Logistic Regression Modeling: Structured a logistic model using variables like word count, input complexity, question position, and estimated completion times to calculate individual abandonment probabilities.
NLP on Open-Text Feedback: Ran participant comments through text classification, extractive summarization, and sentiment analysis to surface recurring response patterns and separate the factors that improved the experience from those that drove frustration and drop-off.
Actionable Design Recommendations: Distilled the model's significant predictors, namely clear instructions, visual appeal, and skip logic, into concrete survey-design guidance, with a strong signal that shorter, more frequent surveys sustain engagement and reduce attrition.
Conclusion
The logistic regression results pinpointed the variables that most strongly drive drop-off: clear instructions, visual appeal, and the presence of skip logic emerged as the biggest levers for reducing attrition, with participants showing a strong preference for shorter, more frequent surveys over long one-off ones.
Complementing the quantitative model, NLP over participant comments added qualitative depth, with text classification surfacing recurring response patterns, extractive summarization compressing long feedback into concise insight, and sentiment analysis separating what helped from what hurt. Positive sentiment clustered around clear instructions, shorter surveys, technical stability, and relevant question types; negative sentiment around unclear instructions, length, technical glitches, and intrusive or irrelevant personal questions. By accounting for both the statistics and respondents' own words, researchers can optimize survey design for higher participation and better data quality.
Tools
Python, Pandas, Scikit-learn, NLTK, Sentiment Analysis
Keeper of this file
Dheere
Started this survey in 2019. Still on question four, and very much not abandoning it.
← Poke it