.svg){kind=small}
Beyond the Response Rate
How Higher Education can finally close the loop between surveys and action. Qualitative interviews with 15 IR professionals at 15 U.S. institutions.
What the research found
15%
Average response rate today
Down from 25–35% a decade ago at the same institutions running the same surveys
10×
Hours on post-collection work
For every hour spent designing a survey — the hidden cost nobody budgets for
2–5
Staff on IR teams
At most institutions, regardless of whether they manage 5 or 50+ surveys per year
0
AI natively embedded
Every AI interaction is a manual export and context switch — nobody has it built in
Six patterns across 15 institutions
01 · Response Rates
Structural decline with no technical fix — Participation has collapsed across all institution types. Every strategy — incentives, personalised invitations, QR codes — has been tried. None produced lasting improvement. It's a trust problem, not a delivery problem.
02 · Survey Fatigue
An institution's own coordination failure — Multiple departments send surveys in the same week. Students receive overlapping questions from different offices. No shared calendar, no deduplication layer, no cross-department authority. The problem is structural.
03 · Analysis Burden
Where capacity actually disappears — Open-text cleaning, longitudinal data stacking, and report generation consume the majority of analyst time. Current platforms optimise for survey construction. The post-collection phase is largely unautomated.
04 · Platform Gaps
Built for design, not workflow — Data tied to personal accounts is a governance choice. Longitudinal stacking being manual is a tool gap. Every time a respondent drops off mid-way, that data disappears. None of this is inevitable.
05 · AI Adoption
Informal, widespread, and at the wrong layer — Every participant uses AI for question drafting and report writing. None have AI embedded in their survey tool. Every AI interaction requires exporting data and switching context. It adds friction rather than reducing it.
06 · Data to Action
Reports produced. Decisions rarely follow. — Surveys are run, reports are filed, and institutional change rarely results. This erodes respondent trust and suppresses future participation. Closing this loop requires leadership commitment — not better software.
In their words
Verbatim from the interviews with IR professionals.
"For every hour we spend designing a survey, we spend ten on cleaning, coding, and getting it into a format anyone can read."
"The open-text cleaning is the single biggest pain point. Thousands of employer name spellings. All manual. Every single cycle."
"Low response rates are structural now. Most of us have moved from trying to solve it to managing expectations around it."
Who this report is for
IR Professionals & Assessment Practitioners
Seeking validation, vocabulary, and frameworks for the challenges they navigate on a daily basis — survey overload, analysis bottlenecks, and reports that don't drive decisions.
Institutional Leadership
Vice provosts, chief data officers, and CIOs who commission surveys and want to understand the full picture of what makes survey programmes succeed — and why so many don't.
Survey Platform Designers & EdTech Developers
A ground-level view of where current tools fail, what practitioners actually need from the next generation of survey infrastructure, and where product investment will have the most impact.
What we recommend
01 · Post-Collection Automation
Build analysis, cleaning, and reporting directly into the survey workflow. The design phase is not where time is lost — every hour in design costs ten in post-collection.
02 · Native AI, Not a Bolt-On
Assist with question logic, phrasing, and open-text analysis in-platform. Every AI interaction that requires an export is friction, not a feature.
03 · Institutional Survey Calendars
Coordinate timing across departments to cut fatigue and redundant outreach. Survey overload is an emergent property of decentralised authority — it requires a coordination layer.
04 · Mobile-First, In-Context Delivery
Meet respondents inside LMS and SSO environments to lift response rates. Surveys built for desktop and distributed by email are structurally misaligned with how students live.
05 · Departmental Accounts & Question Banks
Shared, validated question banks keep longitudinal institutional data intact. Data tied to personal accounts is a governance choice — one that costs institutions their history.
How the study was run
15
Institutions Interviewed
~60
Minutes per Interview
5
Institution Types
8
U.S. States Represented
Get the full report
The complete findings, verbatims and recommendations — sent straight to your inbox.
Are you an IR professional?
We are still interviewing. Share how your institution closes the loop between surveys and action.