In this episode, I talk about a survey I didn’t plan to analyze—one that popped up the moment I opened Microsoft Word. Microsoft asked for feedback, and well… I had some. I break down the flaws in their opening question, including directional bias, vague wording, and unlabeled scale points. I also reflect on how these design choices impact data quality and what could have been done better. It’s a reminder that even the most common surveys we see in the wild from even the biggest tech giants c...
All content for Total Survey Design is the property of Dr. Azdren Coma and Dr. Seon Yup Lee and is served directly from their servers
with no modification, redirects, or rehosting. The podcast is not affiliated with or endorsed by Podjoint in any way.
In this episode, I talk about a survey I didn’t plan to analyze—one that popped up the moment I opened Microsoft Word. Microsoft asked for feedback, and well… I had some. I break down the flaws in their opening question, including directional bias, vague wording, and unlabeled scale points. I also reflect on how these design choices impact data quality and what could have been done better. It’s a reminder that even the most common surveys we see in the wild from even the biggest tech giants c...
An Interview with James McCall, Survey Methodologist
Total Survey Design
28 minutes
1 year ago
An Interview with James McCall, Survey Methodologist
In this episode, we interview James McCall, a survey methodologist at Westat. James shares what first drew him to surveys, and what drove him into a career of surveys. We talk about his role as a survey methodologist in industry. We discuss cognitive testing, data scripts, and other elements of the art and science of survey design. We also discuss our pet-peeves, such as matrix questions, check-all-that-apply questions, pre-testing, having too-short timelines, and more. James also shares advi...
Total Survey Design
In this episode, I talk about a survey I didn’t plan to analyze—one that popped up the moment I opened Microsoft Word. Microsoft asked for feedback, and well… I had some. I break down the flaws in their opening question, including directional bias, vague wording, and unlabeled scale points. I also reflect on how these design choices impact data quality and what could have been done better. It’s a reminder that even the most common surveys we see in the wild from even the biggest tech giants c...
