AI and a survey question bias review

End-of-lesson check

15 questions · take it digitally for instant feedback at tendril.neural-forge.io/learn/quiz/end-creators-research-AI-and-survey-question-bias-review-r10a3-creators

1. Which term describes a survey question that asks about two different things in a single item?

   1. Leading question
   2. Double-barreled question
   3. Loaded question
   4. Complex question

2. What does a leading survey question do?

   1. It uses unfamiliar cultural references
   2. It requires respondents to reveal private information
   3. It combines two different issues into one question
   4. It suggests to respondents what the 'correct' answer should be

3. An AI tool reviewing a survey can reliably identify which of the following?

   1. Missing 'prefer not to answer' response options
   2. What topics are culturally sensitive for a specific population
   3. If the survey will achieve a representative sample
   4. Whether respondents will answer honestly

4. A survey researcher wants to use AI to improve their questionnaire. What is the strongest use case for AI in this process?

   1. Determining which cultural groups will respond
   2. Consistently flagging ambiguous wording across many questions
   3. Replacing in-person cognitive interviews
   4. Deciding what sample size is needed

5. What limitation should a researcher keep in mind when using AI to review their survey for cultural issues?

   1. AI knows which ethnic groups will refuse to participate
   2. AI can understand regional slang perfectly
   3. AI lacks knowledge of the specific cultural context of the target population
   4. AI always detects cultural problems accurately

6. After an AI review flags most questions as having 'no issues,' what should the researcher do?

   1. Conduct a focused manual review of the most complex questions
   2. Delete the survey and start over
   3. Send the survey to all respondents immediately
   4. Accept the results since AI is objective

7. Which scenario best illustrates a double-barreled question?

   1. 'Do you support the new education policy?'
   2. 'How old are you?'
   3. 'Do you think the new park is both accessible and well-maintained?'
   4. 'What is your favorite color??'

8. What is 'response bias' in survey research?

   1. When sample sizes are too small
   2. When respondent answers are systematically skewed by question wording or context
   3. When respondents refuse to participate in surveys
   4. When surveys are distributed electronically

9. Why can AI not replace cognitive interviewing for survey testing?

   1. AI has been proven to outperform cognitive interviews
   2. AI is too expensive for most research budgets
   3. AI cannot observe how real people actually interpret and process questions
   4. Cognitive interviewing is not scientifically validated

10. What type of survey question makes assumptions that may not apply to all respondents?

    1. Open-ended question
    2. Hypothetical question
    3. Likert scale question
    4. Culturally narrow question

11. Which is the best example of an ambiguous survey question?

    1. 'Select your gender: Male / Female'
    2. 'Do you agree that pollution is bad?'
    3. 'What is your zip code?'
    4. 'How often do you exercise?' without defining exercise

12. What response option do best-practice surveys typically include to reduce non-response bias?

    1. 'All of the above'
    2. 'I don't know'
    3. 'None of the above'
    4. 'Prefer not to answer'

13. The lesson suggests that most survey errors stem from what source?

    1. Response formats
    2. Sampling methods
    3. Question wording
    4. Survey length

14. What is the primary advantage of using AI to review survey questions?

    1. Eliminating the need for any human oversight
    2. Determining the perfect sample size
    3. Guaranteeing that all respondents will answer honestly
    4. Speed and consistency in applying a checklist across many questions

15. A question reads: 'Should schools ban junk food and require longer school days?' This is an example of which problem?

    1. Culturally narrow question
    2. Leading question
    3. Double-barreled question
    4. Loaded question