In research, the sample is studied with the goal of generalizing the results to the broader population from which the sample was drawn. This process allows researchers to make inferences about a large group based on data collected from a smaller, representative subset. The relationship is visually comparable to extracting a small representative group from a vast crowd.

Relationship Between Sample and Population

A team of researchers wants to understand the typical sleep habits of all adults in a country of 50 million people. Since they cannot survey every individual, which of the following approaches would be the most practical and scientifically sound first step for their investigation?

A random sample is a subset of a larger population in which every member of the population has an equal chance of being selected. This method is often preferred for selecting experimental participants because, provided the sample is large enough, it provides reasonable assurance that the participating individuals are representative of the broader population.

Random Sample

To illustrate how a sample is used, a researcher might measure the talkativeness of a few hundred university students. This subset serves as the sample, which the researcher studies with the intention of drawing conclusions about the talkativeness of a much larger population, such as men and women in general.

Example of a Sample: Talkativeness Study

A representative sample is a study sample that is similar to the broader population in important respects. It is crucial for researchers to obtain a representative sample so they can appropriately generalize their findings from the small subset of participants to the entire population of interest.

Representative Sample

Inferential statistics are a set of mathematical techniques used by researchers to determine whether a statistical result or relationship observed in a study's sample reflects something that is genuinely true of the broader population.

Inferential Statistics

Probability sampling is a broad category of sampling methods where the researcher can mathematically specify the exact probability that each member of the defined population will be selected for the sample. Because it enables researchers to make highly accurate estimates about a population, it is the favored approach in survey research, though it requires a clear and precise specification of the target population before sampling begins.

Probability Sampling

Non-probability sampling encompasses methods where the researcher cannot mathematically specify the probability that any given member of the target population will be selected for the sample. Because it does not rely on structured random selection from a clearly defined population, it is the most common approach used in general psychological research, even though it limits the ability to make perfectly representative population estimates.

Non-probability Sampling

The optimal sample size for a survey generally depends on two primary factors: the researcher's desired level of statistical confidence and the practical constraints of the study's budget. While larger samples yield statistics that are closer to the true population value and provide greater confidence, they also require more time, effort, and money to collect. Researchers frequently use power analyses to balance these theoretical and practical considerations.

Determinants of Survey Sample Size

Convenience sampling is a common form of non-probability sampling where researchers study individuals who happen to be physically nearby and are readily willing to participate, such as college students in an introductory psychology course. While this approach is frequently used in psychological research due to its accessibility and efficiency, its main disadvantage is that the resulting sample may not accurately represent the broader population, severely limiting the ability to generalize the findings.

Convenience Sampling

A survey non-responder is an individual selected for a survey sample who fails to complete the questionnaire. This lack of participation can occur for various reasons, including moving away, being too busy, lacking interest in the topic, or refusing to participate on principle.

Survey Non-responder

Simple random sampling is a method for obtaining a study sample where every single member of the target population has an equal chance of being selected. While this approach is effective for ensuring a representative sample, it is often difficult or impossible to achieve in psychological research because populations are rarely defined clearly enough to give everyone an equal selection chance.

Simple Random Sampling

Sampling bias is a systematic error that occurs when the method used to select participants results in a sample that fails to accurately represent the broader target population. Because the selected individuals differ in important ways from the overall group, any statistical findings derived from this unrepresentative sample will likely be inaccurate and cannot be safely generalized.

Sampling Bias

Measures of central tendency are descriptive statistics used to describe the typical, average, or center scores within a distribution. Common examples of these measures include the mean, median, and mode.

Measures of Central Tendency

To conduct a study, researchers typically select a smaller subset of individuals from a broader group of interest. This smaller subset is referred to as a ____.

A sample is a smaller subset of individuals selected from a larger population of interest. Because it is usually impossible to study every member of a population, researchers measure variables within a sample with the intention of generalizing their findings back to the broader group, ideally using a representative sample that closely resembles the population.

Google

University of Chicago

A survey is a versatile data collection tool used to gather meaningful answers about topics such as voting intentions, consumer preferences, social attitudes, or health. These self-report measures can vary in length and can be administered through multiple formats, including in-person interviews, telephone calls, mail questionnaires, or online over the Internet.

Survey

In research, a population is the entire, often very large, group of individuals that researchers are interested in studying and drawing conclusions about. Depending on the researcher's goals, a population could be as broad as all human beings or as specific as all American teenagers, children with autism, or professional athletes.

Population

Spielman, R. M., Jenkins, W. J., & Lovett, M. D. (2020, April 22). Psychology (2nd ed.). OpenStax. https://openstax.org/books/psychology-2e/pages/1-introduction

OpenStax Psychology (2nd ed.) Textbook

https://kpu.pressbooks.pub/psychmethods4e/

KPU Research Methods in Psychology - 4th American Edition

In research, a population is the entire group of individuals that the researchers seek to draw conclusions about based on their findings from the sample. 

Cons of using surveys include:

- Surveys rely on self-reported data, which limits the types of information that can be collected.
- People may lie on surveys as they want to be viewed favorably.

Cons of Using Surveys

A key benefit of survey research is its efficiency in data collection. Surveys allow researchers to gather a substantial volume of information from a large sample of participants in a relatively short amount of time.

Advantages of Survey Research

An example of an online survey invitation typically begins with a polite greeting to the visitor and emphasizes the value of their opinion. It then states the survey's purpose, such as gathering feedback on a specific topic like news consumption habits, and provides an estimated completion time, for instance, 10-15 minutes. The invitation concludes with a clear call to action, instructing the user on how to start the survey, often by clicking a "Yes" or "No" button to indicate their willingness to participate.

Example of an Online Survey Invitation

When compared to case studies, surveys have the distinct advantage of collecting data from much larger samples. A large and diverse sample is more likely to accurately represent the diversity of the overall population, which significantly enhances the generalizability of the research findings. Conversely, the strength of case studies lies in their depth; surveys cannot gather the same level of detailed information on each participant as is possible through an in-depth case study.

Comparison of Surveys and Case Studies

A notable example of a comprehensive survey is the doctoral research by Ruth W. Howard. In 1934, she conducted a study by surveying 229 sets of triplets, which was the most extensive research on triplets at the time.

Ruth W. Howard's Triplet Survey

A primary advantage of the survey method is its efficiency in data collection. It allows researchers to gather large quantities of information from a substantial number of participants in a relatively short period.

Advantage of Surveys: Efficient Data Collection

A significant limitation of the survey method is that it relies on self-reporting, meaning participants do not always provide accurate responses. Individuals might intentionally lie, unintentionally misremember details, or answer questions in a way they believe makes them look good, which can compromise the reliability of the data.

Weakness of Survey Research: Reliance on Honest Self-Reporting

A drawback of surveys is that the data they yield is often relatively shallow, especially when contrasted with the in-depth information gathered through methods like case studies.

Weakness of Survey Research: Shallow Data

A team of public health researchers wants to quickly gather data on the dietary habits and attitudes towards nutrition from a large, geographically diverse sample of 5,000 adults. Which of the following data collection strategies would be the most practical and effective for achieving this specific research goal?

A major advantage of survey research is that it enables researchers to collect data from relatively large samples with ease. This capacity for widespread data collection makes it significantly easier to generalize the research findings to the broader population, especially when compared to methods that rely on smaller groups.

Advantage of Survey Research: Generalizability

In a 2012 study by Jenkins and colleagues, researchers used a survey to investigate the persistence of negative attitudes toward the US Arab-American community following the September 11, 2001 terrorist attacks. The survey included direct questions about overt prejudice and indirect questions assessing participants' willingness to socially interact with various ethnicities. Although participants directly denied holding prejudicial attitudes, their indirect responses revealed a significantly lower willingness to interact with Arab-Americans compared to other groups. This research illustrates how surveys can detect subtle forms of prejudice, even when direct self-reports are inaccurate or biased.

Example of Survey Research: Uncovering Subtle Prejudice

Sample

In the context of survey research, a respondent is the term used to describe a study participant. These individuals provide the primary data for the study by directly self-reporting on their own behaviors, thoughts, beliefs, or feelings, typically through structured interviews or questionnaires.

Respondent

Survey research is a versatile methodology utilized to investigate a wide range of basic and applied research questions. It is predominantly used as a non-experimental research design to describe single variables, such as estimating the prevalence of mental disorders, or to identify statistical relationships among naturally occurring variables. Additionally, surveys can function as a data collection method within experimental research to test specific hypotheses concerning causal relationships between variables. When deployed with large and diverse samples, these survey-based experiments provide a valuable complement to traditional laboratory studies.

Applications of Surveys

Survey research is a flexible methodology that incorporates both quantitative and qualitative approaches, defined by two primary characteristics. First, it relies on self-report measures, where researchers ask participants to directly report on their thoughts, feelings, and behaviors using tools like questionnaires or interviews. Second, it emphasizes rigorous sampling techniques, typically favoring large random samples to acquire accurate estimates of population characteristics. This makes survey research one of the few approaches in psychology that routinely relies on random sampling.

Characteristics of Survey Research

The methodological roots of survey research can be traced back to English and American social surveys from the turn of the $$20$$th century, which aimed to systematically document widespread social issues such as poverty. In the $$1930$$s, the methodology progressed significantly as the United States government initiated nationwide surveys to assess social and economic conditions. The necessity to draw accurate inferences about the entire population from these surveys spurred crucial advancements in sampling techniques.

Origins of Survey Research

Following the September 11 terrorist attacks, researchers demonstrated the utility of survey research in psychology by conducting a large-scale internet survey on risk perception. The survey results indicated that participants generally tended to overestimate most risks, that females overestimated risks more than males, and that there were no differences in risk perception between teens and adults. To test their specific hypotheses about emotion, the researchers also incorporated an experimental manipulation within the survey by priming participants to feel either anger or fear. This revealed that risk perceptions are strongly tied to specific emotions; notably, individuals primed to feel anger perceived significantly less risk than those primed to feel fear.

Example of Survey Research: Emotion and Risk Perception

Designing an effective survey is difficult because participants' answers can be unintentionally influenced by factors such as question wording, the order of items, and the available response options. These unintended influences can introduce statistical noise or create systematic biases that lead to misleading results. To maximize the reliability and validity of the data, researchers must apply specific construction principles to minimize these negative effects.

Survey Construction Challenges

Researchers primarily conduct surveys using four main methods: in-person interviews, telephone surveys, mail surveys, and internet surveys. The decision of which mode to use depends on the specific goals of the research and the available budget.

Survey Administration Mode

Which of the following best defines a survey as used in psychological research?

Species & Route of Exposure (Table 1)

In the context of psychological research, how is a 'population' defined?

A developmental psychologist is studying the language acquisition skills of children with autism. She observes 50 children with autism at a local clinic. In this research context, what term best describes the entire group of 'all children with autism' that the psychologist ultimately wants to draw conclusions about?

Learn Before

Related

Learn After