In research, the sample is studied with the goal of generalizing the results to the broader population from which the sample was drawn. This process allows researchers to make inferences about a large group based on data collected from a smaller, representative subset. The relationship is visually comparable to extracting a small representative group from a vast crowd.

Relationship Between Sample and Population

A team of educational psychologists wants to investigate the effectiveness of a new mathematics curriculum for all fourth-grade students in a particular country. To do this, they plan to implement the curriculum in 200 classrooms across various regions and measure the students' learning outcomes. In this research scenario, what is the population?

A random sample is a subset of a larger population in which every member of the population has an equal chance of being selected. This method is often preferred for selecting experimental participants because, provided the sample is large enough, it provides reasonable assurance that the participating individuals are representative of the broader population.

Random Sample

Inferential statistics are a set of mathematical techniques used by researchers to determine whether a statistical result or relationship observed in a study's sample reflects something that is genuinely true of the broader population.

Inferential Statistics

A sampling frame is essentially a comprehensive list of all members of a specified population from which a researcher will select respondents. Sources for these frames can include telephone directories, lists of registered voters, hospital records, or even geographic maps. Establishing an accurate sampling frame is a necessary prerequisite for conducting most forms of probability sampling.

Sampling Frame

In research, a population is the entire group of individuals that the researchers seek to draw conclusions about based on their findings from the sample. 

Google

University of Chicago

New Mexico Highlands University

A survey is a versatile data collection tool used to gather meaningful answers about topics such as voting intentions, consumer preferences, social attitudes, or health. These self-report measures can vary in length and can be administered through multiple formats, including in-person interviews, telephone calls, mail questionnaires, or online over the Internet.

Survey

A variable is any quantity, quality, or characteristic that can change or vary across different individuals, situations, or over time. In psychological research, some variables are straightforward and simple to measure, such as age or height, while others are more complex and require careful operational definition to be studied empirically.

Variable

Spielman, R. M., Jenkins, W. J., & Lovett, M. D. (2020, April 22). Psychology (2nd ed.). OpenStax. https://openstax.org/books/psychology-2e/pages/1-introduction

OpenStax Psychology (2nd ed.) Textbook

Population

Cons of using surveys include:

- Surveys rely on self-reported data, which limits the types of information that can be collected.
- People may lie on surveys as they want to be viewed favorably.

Cons of Using Surveys

A key benefit of survey research is its efficiency in data collection. Surveys allow researchers to gather a substantial volume of information from a large sample of participants in a relatively short amount of time.

Advantages of Survey Research

An example of an online survey invitation typically begins with a polite greeting to the visitor and emphasizes the value of their opinion. It then states the survey's purpose, such as gathering feedback on a specific topic like news consumption habits, and provides an estimated completion time, for instance, 10-15 minutes. The invitation concludes with a clear call to action, instructing the user on how to start the survey, often by clicking a "Yes" or "No" button to indicate their willingness to participate.

Example of an Online Survey Invitation

When compared to case studies, surveys have the distinct advantage of collecting data from much larger samples. A large and diverse sample is more likely to accurately represent the diversity of the overall population, which significantly enhances the generalizability of the research findings. Conversely, the strength of case studies lies in their depth; surveys cannot gather the same level of detailed information on each participant as is possible through an in-depth case study.

Comparison of Surveys and Case Studies

A notable example of a comprehensive survey is the doctoral research by Ruth W. Howard. In 1934, she conducted a study by surveying 229 sets of triplets, which was the most extensive research on triplets at the time.

Ruth W. Howard's Triplet Survey

A primary advantage of the survey method is its efficiency in data collection. It allows researchers to gather large quantities of information from a substantial number of participants in a relatively short period.

Advantage of Surveys: Efficient Data Collection

A significant limitation of the survey method is that it relies on self-reporting, meaning participants do not always provide accurate responses. Individuals might intentionally lie, unintentionally misremember details, or answer questions in a way they believe makes them look good, which can compromise the reliability of the data.

Weakness of Survey Research: Reliance on Honest Self-Reporting

A drawback of surveys is that the data they yield is often relatively shallow, especially when contrasted with the in-depth information gathered through methods like case studies.

Weakness of Survey Research: Shallow Data

A team of public health researchers wants to quickly gather data on the dietary habits and attitudes towards nutrition from a large, geographically diverse sample of 5,000 adults. Which of the following data collection strategies would be the most practical and effective for achieving this specific research goal?

A major advantage of survey research is that it enables researchers to collect data from relatively large samples with ease. This capacity for widespread data collection makes it significantly easier to generalize the research findings to the broader population, especially when compared to methods that rely on smaller groups.

Advantage of Survey Research: Generalizability

In a 2012 study by Jenkins and colleagues, researchers used a survey to investigate the persistence of negative attitudes toward the US Arab-American community following the September 11, 2001 terrorist attacks. The survey included direct questions about overt prejudice and indirect questions assessing participants' willingness to socially interact with various ethnicities. Although participants directly denied holding prejudicial attitudes, their indirect responses revealed a significantly lower willingness to interact with Arab-Americans compared to other groups. This research illustrates how surveys can detect subtle forms of prejudice, even when direct self-reports are inaccurate or biased.

Example of Survey Research: Uncovering Subtle Prejudice

A sample is a smaller subset of individuals selected from a larger population of interest. Because it is usually impossible to study every member of a population, researchers measure variables within a sample with the intention of generalizing their findings back to the broader group, ideally using a representative sample that closely resembles the population.

Sample

In the context of survey research, a respondent is the term used to describe a study participant. These individuals provide the primary data for the study by directly self-reporting on their own behaviors, thoughts, beliefs, or feelings, typically through structured interviews or questionnaires.

Respondent

Survey research is a versatile methodology utilized to investigate a wide range of basic and applied research questions. It is predominantly used as a non-experimental research design to describe single variables, such as estimating the prevalence of mental disorders, or to identify statistical relationships among naturally occurring variables. Additionally, surveys can function as a data collection method within experimental research to test specific hypotheses concerning causal relationships between variables. When deployed with large and diverse samples, these survey-based experiments provide a valuable complement to traditional laboratory studies.

Applications of Surveys

Survey research is a flexible methodology that incorporates both quantitative and qualitative approaches, defined by two primary characteristics. First, it relies on self-report measures, where researchers ask participants to directly report on their thoughts, feelings, and behaviors using tools like questionnaires or interviews. Second, it emphasizes rigorous sampling techniques, typically favoring large random samples to acquire accurate estimates of population characteristics. This makes survey research one of the few approaches in psychology that routinely relies on random sampling.

Characteristics of Survey Research

The methodological roots of survey research can be traced back to English and American social surveys from the turn of the $$20$$th century, which aimed to systematically document widespread social issues such as poverty. In the $$1930$$s, the methodology progressed significantly as the United States government initiated nationwide surveys to assess social and economic conditions. The necessity to draw accurate inferences about the entire population from these surveys spurred crucial advancements in sampling techniques.

Origins of Survey Research

Following the September 11 terrorist attacks, researchers demonstrated the utility of survey research in psychology by conducting a large-scale internet survey on risk perception. The survey results indicated that participants generally tended to overestimate most risks, that females overestimated risks more than males, and that there were no differences in risk perception between teens and adults. To test their specific hypotheses about emotion, the researchers also incorporated an experimental manipulation within the survey by priming participants to feel either anger or fear. This revealed that risk perceptions are strongly tied to specific emotions; notably, individuals primed to feel anger perceived significantly less risk than those primed to feel fear.

Example of Survey Research: Emotion and Risk Perception

Designing an effective survey is difficult because participants' answers can be unintentionally influenced by factors such as question wording, the order of items, and the available response options. These unintended influences can introduce statistical noise or create systematic biases that lead to misleading results. To maximize the reliability and validity of the data, researchers must apply specific construction principles to minimize these negative effects.

Survey Construction Challenges

Researchers primarily conduct surveys using four main methods: in-person interviews, telephone surveys, mail surveys, and internet surveys. The decision of which mode to use depends on the specific goals of the research and the available budget.

Survey Administration Mode

Which of the following best defines a survey as used in psychological research?

A constant is a property or quantity that does not vary across individuals or situations, such as the speed of light. Because constants do not change, they are not the focus of psychological research questions, which instead seek to understand phenomena that vary.

Constant

A quantitative variable is a type of variable that represents a measurable quantity, typically assessed by assigning a numerical value to each individual. Common examples in psychological research include a person's height, level of talkativeness, number of siblings, or score on a depression scale.

Quantitative Variable

A categorical variable is a type of variable that represents a characteristic or quality, typically assessed by assigning a descriptive category label to each individual rather than a number. Examples include a person's chosen major, nationality, occupation, or whether they are receiving psychotherapy.

Categorical Variable

An abstract construct, also referred to as an intangible variable, is a psychological characteristic or internal state that cannot be directly observed, such as self-esteem, mood, or a behavioral intention. Because psychological research relies on empirical data, researchers must develop specific methods to transform these intangible concepts into quantifiable variables so they can be measured and studied.

Abstract Construct

In experimental research, an independent variable is the presumed cause in a cause-and-effect relationship. It is the specific factor that a researcher systematically manipulates or varies to observe its impact on another variable. While experiments require manipulation, in some non-experimental or factorial designs, an independent variable may simply be measured.

Independent Variable

A dependent variable is the factor in an experiment that represents the presumed effect within a causal relationship. It is the variable that researchers measure to evaluate if it changes as a direct result of the manipulation of the independent variable.

Dependent Variable

In research, a population is the entire, often very large, group of individuals that researchers are interested in studying and drawing conclusions about. Depending on the researcher's goals, a population could be as broad as all human beings or as specific as all American teenagers, children with autism, or professional athletes.

To illustrate how quantities and qualities can vary across individuals or situations, consider the students enrolled in a university course. The physical height of these students serves as a clear example of a variable because it differs from one individual to another. Similarly, their chosen major is also a variable, provided that the class consists of students who have declared different fields of study. These illustrations demonstrate how commonly variations occur in the world.

Example of a Variable: Height and Chosen Major

Non-experimental research is a broad category of research methodologies defined by the lack of manipulation of an independent variable. Instead of controlling factors, researchers simply measure variables as they naturally occur in real-world or laboratory settings. Although experimental research can provide strong evidence that changes in an independent variable cause differences in a dependent variable, non-experimental research generally cannot. Despite this inability to draw causal conclusions, non-experimental research is still considered extremely important and is utilized in cases where experimental research cannot be carried out.

Non-Experimental Research

The distribution of a variable describes how individual scores or values are spread across the different levels or categories of that specific variable within a dataset.

Variable Distribution

In psychology, a construct is a complex variable that defies direct observation or straightforward measurement—such as an attitude, ability, personality trait, or emotional state. These variables cannot be seen directly because they represent broad behavioral tendencies rather than isolated actions, and they involve hidden internal processes like specific feelings, thoughts, and nervous system activities. Ultimately, a construct acts as a theoretical summary that encapsulates these intricate sets of internal and external processes.

Psychological Construct

Measurement is the process of systematically assigning scores to individuals or objects so that these scores accurately represent a specific characteristic of interest. Crucially, this broad concept does not limit measurement to the use of specific physical instruments or tools; rather, it requires any methodical procedure that yields a representative score.

Measurement

An operational definition defines a psychological variable in terms of the exact procedures used to measure or observe it. Because most variables are abstract constructs that cannot be directly observed (e.g., stress), researchers must transform these conceptual definitions into concrete, quantifiable forms. For instance, stress could be operationally defined as a score on a standardized questionnaire, the concentration of cortisol in saliva, or the number of recent stressful life events experienced.

Operational Definition

A participant variable, also known as an individual difference, is a type of extraneous variable derived from the pre-existing characteristics of the individuals involved in an experiment. Examples of these variables include demographic factors such as gender, as well as personal attributes or habits like diet and writing ability. Because these individual differences are likely to have their own independent effect on the dependent variable, they must be controlled to prevent them from obscuring the effect of the experimental manipulation.

Participant Variable

Psychological measurement is the systematic empirical process of quantifying abstract variables and constructs—such as moods, self-esteem, or behavioral intentions—to facilitate scientific analysis. By utilizing standardized tools and methodologies, researchers can translate intangible psychological characteristics into objective, numerical data that can be rigorously evaluated and studied.

Psychological Measurement

The distribution of a variable describes how scores or values are spread out across the different levels or categories of that specific variable.

Learn Before

Related

Learn After