Research Design

Research Design

Research Design Jonathan Poland

Research design is the overall plan or approach that a researcher follows in order to study a particular research question. There are many different research designs that can be used, depending on the specific goals and characteristics of the research project.

For example, a researcher might use a descriptive research design to simply observe and describe a particular phenomenon, or a experimental research design to test a hypothesis by manipulating variables and observing the effects. Other common research designs include cross-sectional, longitudinal, and mixed-methods designs. These research designs are used to guide the collection and analysis of data, and to help ensure that the research is rigorous and reliable. The following are common types of research design.

Secondary Research

Review and narrative that is based on existing sources.

Meta-analysis

Analysis that uses existing sources. For example, a review of multiple studies that numerically aggregates and summarizes their findings.

Primary Research

Primary research produces new observations. Also known as original research.

Qualitative Research

Collecting, analyzing, and interpreting non-numerical data such as interviews with people.

Qualitative Research

Collecting, analyzing, and interpreting non-numerical data such as sensor readings.

Scientific Research

Research that strictly conforms to the scientific method including elements such as a falsifiable hypothesis, empirical evidence and peer review.

Correlational Research

Correlational research looks for correlations between variables without manipulating these variables. Correlation doesn’t equal causation such that these studies can produce misleading impressions that one thing causes another when both may be influenced by some third factor.

Data Dredging

Using software to automatically find correlated variables in datasets. This can be used to produce fraudulent research whereby a researcher misrepresents their method by pretending to start with a research question when they actually worked backwards from automatically discovered correlations. Data dredging also plays a valid role in exploratory research.

Exploratory Research

Research that lays the groundwork for other research. For example, a data analysis that is used to formulate a problem statement, hypothesis or experiment design.

Causal-Comparative Research

Causal-comparative research attempts to use data to establish evidence for a cause and effect relationship. This might use several datasets and detailed controls that aggressively seek to eliminate alternative explanations for an effect. For example, if people who live near busy highways have a higher risk of some health problem a study may control for other factors that may explain this correlation such as income level or lifestyle.

Observational Study

Research where the independent variable isn’t controlled such that it isn’t an experiment. This can be exploratory research, correlational research or causal-comparative research.

Cohort Study

Studies based on groups of people who share a common characteristic, known as a cohort.

Prospective Cohort

Choosing the members of cohorts at the start of a study.

Retrospective Cohort

Cohorts are selected based on historical data. Runs some risk that the researcher will aggressively define the cohort to fit some pattern found in the data.

Case–control Study

A retrospective cohort selected based on outcomes such as comparing the lifestyle of people who get a disease with those who don’t get it. Useful for exploratory research but problematic for establishing cause and effect. For example, if you scan for differences in the lifestyle of people who graduate high school and those who don’t you may find that jelly donut consumption are different between these two cohorts but it is a stretch to suggest this is a cause.

Case Study

A detailed report of a single example. Useful for exploratory research. For example, a doctor who documents an allergic reaction to a chemical that hasn’t been on the market for long.

Longitudinal Study

Measuring the same variables over an extended period of time. Often an observational cohort study that observes a group of people over some time period. However, experimental research can also be a longitudinal study such as an experiment on a field of crops for half a year.

Cross-sectional Study

A study that compares observations at a point in time. For example, comparing the air quality of cities and the rate of a disease in those cities with the most recent data available for each city.

Experimental Research

Experimental research is the testing of a hypothesis or multiple hypotheses with experiments. This involves changing an independent variable to observe corresponding changes to a dependent variable. For example, a researcher who produces different types of stainless steel formulations to test which is most resistant to seawater.

Lab Experiment

An experiment in a lab where many variables can be controlled. For example, testing a fertilizer on plants in a lab where you can control extraneous variables such as light, temperature, humidity and water.

Field Experiment

An experiment that occurs in the real world where some variables can’t be controlled. For example, testing a fertilizer on a farm.

Randomized Controlled Trial

A standard for important experiments such as clinical trials for medical treatments that uses random allocation of participants to treatment and control groups to achieve statistical control over factors that may influence results. For example, if body weight may influence the outcome of a trial, people can be randomly distributed into treatment and control groups such that body weight distributions are likely to be similar in each group.

Natural Experiment

A natural experiment is a real world situation that resembles an experiment. This is useful were experiments would likely be unethical. For example, a factory where workers are currently exposed to a hazardous substance.

Constructive Research

Constructive research addresses a real world problem. For example, computer science research that seeks to design algorithms to perform a computation more efficiently.

Research & Development

Constructive research that designs a process, method, procedure, device, machine, product or service. For example, rapid prototyping of possible battery technologies.

Objection Handling Jonathan Poland

Objection Handling

Objection handling is the practice of addressing and overcoming concerns or hesitations that customers may have about making a purchase.…

Marketing Message Jonathan Poland

Marketing Message

A marketing message refers to any media or communication that is intended to persuade or influence customers. Marketing messages can…

Cost Variance Jonathan Poland

Cost Variance

Cost variance (CV) is a project management metric that measures the difference between the budgeted cost of a project and…

Target Audience Jonathan Poland

Target Audience

A target audience refers to the specific group of individuals or consumers that a business or organization is trying to…

Latent Need Jonathan Poland

Latent Need

A latent need is a customer need that is not currently being met by the market and is not actively…

Competitive Threats Jonathan Poland

Competitive Threats

A competitive threat is a potential source of competition that has not yet materialized, but has the potential to do…

Human Behavior Jonathan Poland

Human Behavior

Behavior is a pattern of actions or reactions that varies depending on factors such as context and mood. It is…

What is a Self-Replicating Machine? Jonathan Poland

What is a Self-Replicating Machine?

Self-replicating machines are robots or nanobots that are capable of producing copies of themselves, using scavenged materials and energy to…

Overthinking Jonathan Poland

Overthinking

Overthinking, also known as rumination, is a thought process that involves excessive and prolonged contemplation of a problem or situation.…

Learn More

Marketing Costs Jonathan Poland

Marketing Costs

Marketing costs are expenses that are related to promoting and selling products or services to customers. These costs can include…

Target Costing Jonathan Poland

Target Costing

Target costing is a cost management approach that involves setting a target cost for a product or service and then…

What are Field Services? Jonathan Poland

What are Field Services?

Field service involves managing and deploying resources and assets at customer, public, and third-party locations, as well as providing services…

Brand Analysis Jonathan Poland

Brand Analysis

Brand analysis is the process of systematically and thoroughly examining a brand in order to develop strategies, plans, evaluations, metrics,…

What is the Broken Window Fallacy? Jonathan Poland

What is the Broken Window Fallacy?

The broken window fallacy refers to the idea that the economic benefits of destructive events, such as wars and natural…

A/B Testing Jonathan Poland

A/B Testing

A/B testing, also known as split testing or experimentation, is a statistical method used to compare two versions of a…

Managing Expectations Jonathan Poland

Managing Expectations

Managing expectations is the practice of communicating information to prevent gaps between stakeholder perceptions and business realities. It is common…

Time To Value Jonathan Poland

Time To Value

Overview Time to Value (TTV) is a business concept that refers to the period it takes for a customer to…

Project Management Skills Jonathan Poland

Project Management Skills

Project management skills are a combination of talents, knowledge, and experience that enable an individual to effectively plan and execute…