Research Design

Research Design

Research Design Jonathan Poland

Research design is the overall plan or approach that a researcher follows in order to study a particular research question. There are many different research designs that can be used, depending on the specific goals and characteristics of the research project.

For example, a researcher might use a descriptive research design to simply observe and describe a particular phenomenon, or a experimental research design to test a hypothesis by manipulating variables and observing the effects. Other common research designs include cross-sectional, longitudinal, and mixed-methods designs. These research designs are used to guide the collection and analysis of data, and to help ensure that the research is rigorous and reliable. The following are common types of research design.

Secondary Research

Review and narrative that is based on existing sources.

Meta-analysis

Analysis that uses existing sources. For example, a review of multiple studies that numerically aggregates and summarizes their findings.

Primary Research

Primary research produces new observations. Also known as original research.

Qualitative Research

Collecting, analyzing, and interpreting non-numerical data such as interviews with people.

Qualitative Research

Collecting, analyzing, and interpreting non-numerical data such as sensor readings.

Scientific Research

Research that strictly conforms to the scientific method including elements such as a falsifiable hypothesis, empirical evidence and peer review.

Correlational Research

Correlational research looks for correlations between variables without manipulating these variables. Correlation doesn’t equal causation such that these studies can produce misleading impressions that one thing causes another when both may be influenced by some third factor.

Data Dredging

Using software to automatically find correlated variables in datasets. This can be used to produce fraudulent research whereby a researcher misrepresents their method by pretending to start with a research question when they actually worked backwards from automatically discovered correlations. Data dredging also plays a valid role in exploratory research.

Exploratory Research

Research that lays the groundwork for other research. For example, a data analysis that is used to formulate a problem statement, hypothesis or experiment design.

Causal-Comparative Research

Causal-comparative research attempts to use data to establish evidence for a cause and effect relationship. This might use several datasets and detailed controls that aggressively seek to eliminate alternative explanations for an effect. For example, if people who live near busy highways have a higher risk of some health problem a study may control for other factors that may explain this correlation such as income level or lifestyle.

Observational Study

Research where the independent variable isn’t controlled such that it isn’t an experiment. This can be exploratory research, correlational research or causal-comparative research.

Cohort Study

Studies based on groups of people who share a common characteristic, known as a cohort.

Prospective Cohort

Choosing the members of cohorts at the start of a study.

Retrospective Cohort

Cohorts are selected based on historical data. Runs some risk that the researcher will aggressively define the cohort to fit some pattern found in the data.

Case–control Study

A retrospective cohort selected based on outcomes such as comparing the lifestyle of people who get a disease with those who don’t get it. Useful for exploratory research but problematic for establishing cause and effect. For example, if you scan for differences in the lifestyle of people who graduate high school and those who don’t you may find that jelly donut consumption are different between these two cohorts but it is a stretch to suggest this is a cause.

Case Study

A detailed report of a single example. Useful for exploratory research. For example, a doctor who documents an allergic reaction to a chemical that hasn’t been on the market for long.

Longitudinal Study

Measuring the same variables over an extended period of time. Often an observational cohort study that observes a group of people over some time period. However, experimental research can also be a longitudinal study such as an experiment on a field of crops for half a year.

Cross-sectional Study

A study that compares observations at a point in time. For example, comparing the air quality of cities and the rate of a disease in those cities with the most recent data available for each city.

Experimental Research

Experimental research is the testing of a hypothesis or multiple hypotheses with experiments. This involves changing an independent variable to observe corresponding changes to a dependent variable. For example, a researcher who produces different types of stainless steel formulations to test which is most resistant to seawater.

Lab Experiment

An experiment in a lab where many variables can be controlled. For example, testing a fertilizer on plants in a lab where you can control extraneous variables such as light, temperature, humidity and water.

Field Experiment

An experiment that occurs in the real world where some variables can’t be controlled. For example, testing a fertilizer on a farm.

Randomized Controlled Trial

A standard for important experiments such as clinical trials for medical treatments that uses random allocation of participants to treatment and control groups to achieve statistical control over factors that may influence results. For example, if body weight may influence the outcome of a trial, people can be randomly distributed into treatment and control groups such that body weight distributions are likely to be similar in each group.

Natural Experiment

A natural experiment is a real world situation that resembles an experiment. This is useful were experiments would likely be unethical. For example, a factory where workers are currently exposed to a hazardous substance.

Constructive Research

Constructive research addresses a real world problem. For example, computer science research that seeks to design algorithms to perform a computation more efficiently.

Research & Development

Constructive research that designs a process, method, procedure, device, machine, product or service. For example, rapid prototyping of possible battery technologies.

Risk Culture Jonathan Poland

Risk Culture

Risk culture refers to the values, attitudes, and behaviors related to risk management that are inherent in the culture of…

Branding Jonathan Poland

Branding

A brand is a name, term, design, symbol, or other feature that distinguishes one seller’s goods or services from those…

Data Breach Jonathan Poland

Data Breach

A data breach is a security incident in which sensitive, protected, or confidential data is accessed, disclosed, or stolen. Data…

Autonomous System Jonathan Poland

Autonomous System

An autonomous system is a system that is capable of functioning independently, without the need for human intervention. Autonomous systems…

Customer Dissatisfaction Jonathan Poland

Customer Dissatisfaction

Customer dissatisfaction refers to a customer’s negative evaluation of a product or service. It can be measured by asking customers…

Original Equipment Manufacturer Jonathan Poland

Original Equipment Manufacturer

An OEM (original equipment manufacturer) is a company that produces parts or equipment that is used in the manufacture of…

User Intent Jonathan Poland

User Intent

User intent refers to the goal or objective that a person has in mind at a given moment. Modeling user…

Business Analysis Jonathan Poland

Business Analysis

Business analysis is the practice of researching and developing strategies, plans, solutions, and studies to support the goals and objectives…

Accept vs Except Jonathan Poland

Accept vs Except

To accept is to consent, to receive or to believe something. Except means “not including.” Accept: to consent, to receive,…

Learn More

Revenue Operations Jonathan Poland

Revenue Operations

Revenue operations, also known as RevOps, is the practice of overseeing and optimizing an organization’s core sales processes. This includes…

Working Style Jonathan Poland

Working Style

Working style refers to an individual’s preferred approach to performing their job and completing tasks. This can include factors such…

Customer Service Techniques Jonathan Poland

Customer Service Techniques

Customer service is any person-to-person exchange between a business and a customer. Developing successful customer service is essential for any…

Phased Implementation Jonathan Poland

Phased Implementation

Phased implementation is a method of developing and introducing a business, brand, product, service, process, capability, or system by dividing…

Systematic Risk Jonathan Poland

Systematic Risk

Systemic risk is the risk that a problem in one part of the financial system will have broader impacts on…

Marketing Metrics Jonathan Poland

Marketing Metrics

Marketing metrics are a way to evaluate the success of marketing efforts at various levels, such as the organization, team,…

Internal Controls Jonathan Poland

Internal Controls

Internal controls refer to the structures, processes, practices, reports, measurements, and systems that are implemented within an organization to support…

Lifecycle Cost Analysis Jonathan Poland

Lifecycle Cost Analysis

Lifecycle cost analysis is a tool used to evaluate the total cost of owning and operating a product, system, or…

Product Experience Jonathan Poland

Product Experience

Product experience refers to the overall value that a product or service provides to customers based on their perceptions as…