Research Design

Research Design

Research Design Jonathan Poland

Research design is the overall plan or approach that a researcher follows in order to study a particular research question. There are many different research designs that can be used, depending on the specific goals and characteristics of the research project.

For example, a researcher might use a descriptive research design to simply observe and describe a particular phenomenon, or a experimental research design to test a hypothesis by manipulating variables and observing the effects. Other common research designs include cross-sectional, longitudinal, and mixed-methods designs. These research designs are used to guide the collection and analysis of data, and to help ensure that the research is rigorous and reliable. The following are common types of research design.

Secondary Research

Review and narrative that is based on existing sources.

Meta-analysis

Analysis that uses existing sources. For example, a review of multiple studies that numerically aggregates and summarizes their findings.

Primary Research

Primary research produces new observations. Also known as original research.

Qualitative Research

Collecting, analyzing, and interpreting non-numerical data such as interviews with people.

Qualitative Research

Collecting, analyzing, and interpreting non-numerical data such as sensor readings.

Scientific Research

Research that strictly conforms to the scientific method including elements such as a falsifiable hypothesis, empirical evidence and peer review.

Correlational Research

Correlational research looks for correlations between variables without manipulating these variables. Correlation doesn’t equal causation such that these studies can produce misleading impressions that one thing causes another when both may be influenced by some third factor.

Data Dredging

Using software to automatically find correlated variables in datasets. This can be used to produce fraudulent research whereby a researcher misrepresents their method by pretending to start with a research question when they actually worked backwards from automatically discovered correlations. Data dredging also plays a valid role in exploratory research.

Exploratory Research

Research that lays the groundwork for other research. For example, a data analysis that is used to formulate a problem statement, hypothesis or experiment design.

Causal-Comparative Research

Causal-comparative research attempts to use data to establish evidence for a cause and effect relationship. This might use several datasets and detailed controls that aggressively seek to eliminate alternative explanations for an effect. For example, if people who live near busy highways have a higher risk of some health problem a study may control for other factors that may explain this correlation such as income level or lifestyle.

Observational Study

Research where the independent variable isn’t controlled such that it isn’t an experiment. This can be exploratory research, correlational research or causal-comparative research.

Cohort Study

Studies based on groups of people who share a common characteristic, known as a cohort.

Prospective Cohort

Choosing the members of cohorts at the start of a study.

Retrospective Cohort

Cohorts are selected based on historical data. Runs some risk that the researcher will aggressively define the cohort to fit some pattern found in the data.

Case–control Study

A retrospective cohort selected based on outcomes such as comparing the lifestyle of people who get a disease with those who don’t get it. Useful for exploratory research but problematic for establishing cause and effect. For example, if you scan for differences in the lifestyle of people who graduate high school and those who don’t you may find that jelly donut consumption are different between these two cohorts but it is a stretch to suggest this is a cause.

Case Study

A detailed report of a single example. Useful for exploratory research. For example, a doctor who documents an allergic reaction to a chemical that hasn’t been on the market for long.

Longitudinal Study

Measuring the same variables over an extended period of time. Often an observational cohort study that observes a group of people over some time period. However, experimental research can also be a longitudinal study such as an experiment on a field of crops for half a year.

Cross-sectional Study

A study that compares observations at a point in time. For example, comparing the air quality of cities and the rate of a disease in those cities with the most recent data available for each city.

Experimental Research

Experimental research is the testing of a hypothesis or multiple hypotheses with experiments. This involves changing an independent variable to observe corresponding changes to a dependent variable. For example, a researcher who produces different types of stainless steel formulations to test which is most resistant to seawater.

Lab Experiment

An experiment in a lab where many variables can be controlled. For example, testing a fertilizer on plants in a lab where you can control extraneous variables such as light, temperature, humidity and water.

Field Experiment

An experiment that occurs in the real world where some variables can’t be controlled. For example, testing a fertilizer on a farm.

Randomized Controlled Trial

A standard for important experiments such as clinical trials for medical treatments that uses random allocation of participants to treatment and control groups to achieve statistical control over factors that may influence results. For example, if body weight may influence the outcome of a trial, people can be randomly distributed into treatment and control groups such that body weight distributions are likely to be similar in each group.

Natural Experiment

A natural experiment is a real world situation that resembles an experiment. This is useful were experiments would likely be unethical. For example, a factory where workers are currently exposed to a hazardous substance.

Constructive Research

Constructive research addresses a real world problem. For example, computer science research that seeks to design algorithms to perform a computation more efficiently.

Research & Development

Constructive research that designs a process, method, procedure, device, machine, product or service. For example, rapid prototyping of possible battery technologies.

Types of Fallacies Jonathan Poland

Types of Fallacies

A fallacy is an error in reasoning that can lead to an incorrect conclusion. Fallacies can be found in arguments,…

Lifetime Customer Value Jonathan Poland

Lifetime Customer Value

Lifetime customer value (LCV) is a measure of the total value that a customer will bring to a business over…

What is a Tagline? Jonathan Poland

What is a Tagline?

A tagline is a short, catchy phrase that is used to summarize the core message or value proposition of a…

Unknown Risk Jonathan Poland

Unknown Risk

An unknown risk is a potential loss that is not recognized or identified. In the context of risk management, unknown…

Legal Risk Jonathan Poland

Legal Risk

Legal risk is the risk of financial loss or other negative consequences that may arise from legal action or non-compliance…

Performance Improvement Plan Jonathan Poland

Performance Improvement Plan

A performance improvement plan (PIP) is a formal document that outlines specific goals and objectives that are assigned to an…

Project Management Skills Jonathan Poland

Project Management Skills

Project management skills are a combination of talents, knowledge, and experience that enable an individual to effectively plan and execute…

Capitalist Realism Jonathan Poland

Capitalist Realism

Capitalist realism is the theory that capitalism is the only economic system that is realistically possible or viable. This term…

Network Infrastructure Jonathan Poland

Network Infrastructure

Network infrastructure refers to the hardware and software components that are used to build and support a computer network. It…

Learn More

What is Stagflation? Jonathan Poland

What is Stagflation?

Stagflation is a period of high inflation, low economic growth and high unemployment. Stagflation is a economic phenomenon in which…

Total Addressable Market Jonathan Poland

Total Addressable Market

A total addressable market (TAM) is the total potential revenue that a company can generate from its products or services…

External Risk Jonathan Poland

External Risk

An external risk is a type of risk that is outside of your control and cannot be influenced or managed…

Business Development Jonathan Poland

Business Development

Business development is a multifaceted discipline that involves identifying and pursuing opportunities to grow a business. It’s a combination of…

Microtransactions Jonathan Poland

Microtransactions

Microtransactions is a large scale industry that is becoming a dominant business for certain types of companies. They are small…

Building Trust Jonathan Poland

Building Trust

To build trust, it is necessary to engage in ongoing behavior that helps people trust you. In general, people tend…

Labor Specialization Jonathan Poland

Labor Specialization

Specialization of labor involves dividing work into specific roles or tasks, with the goal of improving productivity, efficiency, quality, and…

Organizational Capital Jonathan Poland

Organizational Capital

Organizational capital refers to the intangible assets and resources within an organization that support its operations and enable it to…

Operations Planning Jonathan Poland

Operations Planning

Operations planning involves identifying and implementing strategies and tactics to optimize the core processes and practices that enable a business…