Impact Evaluation

Impact Evaluation

Impact Evaluation Jonathan Poland

An impact evaluation is a study that measures the actual outcomes and consequences of a change. It takes into account both intended and unintended effects of the change, and aims to determine its overall impact. This means that a program or project may achieve its goals, but have negative unintended consequences. On the other hand, a program that is perceived as a failure due to budget and schedule issues may actually have a more positive impact than originally anticipated by its planners. Impact evaluations help organizations understand the full range of impacts of a change and can inform decision-making about future changes or interventions. The following are illustrative examples of an impact evaluation.

Cities

A city expands its highway system to more lanes only to discover that within a few short years traffic jams have once again become a common occurrence. An impact study indicates that the new lanes encouraged development of land further from the downtown core making the city less dense and increasing average commuting distance.

Transportation

A program to develop a system of high speed trains is initially viewed as a failure as it exceeds planned budget. However, within a decade ridership is far greater than business plans had anticipated. The overall impact on the economy, quality of life and the environment can be demonstrated to be exceedingly positive.

Education

An education system abandons standardized testing in high schools in favor of tests crafted by individual teachers. A later impact study looked at data before and after to determine that grade inflation occurred with the abandonment of the standard tests. This led universities and colleges to begin to rank schools and apply more complex admission processes than were far less transparent to students.

Marketing

A newspaper begins aggressively optimizing the titles of its articles with A/B testing. This immediately increases overall revenue. A later impact study indicates that the quality of titles dropped dramatically such that titles often didn’t reflect the content of articles. The optimization effort was associated with a steady decline in reputation, customer satisfaction and subscription rates.

Learn More…

Product Analysis Jonathan Poland

Product Analysis

Product analysis is the process of evaluating a product for the purpose…

What is a thought experiment? Jonathan Poland

What is a thought experiment?

A thought experiment is a mental exercise that involves exploring the implications…

What is a Durable Product? Jonathan Poland

What is a Durable Product?

A durable product is a product that is designed to last for…

Business Decisions Jonathan Poland

Business Decisions

A business decision is a commitment made by a company, team, or…

Internal Communication Jonathan Poland

Internal Communication

Internal communication is the exchange of information within an organization that is…

Feedback Loop Jonathan Poland

Feedback Loop

A feedback loop is a process in which the output of a…

Critical Mass Jonathan Poland

Critical Mass

In economics, critical mass refers to the minimum size a company needs…

Examples of Consumer Goods Jonathan Poland

Examples of Consumer Goods

Consumer goods are physical products that are purchased by individuals for their…

Vertical Integration Jonathan Poland

Vertical Integration

Vertical integration is when a single company owns multiple levels or all of its supply chain.

Jonathan Poland © 2023

Search the Database

Over 1,000 posts on topics ranging from strategy to operations, innovation to finance, technology to risk and much more…

Marketing Channel Jonathan Poland

Marketing Channel

The total combined industries of consumer goods and services.

Life Skills Jonathan Poland

Life Skills

Life skills are essential abilities that enable individuals to navigate the complexities…

Value Proposition Jonathan Poland

Value Proposition

A value proposition is a statement that explains the unique value that…

Internal Benchmarking Jonathan Poland

Internal Benchmarking

Internal benchmarking is the process of comparing the performance of one aspect…

Conflicts of Interest Jonathan Poland

Conflicts of Interest

A conflict of interest exists when an individual or organization has incentives…

Risk Impact Jonathan Poland

Risk Impact

Risk impact refers to the potential consequences or losses that an organization…

Active Silence Jonathan Poland

Active Silence

Active silence is the intentional and strategic use of silence in communication.…

Capital Goods Jonathan Poland

Capital Goods

Capital goods are physical assets that are used in the production of…

Rites of Passage Jonathan Poland

Rites of Passage

A rite of passage is a ceremony or event that marks an…