Impact Evaluation

Impact Evaluation

Impact Evaluation Jonathan Poland

An impact evaluation is a study that measures the actual outcomes and consequences of a change. It takes into account both intended and unintended effects of the change, and aims to determine its overall impact. This means that a program or project may achieve its goals, but have negative unintended consequences. On the other hand, a program that is perceived as a failure due to budget and schedule issues may actually have a more positive impact than originally anticipated by its planners. Impact evaluations help organizations understand the full range of impacts of a change and can inform decision-making about future changes or interventions. The following are illustrative examples of an impact evaluation.

Cities

A city expands its highway system to more lanes only to discover that within a few short years traffic jams have once again become a common occurrence. An impact study indicates that the new lanes encouraged development of land further from the downtown core making the city less dense and increasing average commuting distance.

Transportation

A program to develop a system of high speed trains is initially viewed as a failure as it exceeds planned budget. However, within a decade ridership is far greater than business plans had anticipated. The overall impact on the economy, quality of life and the environment can be demonstrated to be exceedingly positive.

Education

An education system abandons standardized testing in high schools in favor of tests crafted by individual teachers. A later impact study looked at data before and after to determine that grade inflation occurred with the abandonment of the standard tests. This led universities and colleges to begin to rank schools and apply more complex admission processes than were far less transparent to students.

Marketing

A newspaper begins aggressively optimizing the titles of its articles with A/B testing. This immediately increases overall revenue. A later impact study indicates that the quality of titles dropped dramatically such that titles often didn’t reflect the content of articles. The optimization effort was associated with a steady decline in reputation, customer satisfaction and subscription rates.

Learn More
Overchoice Jonathan Poland

Overchoice

Overchoice, also known as the “paradox of choice,” is a phenomenon in which having too many options or choices can…

Job Titles Jonathan Poland

Job Titles

Job titles are brief labels that are used to describe the duties, goals, and expectations of a job. Some companies…

Elastic Demand Jonathan Poland

Elastic Demand

Elastic demand is a term used in economics to describe the responsiveness of the quantity of a good or service…

Economic Advantage Jonathan Poland

Economic Advantage

A competitive advantage is a feature or characteristic that allows a company to perform better than its competitors in a…

Knowledge Work Jonathan Poland

Knowledge Work

Knowledge work refers to work that involves the creation, use, or application of knowledge and expertise. It is characterized by…

Process Improvement Jonathan Poland

Process Improvement

Process improvement is a systematic approach to identifying and implementing changes to processes within an organization in order to improve…

Agency Cost Jonathan Poland

Agency Cost

An agency cost is an inefficiency that arises when there are differences in the motivations and access to information between…

Employee Retention Jonathan Poland

Employee Retention

Employee retention refers to the success of a company in keeping its talented employees from leaving. High employee turnover can…

Algorithmic Accountability Jonathan Poland

Algorithmic Accountability

Algorithmic accountability is the concept of holding algorithms and the organizations that use them accountable for the decisions they make…

Content Database

Search over 1,000 posts on topics across
business, finance, and capital markets.

What is Service Life Jonathan Poland

What is Service Life

The service life of a product refers to the length of time it can be used before it needs to…

Waste is Food Jonathan Poland

Waste is Food

The concept of “waste is food” is based on the idea that an industrial economy should not produce any waste except for biological nutrients that can be safely returned to the environment.

How does a plane fly? Jonathan Poland

How does a plane fly?

A plane flies due to a combination of four fundamental forces: lift, weight (gravity), thrust, and drag. These forces work…

Market Forces Jonathan Poland

Market Forces

The interaction that shapes a market economy. Market forces are the factors that determine the supply and demand for a…

Time To Value Jonathan Poland

Time To Value

Overview Time to Value (TTV) is a business concept that refers to the period it takes for a customer to…

Praxeology Jonathan Poland

Praxeology

Praxeology is the study of human action, particularly as it pertains to decision-making and the pursuit of goals. The term…

What is a One Stop Shop? Jonathan Poland

What is a One Stop Shop?

A one stop shop is a business that offers a wide range of products and services from a single location,…

Variable Pricing Jonathan Poland

Variable Pricing

Variable pricing is a pricing strategy in which prices are set based on real-time data and can vary depending on…

Brand Metrics Jonathan Poland

Brand Metrics

Brand metrics are used to assess the effectiveness of branding efforts and marketing strategies in terms of brand identity, positioning,…