Impact Evaluation

Impact Evaluation

Impact Evaluation Jonathan Poland

An impact evaluation is a study that measures the actual outcomes and consequences of a change. It takes into account both intended and unintended effects of the change, and aims to determine its overall impact. This means that a program or project may achieve its goals, but have negative unintended consequences. On the other hand, a program that is perceived as a failure due to budget and schedule issues may actually have a more positive impact than originally anticipated by its planners. Impact evaluations help organizations understand the full range of impacts of a change and can inform decision-making about future changes or interventions. The following are illustrative examples of an impact evaluation.

Cities

A city expands its highway system to more lanes only to discover that within a few short years traffic jams have once again become a common occurrence. An impact study indicates that the new lanes encouraged development of land further from the downtown core making the city less dense and increasing average commuting distance.

Transportation

A program to develop a system of high speed trains is initially viewed as a failure as it exceeds planned budget. However, within a decade ridership is far greater than business plans had anticipated. The overall impact on the economy, quality of life and the environment can be demonstrated to be exceedingly positive.

Education

An education system abandons standardized testing in high schools in favor of tests crafted by individual teachers. A later impact study looked at data before and after to determine that grade inflation occurred with the abandonment of the standard tests. This led universities and colleges to begin to rank schools and apply more complex admission processes than were far less transparent to students.

Marketing

A newspaper begins aggressively optimizing the titles of its articles with A/B testing. This immediately increases overall revenue. A later impact study indicates that the quality of titles dropped dramatically such that titles often didn’t reflect the content of articles. The optimization effort was associated with a steady decline in reputation, customer satisfaction and subscription rates.

Learn More
Job Levels Jonathan Poland

Job Levels

Job levels, also known as career levels or job grades, refer to the hierarchical structure within an organization. They are…

Digital Channels Jonathan Poland

Digital Channels

A digital channel is a means of distributing or selling products or services electronically, as opposed to through physical channels…

Decision Trees Jonathan Poland

Decision Trees

Decision Trees are a popular machine learning algorithm used for both classification and regression tasks. They are part of a…

Curiosity Drive Jonathan Poland

Curiosity Drive

Curiosity drive, or the desire to obtain new information, is a fundamental human motivation that drives learning and exploration. In…

Asset Based Lending Jonathan Poland

Asset Based Lending

Asset-based lending (ABL) is a type of business financing in which a loan or line of credit is secured by…

Capital Improvements Jonathan Poland

Capital Improvements

Capital improvements are investments in new assets or the improvement of existing assets that are intended to provide a long-term…

Market Potential Jonathan Poland

Market Potential

Market potential is the entire size of the market for a product at a specific time. It represents the upper limits of the market for a product. Market potential is usually measured either by sales value or sales volume.

Machine Learning Jonathan Poland

Machine Learning

Machine learning is a method of teaching computers to learn from data, without being explicitly programmed. It is a type…

Modular Products Jonathan Poland

Modular Products

Modular products are products that are made up of standardized, interchangeable parts or modules that can be easily assembled and…

Latest Thinking

Qualified Small Business Stock (QSBS) Jonathan Poland

Qualified Small Business Stock (QSBS)

Qualified Small Business Stock (QSBS) refers to a special classification of stock in the United States that offers significant tax…

Barrick Gold Jonathan Poland

Barrick Gold

Barrick Gold Corporation (NYSE: GOLD) is a significant player in the global economy, particularly within the gold mining industry. Its…

Newmont Corporation Jonathan Poland

Newmont Corporation

Newmont Corporation (NYSE: NEM), being the world’s largest gold mining corporation, with extensive operations in mining and production of not…

Gold is Money Jonathan Poland

Gold is Money

Overview The history of gold as money spans thousands of years and has played a pivotal role in the economic…

What is Leadership? Jonathan Poland

What is Leadership?

In the modern business world, where rapid changes, technological advancements, and global challenges are the norm, effective leadership is more…

Product Durability Jonathan Poland

Product Durability

A durable product, often referred to as a durable good, is a product that does not quickly wear out or,…

Durable Competitive Advantage Jonathan Poland

Durable Competitive Advantage

The most important aspect of durability is market fit. Unique super simple products or services that does change much if…

Praxeology Jonathan Poland

Praxeology

Praxeology is the study of human action, particularly as it pertains to decision-making and the pursuit of goals. The term…

Business Models Jonathan Poland

Business Models

Business models define how a company creates, delivers, and captures value. There are numerous business models, each tailored to specific…