Impact Evaluation

Impact Evaluation

Impact Evaluation Jonathan Poland

An impact evaluation is a study that measures the actual outcomes and consequences of a change. It takes into account both intended and unintended effects of the change, and aims to determine its overall impact. This means that a program or project may achieve its goals, but have negative unintended consequences. On the other hand, a program that is perceived as a failure due to budget and schedule issues may actually have a more positive impact than originally anticipated by its planners. Impact evaluations help organizations understand the full range of impacts of a change and can inform decision-making about future changes or interventions. The following are illustrative examples of an impact evaluation.

Cities

A city expands its highway system to more lanes only to discover that within a few short years traffic jams have once again become a common occurrence. An impact study indicates that the new lanes encouraged development of land further from the downtown core making the city less dense and increasing average commuting distance.

Transportation

A program to develop a system of high speed trains is initially viewed as a failure as it exceeds planned budget. However, within a decade ridership is far greater than business plans had anticipated. The overall impact on the economy, quality of life and the environment can be demonstrated to be exceedingly positive.

Education

An education system abandons standardized testing in high schools in favor of tests crafted by individual teachers. A later impact study looked at data before and after to determine that grade inflation occurred with the abandonment of the standard tests. This led universities and colleges to begin to rank schools and apply more complex admission processes than were far less transparent to students.

Marketing

A newspaper begins aggressively optimizing the titles of its articles with A/B testing. This immediately increases overall revenue. A later impact study indicates that the quality of titles dropped dramatically such that titles often didn’t reflect the content of articles. The optimization effort was associated with a steady decline in reputation, customer satisfaction and subscription rates.

Learn More
Brand Awareness Jonathan Poland

Brand Awareness

Brand awareness refers to the extent to which consumers are familiar with and able to recognize a brand. It is…

Flat Pricing Jonathan Poland

Flat Pricing

Flat pricing is a pricing strategy in which a fixed price is offered to all customers for a product or…

Austrian Economics 101 Jonathan Poland

Austrian Economics 101

Austrian economics is a school of economic thought that originated in Austria in the late 19th century with Carl Menger,…

Cash Flow Statement Jonathan Poland

Cash Flow Statement

The cash flow statement is a financial statement that shows the inflows and outflows of cash for a company over…

Early Adopters Jonathan Poland

Early Adopters

Early adopters are individuals who quickly adopt an innovation. Marketing and selling innovative products can be challenging as it may…

Total Addressable Market Jonathan Poland

Total Addressable Market

A total addressable market (TAM) is the total potential revenue that a company can generate from its products or services…

Decision Trees Jonathan Poland

Decision Trees

Decision Trees are a popular machine learning algorithm used for both classification and regression tasks. They are part of a…

Risk Tolerance Jonathan Poland

Risk Tolerance

A risk is the possibility of an adverse event occurring, while a trigger is the root cause of that event.…

Product Knowledge Jonathan Poland

Product Knowledge

Product knowledge refers to the ability to effectively communicate information and answer questions about a product or service. This knowledge…

Content Database

Gold is Money Jonathan Poland

Gold is Money

Overview The history of gold as money spans thousands of years and has played a pivotal role in the economic…

Everyday Low Price Jonathan Poland

Everyday Low Price

Everyday low price, commonly abbreviated as EDLP, is a pricing strategy in which a retailer offers its products at a…

Chaos Theory Jonathan Poland

Chaos Theory

Chaos theory is a branch of mathematics that studies the behavior of complex systems and the impact of small changes…

Marketing Message Jonathan Poland

Marketing Message

A marketing message refers to any media or communication that is intended to persuade or influence customers. Marketing messages can…

Real Estate Investing Jonathan Poland

Real Estate Investing

Real estate investing refers to the process of buying, owning, managing, and selling real estate properties for the purpose of…

Examples of Tact Jonathan Poland

Examples of Tact

Tact is the ability to sensitively and skillfully handle a situation or conversation so as to avoid giving offense. It…

The Importance of Lobbying 150 150 Jonathan Poland

The Importance of Lobbying

Lobbying is the act of influencing or attempting to influence the decisions of government officials, legislators, or regulators on behalf…

Quality Requirements Jonathan Poland

Quality Requirements

Quality requirements refer to the specific standards that a product, service, process, or environment must meet in order to be…

Analytical Skills Jonathan Poland

Analytical Skills

Analytical skills are the abilities, knowledge, and experience related to the gathering, processing, organizing, and interpreting of information. These skills…