Summary of The ABCs of Evaluation

John Boulmetis and Phyllis Dutwin

Looking for the book?
We have the summary! Get the key insights in just 10 minutes.

Rating

The rating – what does it mean?

At getAbstract, we summarize books* that help people understand the world and make it better. Whatever we select for our library has to excel in one or the other of these two core criteria:

Enlightening – You’ll learn things that will inform and improve your decisions.

Helpful – You’ll take-away practical advice that will help you get better at what you do.

We rate each piece of content on a scale of 1–10 with regard to these two core criteria. Our rating helps you sort the titles on your reading list from adequate (5) to brilliant (10). Books we rate below 5 won’t be summarized. Here's what the ratings mean:

5 – Solid. A helpful and/or enlightening book, inspite of its obvious shortcomings. For instance, it may be offer decent advice in some areas but be repetitive or unremarkable in others.
6 – Notable. A helpful and/or enlightening book that stands out by at least one aspect, e.g. is particularly well structured.
7 – Good. A helpful and/or enlightening book that combines two or more noteworthy strengths, e.g. contains uncommonly novel ideas and presents them in an engaging manner.
8 – Very good. A helpful and/or enlightening book that has a substantial number of outstanding qualities without excelling across the board, e.g. presents the latest findings in a topical field and is written by a renowned expert but lacks a bit in style.
9 – Superb. A helpful and/or enlightening book that is extremely well rounded, has many strengths and no shortcomings worth mentioning.
10 – Brilliant. A helpful and/or enlightening book that, in addition to meeting the highest standards in all pertinent aspects, stands out even among the best. Often an instant classic and must-read for everyone.

While the rating tells you how good a book is according to our two core criteria, it says nothing about its particular defining features. Therefore, we use a set of 20 qualities to characterize each book by its strengths:

Applicable – You’ll get advice that can be directly applied in the workplace or in everyday situations.
Analytical – You’ll understand the inner workings of the subject matter.
Background – You’ll get contextual knowledge as a frame for informed action or analysis.
Bold – You’ll find arguments that may break with predominant views.
Comprehensive – You’ll find every aspect of the subject matter covered.
Concrete Examples – You’ll get practical advice illustrated with examples of real-world applications or anecdotes.
Eloquent – You’ll enjoy a masterfully written or presented text.
Engaging – You’ll read or watch this all the way through the end.
Eye opening – You’ll be offered highly surprising insights.
For beginners – You’ll find this to be a good primer if you’re a learner with little or no prior experience/knowledge.
For experts – You’ll get the higher-level knowledge/instructions you need as an expert.
Hot Topic – You’ll find yourself in the middle of a highly debated issue.
Innovative – You can expect some truly fresh ideas and insights on brand-new products or trends.
Insider’s take – You’ll have the privilege of learning from someone who knows her or his topic inside-out.
Inspiring – You’ll want to put into practice what you’ve read immediately.
Overview – You’ll get a broad treatment of the subject matter, mentioning all its major aspects.
Scientific – You’ll get facts and figures grounded in scientific research.
Visionary – You’ll get a glimpse of the future and what it might mean for you.
Well structured – You’ll find this to be particularly well organized to support its reception or application.

*getAbstract is summarizing much more than books. We look at every kind of content that may matter to our audience: books, but also articles, reports, videos and podcasts. What we say here about books applies to all formats we cover.

Recommendation

You can't avoid evaluations. Whether you're in education, business or nonprofit management, your supervisor will eventually order an evaluation to determine the viability of your program. Many people find evaluations unpleasant and intimidating, but, as John Boulmetis and Phyllis Dutwin show, they don't have to be. The authors demystify the process by carefully explaining its principles, philosophy and techniques. End-of-chapter exercises and numerous examples make evaluation and analysis accessible to any business reader. Appendices provide a tutorial on data analysis, and samples of a final report and an evaluation contract. getAbstract recommends this book to professionals who have little experience with evaluation, although even seasoned veterans will find the material useful.

About the Authors

John Boulmetis is a professor in the University of Rhode Island's School of Education and coordinator of the graduate program in adult education. Phyllis Dutwin is the president of a training and development firm.

Summary

Evaluation Basics

You may not find evaluation glamorous or exciting, but it is the only way to assess the effectiveness of a program accurately. Thus, it is a valuable tool for managers, administrators, consultants and analysts in almost any field.

CEOs are always interested in the return on investment (ROI), whether it’s an investment in their company’s new products or its factory equipment. If they spend money on a training program to upgrade employees’ knowledge or team-building skills, they want to know whether the expenditure helped the company. Thus, if you fail to deliver a comprehensive evaluation, you may have to say goodbye to future funding – or even to your job. Evaluations can prove your program’s worth. Yet, for many managers and employees, evaluation has a negative connotation. Managers may view the process as cumbersome, time-consuming and overwhelming, while employees fear evaluations presage downsizing or reassignment. Learning about evaluation can help allay your fears and give you an opportunity to benefit your organization or program.