Search Content


Content Categories



A Question From India On Rating Distributions

Like many web sites, our Grote Consulting Corporation website invites browsers to send in questions.

I love getting questions: It’s a great way to find out what’s on people’s minds so I can cover the issue that’s been raised in my writings on performance management or in my Making Performance Appraisal Work seminar.

This morning, the “Contact Us” link at www.GroteConsulting.com delivered a polite question that asked why I argued in favor of something that in fact I don’t believe in at all: a normal distribution of performance appraisal ratings. Here’s precisely how Rajiv from the Indian Institute of Management put it:

Mr. Grote,

I am curious about this argument you have put forth. My question is: what is the basis for you to think that employee performance in companies follows a normal distribution?

I’d be grateful for your views on my question.

Regards,

You know what a “normal distribution” is. It’s the classic bell-shaped curve that applies to almost everything in life. I think mathematicians call it a “Gaussian curve.” Applied to performance appraisal, a normal distribution means that most employees will get whatever the form’s middle rating is (maybe “Fully Successful” or “Meets Expectations.”) A significantly smaller number will get the rating just higher than the middle (“Superior” or “Exceeds Expectations”). And exactly the same smaller number will get the rating just lower than the middle (“Needs Improvement” or “Meets Some Expectations.”) Finally, a tiny number of employees will get the absolute top rating (like “Distinguished” or “Greatly Exceeds Expectations”) while the exact same tiny number will get the lowest rating the form offers (perhaps “Unacceptable” or “Fails to Meet Expectations”). Convert those numbers to a graph and you’ve got your classic normal distribution curve.

But that normal distribution curve in bogus in organizations.

Here’s how I responded to Rajiv’s question:

Greetings, Rajiv!

Thanks for raising the question about distributions.

But I’m puzzled. I don’t think I have ever argued that the distributions of performance appraisal ratings should follow a normal, bell-shaped, Gaussian distribution curve.

As you know, for a normal distribution curve to be valid, there must be two pre-conditions. First, there must be a sufficiently large population. In most companies there are enough employees for that condition to be met.

The other condition is that there be random distribution. But in companies, you don’t have random distribution. Companies don’t hire people at random (for example, every 14th applicant) or promote people at random (for example, on an alphabetical basis). And companies provide training and coaching to help people improve their performance.

Therefore, in a well-managed company with good supervisors and tough performance standards, you should NOT expect a random, bell-shaped curve distribution of appraisal ratings. You should expect a slight positive skew.

Here’s how I explained it in my book, Forced Ranking: Making Performance Management Work (Harvard Business School Press, 2005, page 148):

Allow some flexibility in the distribution expectations. In GroteApproach®, the web-based performance management system my company has developed, clients can determine whether they want to show a recommended distribution and what that distribution should be. But here’s our default recommendation:

Distinguished — Up to 10%

Superior — About 20 – 30%

Fully Successful — About 60% or more

Needs Improvement — About 10 – 15%

Unsatisfactory — Less than 5%

This set of guidelines provides for twice as many people to be rated in the Distinguished and Superior category than in the Needs Improvement and Unsatisfactory categories. It provides a range and not a fixed requirement at every rating level. It provides for a reasonably normal distribution but one with an appropriate positive skew. And finally, as the heading indicates, the distributions displayed are not rigid requirements but instead represent the “likely percentage of employees” that will end up in each area.

I hope this helps. Thanks for writing.

I sent my email off to Rajiv. I don’t know whether I’ll be successful in convincing him that you shouldn’t expect a normal distribution of appraisal ratings. But if the system’s working right, there should be around twice as many people getting higher ratings than lower ones, with most employees in the middle.


Related Apex API Articles

MX 2009 Speaker publishes Forrester’s 2008 Custome


Forrester has just released in 2008 Customer Experience Index. (Registration required to download). The Index was compiled by Bruce Temkin, who will keynote Day 1 of MX 2009. The results confirm what we all suspect — retailers and hotels rank the...

Read more about MX 2009 Speaker publishes Forrester’s 2008 Customer Experience Index...

Carrefour and Teradata and More...


Ah, here's a dateline from First Coffee's old stomping grounds, Istanbul, with the news that Teradata Corporation has announced that European retailing behemoth Carrefour is expanding its Teradata Active Enterprise Data Warehouse environment to...

Read more about Carrefour and Teradata and More......