There is no implication in so far as the course is concerned – you have completed the work and we issue the completion certificate.
Scores achieved during the course work are important, but the 100 question 'benchmark test' which should be taken as an exam (closed book, 2 hours max) is really the key.
PMP, CAPM and PMI-SP scores are all based on how well you answer multi-choice questions in your exam.
Unfortunately, the information provided to candidates at the end of their PMI exam is minimal. You are told if you have passed or failed based on the number of questions correctly answered (but the passing score is a secret) and you are told if your score is below average, average or above average against the five ‘domains’ or PMBOK® Guide chapters in the case of CAPM. But you are not told what average represents, how it relates to the passing score, or how wide the average band is. In reality, the only option is to be happy if you are in the 70% to 80% who pass and talk to your training provider if you have failed. You cannot get anything additional out of PMI.
During your training, the situation is (or should be) very different!
Almost every training organisation offers its PMI exam candidates sets of questions to help consolidate their learning – we build our courses around lots of regular tests. If the tests are well designed they use the standard 4-option multi-choice question format used by PMI and provide feedback to the trainee on the number of questions correctly answered and detailed information about the answers to all of the questions. We do, and so does everyone else I talk to.
However, what many people don’t fully appreciate is the effect of the four options in the PMI multi-choice format and why a score of 55% is definitely in the ‘fail’ category! The cause is the fact that one of the options will always be correct, therefore a set of random guesses will score 25% on average, and the more questions you answer the more the 25% will come into play. The challenge is working out what proportion of the 55% can be attributed to ‘knowing the right answer’ and what proportion is likely to be a consequence of the ‘lucky 25%’.
As a starting point, any score you achieve will have a certain number of questions answered correctly because you knew the correct answer and a certain number of questions that you answered incorrectly but fluked the right answer for the wrong reason (the ‘lucky 25%’ effect).
One way to assess how many of each are included in your score is to assume a known number of answers are correct because you ‘know the right answer’ and then add 25% of the rest as likely to be correct based on the ‘lucky 25%’ factor. Therefore in a set of 100 questions, if you ‘know the right answers’ to 40 questions and add 25% of the remainder (60 / 4) = 15 you get a score of 55 (or 55%). So whilst superficially a score 55% may seem to be ‘not too bad’ knowing this represents a real score of around 40% gives a very different picture. And the reason increasing your score is quite hard work is because as your real score increases, the remaining number of questions subject to the ‘25% luck’ factor decreases. The situation is further complicated by the fact on a 'lucky day' the number of correct guesses will be higher than 25%, on a 'bad day' less than 25%..... the 'luck factor' its self is subject to a range of possibilities.
This chart is one way of assessing what you really know from any score achieved in a 4-option multi-choice question exam. If you don’t know the answer to any question and guess the lot, you should still score around 25%. Conversely, if you know the correct answer to every question, there are none left to be affected by the ‘25% luck’ factor.
In the chart, your total score is represented by the Pale Blue line and the questions you can assume you ‘know the correct answer to’ is represented by the Dark Blue line.
Between these two lines, there are a steadily decreasing number of questions that you did not know the right answer to but got a correct answer to based on the ‘25% luck’ factor. This 25% factor is represented by the Green Line (the two dotted green lines show the probable error range).
To use the chart
See what your score is in a test and convert it to a percentage. This is your ‘Total Score’ on the vertical axis. Project this across to the Light Blue line and then look down the chart to see your real score on the horizontal axis. The Dark Blue and Green lines will give you an approximate split between the questions you 'knew the right answer to' and the 'lucky guesses'.
For example, if you scored 62.5% in total, you probably know the answer to around 50% of the questions and the random factor added another 12.5% (the probable range being between 15% and 10% attributed to 'luck' the rest to knowledge).
Limitations & Observations
This chart explains why PMI has set a passing score above 60% in the past (when we knew this information) and seem to have maintained this policy into the present. A score of around 65% would assure PMI the candidate probably achieved a score of 50% or better from knowledge. But there are a number of issues with the chart.
Next time you take a practice test use this chart to assess your real level of knowledge but make sure you check all of the answers you got right so you can identify the questions you got right for the wrong reason, the ‘25% luck’ factor.
One of the reasons we set our trainees a benchmark score of 75% in our coursework is to help overcome the factors discussed above. By the time you are scoring around 75% the effect of the 25% random variability has reduced well below 10% and we know you know enough to score around 65% in the exam without the luck factor. This means most people will pass most of the time; if you score below 75% you are starting to rely on the 25% luck factor and there is always a chance you may not have an average amount of luck on exam day.
To help you practice your PMP, CAPM and PMI-SP answering skills we Tweet a new question every day, for today’s see: http://www.mosaicprojects.com.au/Training-PMP-Q-Today.html