Situational judgement test
Template:Psychology Situational Judgement Tests (SJTs) or Inventories (SJIs) are a type of psychometric test which present applicants with realistic, hypothetical scenarios and ask them to identify an appropriate response.[1] These are generally in a multiple choice format.[1][2]
Unlike most psychometric tests SJTs are not acquired ‘off-the-shelf’, but are in fact designed as a bespoke tool, tailor-made to suit the individual role requirements.[1]
History
The earliest judgement test was a scale in the George Washington University Social Intelligence Test published in 1926.[2]
Situational judgement tests then went on to be used in World War II by psychologists in the US military.[2]
Today, SJTs are used in many organisations, are promoted by various consulting firms, and are researched by many.[2]
Example
Everyone in your work group has received a new computer except you. What would you do?
A. Assume it was a mistake and speak to your supervisor.
B. Confront your supervisor regarding why you are being treated unfairly.
C. Take a new computer from a co-worker’s desk.
D. Complain to human resources.
E. Quit.[2]
Advantages over other measures
- They show reduced levels of adverse impact, by gender and ethnicity, (Hoare, Day & Smith, Template:Ref harvard) compared to cognitive ability tests.[1][3]
- They use measures that directly assess job relevant behaviours.[1]
- They can be administered in bulk, either via pen and paper or on-line.[1]
- The SJT design process results in higher relevance of content than other psychometric assessments (e.g. Motowildo, Hansen & Crafts, Template:Ref harvard).[3] They are therefore more acceptable and engaging to candidates compared to cognitive ability tests since scenarios are based on real incidents[1]
- It is unlikely that practice will enhance candidate performance as the answers cannot be arrived at logically – a response to a situation may be appropriate in one organisation and inappropriate in another.[1]
- They can tap into a variety of constructs – ranging from problem solving and decision making to interpersonal skills.[1] Traditional psychometric tests do not account for the interaction between ability, personality and other traits.[3]
- They can be used in combination with a knowledge based test to give a better overall picture of a candidate's aptitude for a certain job.[4]
Criticisms
- The scenarios in many SJTs tend to be brief; therefore candidates do not become fully immersed in the scenario. This removes some of the intended realism of the scenario and reduces the quality and depth of assessment that can be obtained.[3]
- SJI responses can be transparent, providing more of an index of best practice knowledge in some cases and therefore failing to discriminate between candidates’ work-related performance.[3]
- The response formats in some SJIs do not present a full enough range of responses to the scenario. Candidates can be forced to select actions or responses that do not necessarily fit their behaviour. They can find this frustrating and this can affect the validity of such measures (e.g. Chan & Schmitt, Template:Ref harvard; Ployhart & Harold, Template:Ref harvard; Schmit & Ryan, Template:Ref harvard).
Notes
- ↑ 1.0 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 "Situational Judgement Tests: Are they just measures of cognitive ability?". Human Assets. Retrieved 2007-08-07.
- ↑ 2.0 2.1 2.2 2.3 2.4 McDaniel, Michael A. "Situational Judgment Tests. An IPMAAC Workshop" (PDF). IPMA-HR Assessment Council. Retrieved 2007-08-07. Unknown parameter
|coauthors=ignored (help) - ↑ 3.0 3.1 3.2 3.3 3.4 "Technical Information". Harcourt Assessment. Retrieved 2007-08-07.
- ↑ Rahman, Mahibur. "Tackling situational judgment tests". BMJ Publishing Group Ltd. Retrieved 2007-08-07.
Other References
- Template:Note labelHoare, S., Day, A., & Smith, M. (1998). The development and evaluation of situations inventories. Selection & Development Review, 14(6), 3-8.
- Template:Note labelMotowildo, S.J., Hanson, M.A., & Crafts, J.L. (1997). Low fidelity simulations. In D.L. Whetzel & G.R. Wheaton (Eds.), Applied Measurement in industrial Psychology. Palo Alto, CA: Davies-Black.
- Template:Note labelChan, D., & Schmitt, N. (2005). An agenda for future research on applicants’ reactions to selection procedures: A construct-orientated approach. International Journal of Selection and Assessment, 12, 9-23.
- Template:Note labelPloyhart, R.E., & Harold, C.M. (2004). The applicant attribution-reaction theory (AART): An integrative approach of applicant attributional processing. International Journal of Selection & Assessment, 12, 84-98.
- Template:Note labelSchmit, M.J., & Ryan, A.M. (1992). Test-taking dispositions: A missing link? Journal of Applied Psychology, 77, 629-637.