Creative individuals are better than their peers at identifying uncreative products; expert ratings of the quality of a creative product are driven more by the ability to identify low quality work as opposed to high quality work

Are Creative People Better than Others at Recognizing Creative Work? Steven E.Stemler, James C. Kaufman. Thinking Skills and Creativity, September 15 2020, 100727. https://doi.org/10.1016/j.tsc.2020.100727

Rolf Degen's take: https://twitter.com/DegenRolf/status/1305757801172684800

Highlights
• Rating paradigms often focus on identifying the “Best” candidate, product, or solution
• Highly creative individuals are better than their peers at identifying uncreative products
• Rater creativity was not related to the ability to recognizing highly creative products
• Expert ratings of the quality of a creative product are driven more by the ability to identify low quality work as opposed to high quality work
• Ruling out the least creative candidate, product, or solution may be more important – or at least require more creative expertise – than identifying the “Best” of the bunch.

Abstract: It is often assumed that people with high ability in a domain will be excellent raters of quality within that same domain. This assumption is an underlying principle of using raters for creativity tasks, as in the Consensual Assessment Technique. While several prior studies have examined expert-novice differences in ratings, none have examined whether experts’ ability to identify the quality of a creative product is being driven more by their ability to identify high quality work, low quality work, or both. To address this question, a sample of 142 participants completed individual difference measures and rated the quality of several sets of creative captions. Unbeknownst to the participants, the captions had been identified a prior by expert raters as being of particularly high or low quality. Hierarchical regression analyses revealed that after controlling for participants’ background and personality, those who scored significantly higher on any of three external measures of creativity also rated low-quality captions significantly lower than their peers; however, they did not rate the high-quality captions significantly higher. These findings support research in other domains suggesting that ratings of quality may be driven more by the lower end of the quality spectrum than the high end.

Keywords: CreativityAssessmentRatingsExpertise