Assessing Creative Products by Experts

Author(s): Kuan Chen Tsai

The product-orientated definition of creativity is widely acceptable because it is empirically objective and adequately reliable. The objective of this study was oriented toward understanding experts’ perceptions of creativity evaluated by experts. The perceptional map indicates that two dimensions clearly existed in the assessment of creativity among six experts. It is speculated that these two dimensions might be related to technical and aesthetic factors. Overall, the homogeneity of six experts’ perceptions of creativity on 46 collages implies that the product approach to some extent is a valid assessment of creativity. However, it is clear that more research is needed in the application of expert judges on creative products.

Creativity assessment, creative product, perceptional map, multidimensional scaling

1. Amabile, T. M. (1979). Effects of external evaluation on artistic creativity. Journal of Personality and Social Psychology, 37(2), 221-233
2. Amabile, T. M. (1982). Social psychology of creativity: A consensual assessment technique. Journal of Personality and Social Psychology, 43(5), 997-1013
3. Amabile, T. M. (1983). The social psychology of creativity: A componential conceptualization. Journal of Personality and Social Psychology, 45(2), 357-376
4. Amabile, T. M. (1996). Creativity in context: Update to the social psychology of creativity. Boulder, Colorado: Westview Press
5. Amabile, T. M., Hennessey, B.A., & Crossman, B. S. (1986). Social influences on creativity: The effects of contracted-for rewards. Journal of Personality and Social Psychology, 50(1), 14-23
6. Baer, J. (1993). Creativity and divergent thinking: A task-specific approach. Hillsdale, NJ: Lawrence Erlbaum Associates
7. Besemer, S. P., & O’Quin, K. (1986). Analyzing creative products: Refinement and test of a judging instrument. The Journal of Creative Behavior, 20(2), 115-126
8. Besemer, S. P., & Treffinger, D. J. (1981). Analysis of creative products: Review and synthesis. The Journal of Creative Behavior, 15(3), 158-178
9. Butler-Kisber, L., & Poldma, T. (2010). The power of visual approaches in qualitative inquiry: The use of collage making and concept mapping in experiential research. Journal of Research Practice, 6(2), 1-17
10. Garoff, X., & Besancon, M. (2008). Variability of creativity judgments. Learning and Individual Differences, 18(4), 367-371
11. Hennessey, B. A., & Amabile, T. M. (1999). Consensual assessment. In M. A. Runco & S. R. Pritzker (Eds.), Encyclopedia of creativity (pp. 347-359). San Diego, CA: Academic Press
12. Hocevar, D. (1981). Measurement of creativity: Review and critique. Journal of Personality Assessment, 45(5), 450-464
13. Kaufman, J. C., Bear, J., & Cole, J. C. (2009). Expertise, domains, and the consensual assessment technique. The Journal of Creative Behavior, 43(4), 223- 233
14. Kaufman, J. C., Baer, J., Cole, J. C., & Sexton, J. D. (2008). A comparison of expert and nonexpert raters using the consensual assessment technique. Creativity Research Journal, 20(2), 171-178. doi:10.1080/10400410802059929
15. Kaufman, J. C., Lee, J., Baer, J., & Lee, S. (2007). Captions, consistency, creativity and the consensual assessment technique: New evidence of reliability. Thinking Skills and Creativity, 2(2), 96-106
16. Kaufman, J. C., Plucker, J. A., & Baer, J. (2008). Essentials of creativity assessment. Hoboken, NJ: John Wiley & Sons
17. MacKinnon, D. W. (1962). The nature and nurture of creative talent. American Psychologist, 17(7), 484-495
18. Pearlman, C. (1983). Teachers as an informational resource in identifying and rating student creativity. Education, 103(3), 215-222
19. Runco, M. A. (1995). Insight for creativity, expression for impact. Creativity Research Journal, 8(4), 377-390
20. Runco, M. A., McCarthey, K. A., & Svenson, E. (1994). Judgments of the creativity of artwork from students and professional artists. Journal of Psychology, 128(1), 23-31
21. Runco, M. A., Plucker, J. A., & Lim, W. (2000-2001). Development and psychometric integrity of a measure of ideational behavior. Creativity Research Journal, 13 (3/4), 393-400
22. Simpson, S. (2009). Raising awareness of transformation: Collage, creative expression, and imagination. In C. Hoggan, S. Simpson, and H. Stuckey (Eds.), Creative expression in transformative learning: Tools and techniques for educators of adults (pp. 75-101). Malabar, FL: Krieger Publishing