Creativity
Computer scoring

Considerable progress has been made in the automated scoring of divergent thinking tests using a semantic approach. When compared to human raters, NLP techniques are reliable and valid for scoring originality. Computer programs were able to achieve a correlation to human graders of 0.60 and 0.72.

Semantic networks also devise originality scores that yield significant correlations with socio-personal measures. A team of researchers led by James C. Kaufman and Mark A. Runco combined expertise in creativity research, natural language processing, computational linguistics, and statistical data analysis to devise a scalable system for computerized automated testing (the SparcIt Creativity Index Testing system). This system enabled automated scoring of DT tests that is reliable, objective, and scalable, thus addressing most of the issues of DT tests that had been found and reported. The resultant computer system was able to achieve a correlation to human graders of 0.73.
detectable_format:json_format