TASC Research

The TASC method was developed over a series of studies to use word selection from raters, and semantic similarity (word relatedness) to calculate design creativity. The sematic weights used in TASC are a measure of the relatedness between each of the words in the list and the words “innovative” and “feasible” obtained from using an online toolkit called DISCO [1]. The semantic gloss vector measure calculated within DISCO was selected to measure the semantic distance in this study due to it’s ability to measure adjective similarity and because of its leverage of natural language processing technology [2-4]. Detailed descriptions of how DISCO functions can be found in [1]. In order to use TASC participants must rate each design by selecting three to five words from a table of 36 words that they believe best describe the concept in question. Once each participant has rated each design, the selected words are given a feasibility score and a innovative score by averaging the weights given to each word. The ratings are then added together to get a design creativity score based on the team of raters. More details about our methods can be found in “A novel method for assessing design concept creativity using single-word adjectives and semantic similarity.”

[1] Kolb, P., 2008, "Disco: A multilingual database of distributionally similar words," Proceedings of KONVENS-2008, Berlin. [2] Prabhakaran, R., Green, A. E., and Gray, J. R., 2013, "Thin slices of creativity: Using single-word utterances to assess creative cognition," Behavior research methods, pp. 1-19. [3] Benedek, J., and Miner, T., 2002, "Measuring Desirability: New methods for evaluating desirability in a usability lab setting," Proceedings of Usability Professionals Association, 2003, pp. 8-12. [4] Bollegala, D., Matsuo, Y., and Ishizuka, M., 2011, "A web search engine-based approach to measure semantic similarity between words," Knowledge and Data Engineering, IEEE Transactions on, 23(7), pp. 977-990.

Publications

2015
Implementing Creativity Evaluation Tools Into The Concept Selection Process In Engineering Education.
Elizabeth Starkey, Christopher Gosnell and Scarlett Miller
ASME Design Engineering Technical Conference 12th International Conference on Design Education, August 2-5 2015, Boston, MA
pdf
2014
A novel method for assessing design concept creativity using single-word adjectives and semantic similarity.
Chris Gosnell and Scarlett Miller
ASME Design Engineering Technical Conference 26th Annual Conference on Design Theory and Methodology, August 17-20 2014, Buffalo, NY
pdf