Measuring Computational Creativity: Collaboratively Designing Metrics for Evaluating Creative Machines
Symposium:
Title:
- Measuring Computational Creativity: Collaboratively Designing Metrics for Evaluating Creative Machines
Organiser/Presenter(s):
Statement:
How do we make a creative machine? Creativity involves “a multitude of definitions, conceptualizations, domains, disciplines that bear on its study, empirical methods, and levels of analysis, as well as research orientations that are both basic and applied – and applied in varied contexts.”
This workshop follows a series of studies conducted in the classroom setting at CMU and UC San Diego. To begin, participants were asked to provide a definition of creativity specific to machines. Then more questions emerged: Can we computationally model ambiguity? Would a novelty search result in valuable discoveries? Where is the threshold between randomness and creativity? How do we evaluate the creativity of an algorithm?
To answer these questions, participants developed sets of criteria to assess their own and peer groups’ creative AI and ML projects. Although such a human-centred method is subjective, participants found that the exercise helped them to better describe and interpret dimensions of algorithmic creativity.
