Full Content is available to subscribers

Subscribe/Learn More  >

Crowdsourcing the Evaluation of Design Concepts With Empathic Priming

[+] Author Affiliations
Michelle A. Pang, Carolyn C. Seepersad

University of Texas at Austin, Austin, TX

Paper No. DETC2016-59417, pp. V007T06A004; 13 pages
  • ASME 2016 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference
  • Volume 7: 28th International Conference on Design Theory and Methodology
  • Charlotte, North Carolina, USA, August 21–24, 2016
  • Conference Sponsors: Design Engineering Division, Computers and Information in Engineering Division
  • ISBN: 978-0-7918-5019-0
  • Copyright © 2016 by ASME


The evaluation of design concepts is a time consuming and resource intensive process. Crowdsourcing evaluations has been examined in previous work as a means to reduce the need for expert raters, while achieving similar evaluation results. This paper examines the impact of empathically priming novice raters on their evaluation of alternative design concepts. The rating system is based on a pairwise comparison method that requires minimal training of novice raters. In a pilot study the pairwise method for crowdsourcing evaluations is compared with crowdsourced evaluations using non-pairwise rating scales and with the evaluations of expert raters. The primary study incorporates written and empathic priming strategies to determine their impact on novice raters’ evaluation of concepts. Raters are asked to consider several criteria, including novelty, feasibility, clarity (of the concept), usefulness, ease of use, and overall worthiness of further development. Results offer insight into the criteria that are most relevant to novice raters and whether empathic priming has a significant effect on those evaluations.

Copyright © 2016 by ASME
Topics: Design



Interactive Graphics


Country-Specific Mortality and Growth Failure in Infancy and Yound Children and Association With Material Stature

Use interactive graphics and maps to view and sort country-specific infant and early dhildhood mortality and growth failure data and their association with maternal

Citing articles are presented as examples only. In non-demo SCM6 implementation, integration with CrossRef’s "Cited By" API will populate this tab (http://www.crossref.org/citedby.html).

Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging and repositioning the boxes below.

Related eBook Content
Topic Collections

Sorry! You do not have access to this content. For assistance or to subscribe, please contact us:

  • TELEPHONE: 1-800-843-2763 (Toll-free in the USA)
  • EMAIL: asmedigitalcollection@asme.org
Sign In