Tuesday 12pm, 6 September 2016


Clustering and Visualizing Solution Variation in Massive Programming Classes || Design Roadmapping: Integrating Design Research Into Strategic Planning For New Product Development

Elena Glassman and Euiyoung Kim

Post-docs - UC Berkeley


Clustering and Visualizing Solution Variation in Massive Programming Classes
In large programming classes, a single problem may yield thousands of student solutions. Solutions can vary in correctness, approach, and readability. Understanding large-scale variation in solutions is a hard but important problem. For teachers, this variation could be a source of innovative new student solutions and instructive examples. Understanding solution variation could help teachers write better feedback, test cases, and evaluation rubrics. Theories of learning, e.g., analogical learning and variation theory, suggest that students would benefit from understanding the variation in the fellow student solutions as well. Even when there are many solutions to a problem, when a student is struggling in a large class, other students may have struggled along a similar solution path, hit the same bugs, and have hints based on that earned expertise. I will describe several systems that exploit large-scale solution variation and demonstrate how clustering and visualizing solution variation can help teachers directly respond to trends and outliers within student solutions, as well as help students help each other.
Design Roadmapping: Integrating Design Research Into Strategic Planning For New Product Development
While product and technology roadmaps have been well formalized in terms of their structures, methodologies, and frameworks, design roadmaps have not been explicitly explored nor studied from either an academic or industry practice standpoint. With increasing uncertainty, rapid change, and complexity in market environments, companies are finding that they can no longer differentiate their products and services by relying on traditional roadmapping processes that focus solely on technologies and product features. Rather, strategies that revolve around the holistic experience provided by a product or service are more likely to be successful in today’s market. This talk introduces a formalized design roadmapping framework to guide product planning in today’s more user-centered marketplace.


Elena Glassman is an EECS postdoctoral researcher at the Berkeley Institute of Design, advised by Bjoern Hartmann and Marti Hearst. While advised by Rob Miller at MIT CSAIL, she created scalable systems that help teach programming and hardware design to thousands of students at once. Based on that work, she earned her EECS PhD in August 2016. Prior to discovering the field of human-computer interaction, she earned her MEng in the MIT CSAIL Robot Locomotion Group. She has also been a visiting researcher at the Stanford Biomimetics and Dextrous Manipulation Lab and a summer research intern at both Google and Microsoft Research, working on systems that help people teach and learn. She was awarded the Intel Foundation Young Scientist Award, both the NSF and NDSEG graduate fellowships, the MIT EECS Oral Master’s Thesis Presentation Award, and the MIT Amar Bose Teaching Fellowship for innovation in teaching methods.
Euiyoung Kim is a post-doc design fellow at Jacobs Institute for Design Innovation and a post-doc scholar in the Mechanical Engineering deparment at the University of California, Berkeley. He received PhD degree in the department of Mechanical Engineering at the University of California, Berkeley focusing on Design Theory & Methods and New Product Development, Summer 2016. He was granted a Master’s degree from EDI (Engineering Design Innovation) program at Northwestern University in 2011. Prior to moving to the United States, he worked as a product planning manager in strategic marketing team for IT solutions business, Samsung Electronics from 2006 to 2012.
 His research interest involves design roadmapping, human centric research and multi-disciplinary studies that bring different academic research fields such as product management, design and engineering. He has received a ASME Best Paper Award (2016) and two ICED Best Paper Award (2013 and 2015), and a fellow of 2015 SIPFF (Summer Institute for Preparing Future Faculty), UC Berkeley. He is a member of ASME, IDSA, and Design Society.