This paper focuses on better understanding how design processes affect outcomes in mechanical engineering design. Following a general design research methodology, process data were collected from student design journals and tested for association with design quality as measured by an external evaluation using a virtual design of experiments approach. The results indicate that more time spent on system-level design (including problem generation, idea generation, and analysis activity) and on concept-level problem definition activity associate positively with design quality, while more time spent on concept-level idea generation, detailed design, and refinement associated negatively with design quality. These results imply that student designers should emphasize problem definition, information gathering, and system-level design work more so than high-level idea generation activities.

1.
Blessing
,
L. T. M.
,
Chakrabarti
,
A.
, and
Wallace
,
K. M.
, 1998, “
An Overview of Descriptive Studies in Relation to a General Design Research Methodology
,”
Designers: The Key to Successful Product Development
,
E.
Frankenberger
,
P.
Badke-Schaub
, and
A.
Birkhofer
, eds.,
Springer
, New York.
2.
“Criteria for Accrediting Engineering Programs,” Accreditation Board of Engineering and Technology, 2007, http://www.abet.org/forms.shtmlhttp://www.abet.org/forms.shtml
3.
Finger
,
S.
, and
Dixon
,
J.
, 1989, “
A Review of Research in Mechanical Engineering Design, Part I: Descriptive, Prescriptive, and Computer-based Models of Design Processes
,”
Res. Eng. Des.
0934-9839,
1
, pp.
51
67
.
4.
Birmingham
,
R.
,
Cleland
,
G.
,
Driver
,
R.
, and
Maffin
,
D.
, 1997,
Understanding Engineering Design
,
Prentice Hall
, London, UK.
5.
Cross
,
N.
, 1989,
Engineering Design Methods
,
Wiley
, Chichester, UK.
6.
Dym
,
C. L.
, and
Little
,
P.
, 2000,
Engineering Design: A Project-Based Introduction
,
Wiley
, New York.
7.
Pahl
,
G.
, and
Beitz
,
W.
, 2001,
Engineering Design: A Systematic Approach
,
Springer
, New York.
8.
Pugh
,
S.
, 1990,
Total Design
,
Addison-Wesley
, Wokingham, UK.
9.
Ullmann
,
D. G.
, 2003,
The Mechanical Design Process
,
McGraw–Hill
, Boston.
10.
Maffin
,
D.
, 1998, “
Engineering Design Models: Context, Theory, and Practice
,”
J. Eng. Design
0954-4828,
9
, pp.
315
327
.
11.
Atman
,
C. J.
,
Chimka
,
J. R.
,
Bursic
,
K. M.
, and
Nachtmaan
,
H. L.
, 1999, “
A Comparison of Freshman and Senior Engineering Design Processes
,”
Des. Stud.
0142-694X,
20
, pp.
131
152
.
12.
Ball
,
L. J.
,
Evans
,
B. T.
, and
Dennis
,
I.
, 1994, “
Cognitive Processes in Engineering Design: A Longitudinal Study
,”
Ergonomics
0014-0139,
37
, pp.
1753
1786
.
13.
Pahl
,
G.
,
Badke-Schaub
,
P.
, and
Frankenberger
,
E.
, 1999, “
Resume of 12 Years of Interdisciplinary Empirical Studies of Engineering Design in Germany
,”
Des. Stud.
0142-694X,
20
, pp.
481
494
.
14.
Bender
,
B.
,
Kammerer
,
U.
,
Pietzcker
,
F. P.
,
Hacker
,
W.
, and
Blessing
,
L. T. M.
, 2001, “
Successful Strategies in Complex Design in Early Phases of the Product Development Process—An Empirical Study
,”
Proceedings of International Conference on Engineering Design Proceedings
, Glasgow, UK, August 6–10.
15.
Adams
,
R.
,
Turns
,
J.
, and
Atman
,
C. J.
, 2003, “
Educating Effective Engineering Designers: The Role of Reflective Practice
,”
Des. Stud.
0142-694X,
24
, pp.
275
294
.
16.
Badke-Schaub
,
P.
, and
Frankenberger
,
E.
, 1999, “
Analysis of Design Projects
,”
Des. Stud.
0142-694X,
20
, pp.
465
480
.
17.
Cross
,
N.
, 2004, “
Expertise in Design: An Overview
,”
Des. Stud.
0142-694X,
25
, pp.
427
441
.
18.
Stauffer
,
L. A.
, and
Ullman
,
D. G.
, 1991, “
Fundamental Processes of Mechanical Designers Based on Empirical Data
,”
J. Eng. Design
0954-4828,
2
, pp.
113
125
.
19.
Badke-Schaub
,
P.
, 2003, “
Strategies of Experts in Engineering Design: Between Innovation and Routine Behavior
,”
Expertise in Design
,
N.
Cross
, ed.,
University of Technology Press
, Sydney, Australia.
20.
Stauffer
,
L. A.
, and
Ullman
,
D. G.
, 1988, “
A Comparison of the Results of Empirical Studies into the Mechanical Design Process
,”
Des. Stud.
0142-694X,
9
, pp.
107
114
.
21.
Chusilp
,
P.
, and
Jin
,
Y.
, 2006, “
Impact of Mental Iteration on Concept Generation
,”
J. Mech. Des.
1050-0472,
128
, pp.
14
25
.
22.
Stewart
,
D.
, 1981, “
The Design Structure System: A Method for Managing the Design of Complex Systems
,”
IEEE Trans. Eng. Manage.
0018-9391,
28
, pp.
71
74
.
23.
Smith
,
R.
, and
Eppinger
,
S.
, 1997, “
A Predictive Model of Sequential Iteration in Engineering Design
,”
Manage. Sci.
0025-1909,
43
, pp.
1104
1120
.
24.
Eppinger
,
S.
,
Nukala
,
M.
, and
Whitney
,
D.
, 1997, “
Generalized Models of Design Iteration Using Signal Flow Graphs
,”
Res. Eng. Des.
0934-9839,
9
, pp.
112
123
.
25.
Smith
,
R.
, and
Morrow
,
J.
, 1999, “
Product Development Process Modeling
,”
Des. Stud.
0142-694X,
20
, pp.
237
261
.
26.
Atman
,
C. J.
,
Bursic
,
K. M.
, and
Lozito
,
S.
, 1996, “
Application of Protocol Analysis to the Engineering Design Process
,”
Proceedings of the American Society of Engineering Education Annual Conference
, Washington, D.C, June 23–26.
27.
Ericsson
,
K.
, and
Simon
,
H.
, 1984,
Protocol Analysis
,
MIT Press
, Cambridge, MA.
28.
Bucciarelli
,
L.
, 1994,
Designing Engineers
,
MIT Press
, Cambridge, MA.
29.
Brockman
,
J.
, 1996, “
Evaluation of Student Design Processes
,”
Frontiers in Education Conference Proceedings
, Salt Lake City, UT, November 6–9.
30.
Waldron
,
M.
, and
Waldron
,
K.
, 1992,
Mechanical Design: Theory and Methodology
,
Springer
, New York.
31.
Dong
,
A.
,
Hill
,
A. W.
, and
Agogino
,
A. M.
, 2004, “
A Document Analysis Method for Characterizing Team-based Design Outcomes
,”
J. Mech. Des.
1050-0472,
126
, pp.
378
385
.
32.
Sobek
,
D. K.
, 2002, “
Use of Journals to Evaluate Student Design Processes
,”
Proceedings of the American Society of Engineering Education Conference
, Montreal, Canada, June 16–19.
33.
Sobek
,
D. K.
, 2002, “
Preliminary Findings from Coding Student Design Journals
,”
Proceedings of the American Society of Engineering Education Conference
, Montreal, Canada, June 16–19.
34.
Ulrich
,
K.
, and
Eppinger
,
S.
, 2000,
Product Design and Development
,
McGraw–Hill
, New York.
35.
Ullman
,
D. G.
,
Dietterich
,
T. G.
, and
Stauffer
,
L. A.
, 1988, “
A Model of the Mechanical Design Process Based on Empirical Data
,”
Artif. Intell. Eng. Des. Anal. Manuf.
0890-0604,
2
, pp.
33
52
.
36.
Jain
,
V. K.
, and
Sobek
,
D. K.
, III
, 2006, “
Linking Design Process to Customer Satisfaction Through Virtual Design of Experiments
,”
Res. Eng. Des.
0934-9839,
17
(
2
), pp.
59
71
.
41.
Jain
,
V. K.
, 2003, “
Relating Design Process To Design Outcome In Engineering Capstone Projects
,” Master’s thesis, Montana State University, Bozeman, MT.
42.
Sobek
,
D. K.
, and
Jain
,
V. K.
, 2004, “
Two Instruments for Assessing Design Outcomes of Capstone Projects
,”
Proceedings of the American Society of Engineering Education Conference
, Salt Lake City, UT, June 20–23.
43.
Pyzdek
,
T.
, 1999, “
Applying Virtual DOE in the Real World, Quality Digest
,” http://www.pyzdek.com/PDF/1999-08.pdfhttp://www.pyzdek.com/PDF/1999-08.pdf
44.
Sacks
,
J.
,
Welch
,
W.
,
Mitchell
,
T.
, and
Wynn
,
H.
, 1989, “
Design and Analysis of Computer Experiments
,”
Stat. Sci.
0883-4237,
4
, pp.
409
435
.
45.
Diamantaras
,
K.
, and
Kung
,
S.
, 1996,
Principal Component Neural Networks
,
Wiley
, New York.
46.
Tan
,
S.
, and
Mavarovouniotis
,
M.
, 1995, “
Reducing Data Dimensionality Through Optimizing Neural Network Inputs
,”
AIChE J.
0001-1541,
41
, pp.
1471
1480
.
47.
Neural Networks-Neurosolutions
,” 2007, http://www.neurosolutions.comhttp://www.neurosolutions.com
48.
Shi
,
X.
,
Schillings
,
P.
, and
Boyd
,
D.
, 2002, “
Applying Artificial Neural Networks and Virtual Experimental Design to Quality Improvement of Two Industrial Processes
,”
Int. J. Prod. Res.
0020-7543,
42
, pp.
101
118
.
49.
Smith
,
M.
, 1993,
Neural Networks for Statistical Modeling
,
Van Nostrand Reinhold
, New York.
50.
Warner
,
B.
, and
Misra
,
M.
, 1996, “
Understanding Neural Networks as Statistical Tools
,”
Am. Stat.
0003-1305,
50
, pp.
284
293
.
52.
Ahmed
,
S.
,
Wallace
,
K.
, and
Blessing
,
L.
, 2003, “
Understanding the Differences Between How Novice and Experienced Designers Approach Design Tasks
,”
Res. Eng. Des.
0934-9839,
14
, pp.
1
11
.
53.
Newstetter
,
W.
, and
McCracken
,
M.
, 2001, “
Novice Conceptions of Design: Implications for the Design of Learning Environments
,”
Design Knowing and Learning: Cognition in Design Education
,
C.
Eastman
,
M.
McCracken
, and
W.
Newstetter
, eds.,
Elsevier Science
, Oxford, UK.
54.
Hicks
,
B. J.
,
Culley
,
S. J.
, and
Mullineux
,
G.
, 2005, “
The Modeling of Engineering Systems for Their Computer-Based Embodiment With Standard Components
,”
J. Mech. Des.
1050-0472,
127
, pp.
424
432
.
You do not currently have access to this content.