Abstract

This brief extends prior research by the authors on studying the impacts of interventions provided by either a human or an artificial intelligence (AI) process manager on team behaviors. Our earlier research found that a created AI process manager matched the capabilities of human process management. Here, these data are studied further to identify the impact of different types of interventions on team behaviors and outcomes. This deeper dive is done via two unique perspectives: comparing teams’ problem-solving processes before and after interventions are provided, and through a regression analysis between intervention counts and performance. Results show overall mixed adherence to the provided interventions, and that this adherence also depends on the intervention type. The most significant impact on the team process arises from the communication frequency interventions. Furthermore, a regression analysis identifies the interventions with the greatest correlation with team performance, indicating a better selection of interventions from the AI process manager. Paired together, the results show the feasibility of automated process management via AI and shed light on the effective implementation of intervention strategies for future development and deployment.

References

1.
Gyory
,
J. T.
,
Cagan
,
J.
, and
Kotovsky
,
K.
,
2019
, “
Are You Better Off Alone? Mitigating the Underperformance of Engineering Teams During Conceptual Design Through Adaptive Process Management
,”
Res. Eng. Des.
,
30
(
1
), pp.
85
102
.
2.
Gyory
,
J. T.
,
Soria Zurita
,
N. F.
,
Martin
,
J.
,
Balon
,
C.
,
McComb
,
C.
,
Kotovsky
,
K.
, and
Cagan
,
J.
,
2021
, “
Human Versus Artificial Intelligence: A Data-Driven Approach to Real-Time Process Management During Complex Engineering Design
,”
ASME J. Mech. Des.
,
144
(
2
), p.
021405
.
3.
Dellermann
,
D.
,
Ebel
,
P.
,
Söllner
,
M.
, and
Leimeister
,
J. M.
,
2019
, “
Hybrid Intelligence
,”
Bus. Inf. Syst. Eng.
,
61
(
5
), pp.
637
643
.
4.
Roll
,
I.
,
Wiese
,
E. S.
,
Long
,
Y.
,
Aleven
,
V.
, and
Koedinger
,
K. R.
,
2014
,
Design Recommendations for Intelligent Tutoring Systems
, Vol.
Vol. 2
,
U.S. Army Research Laboratory
,
Orlando, FL
, pp.
169
182
.
5.
Liew
,
C.
,
2018
, “
The Future of Radiology Augmented With Artificial Intelligence: A Strategy for Success
,”
Eur. J. Radiol.
,
102
, pp.
152
156
.
6.
Zurita
,
N. F. S.
,
Gyory
,
J. T.
,
Balon
,
C.
,
Martin
,
J.
,
Kotovsky
,
K.
,
Cagan
,
J.
, and
McComb
,
C.
,
2022
, “
Data on the Human Versus Artificial Intelligence Process Management Experiment
,”
Data Br.
,
41
, p.
107917
.
7.
HyFormTM GitHub
,” https://github.com/hyform/drone-testbed-server/releases/tag/2021-March-v2, Accessed April 23, 2021.
8.
Gyory
,
J. T.
,
Song
,
B.
,
Cagan
,
J.
, and
McComb
,
C.
,
2021
, “
Communication in AI-Assisted Teams During an Interdisciplinary Drone Design Problem
,”
International Conference on Engineering Design
,
Gothenburg, Sweden
,
Aug. 16–20
.
9.
Landauer
,
T. K.
,
Foltz
,
P. W.
, and
Laham
,
D.
,
1998
, “
An Introduction to Latent Semantic Analysis
,”
Discourse Process.
,
25
(
2–3
), pp.
259
284
.
10.
Dong
,
A.
,
2005
, “
The Latent Semantic Approach to Studying Design Team Communication
,”
Des. Stud.
,
26
(
5
), pp.
445
461
.
11.
Foltz
,
P. W.
, and
Martin
,
M. J.
,
2008
,
Team Effectiveness in Complex Organizations
,
Routledge
,
New York
, pp.
445
466
.
You do not currently have access to this content.