This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Google Scholar Articles by Goodhue, D. Articles by Thompson, R. Search for Related Content

Research Note—Statistical Power in Analyzing Interaction Effects: Questioning the Advantage of PLS with Product Indicators

MIS Department, Terry College of Business, University of Georgia, Athens, Georgia 30606
College of Administration and Business, Louisiana Tech University, P.O. Box 10318, Ruston, Louisiana 71272
Babcock Graduate School of Management, Wake Forest University, Winston-Salem, North Carolina 27109
dgoodhue{at}terry.uga.edu
william.w.lewis{at}gmail.com
ron.thompson{at}mba.wfu.edu

A significant amount of information systems (IS) research involves hypothesizing and testing for interaction effects. Chin et al. (2003) completed an extensive experiment using Monte Carlo simulation that compared two different techniques for detecting and estimating such interaction effects: partial least squares (PLS) with a product indicator approach versus multiple regression with summated indicators. By varying the number of indicators for each construct and the sample size, they concluded that PLS using product indicators was better (at providing higher and presumably more accurate path estimates) than multiple regression using summated indicators. Although we view the Chin et al. (2003) study as an important step in using Monte Carlo analysis to investigate such issues, we believe their results give a misleading picture of the efficacy of the product indicator approach with PLS. By expanding the scope of the investigation to include statistical power, and by replicating and then extending their work, we reach a different conclusion—that although PLS with the product indicator approach provides higher point estimates of interaction paths, it also produces wider confidence intervals, and thus provides less statistical power than multiple regression. This disadvantage increases with the number of indicators and (up to a point) with sample size. We explore the possibility that these surprising results can be explained by capitalization on chance. Regardless of the explanation, our analysis leads us to recommend that if sample size or statistical significance is a concern, regression or PLS with product of the sums should be used instead of PLS with product indicators for testing interaction effects.

Key Words: interaction effects; moderator effects; regression; PLS; product indicators; statistical power; statistical accuracy; Monte Carlo simulation
History: This paper was received on June 4, 2004.

This article has been cited by other articles:

				G. Im and A. Rai Knowledge Sharing Ambidexterity in Long-Term Interorganizational Relationships Management Science, July 1, 2008; 54(7): 1281 - 1296. [Abstract] [PDF]