HKUST Library Institutional Repository Banner

HKUST Institutional Repository >
Marketing >
MARK Working Papers >

Please use this identifier to cite or link to this item: http://hdl.handle.net/1783.1/882
Title: Assessing the integrity of cross-validation : a case for small sample-based research
Authors: Kim, Namwoon
Han, Jin Kyung
Keywords: Small sample-based research
Cross-validation methods
Sample-repeat
Bootstrap
Jackknife
Bootjack
Integrity
Issue Date: Jul-1997
Series/Report no.: Marketing Working Paper Series ; MKTG 97.096
Abstract: In the context of small sample-based research, investigators often encounter feasibility problem(s) in cross-validation endeavors. The problem(s), in general, can be traced to two criteria: (1) methodological (i.e., arising due to inefficient or limited portfolio of cross-validation methods); and (2) data-related (i.e., originating due to availability-constraints on pertinent research sample). In this paper, we address the former source of problem as the main contingency when the latitude on the latter problem source is exogenous to the investigator. Specifically, four resampling-class of validation methods applicable for small-sample context are examined: sample-repeat, bootstrap, jackknife, and introducing bootjack. Bootjack, developed by the authors, incorporates desirable features from two other methods (bootstrap and jackknife). The four techniques are put through a comparative analysis across sample-sizes of various magnitudes. Moreover, the methods are judged for the integrity of their prediction results, which consists of (1) unbiasedness in predictions; (2) consistency of predictions across different sample sizes; and (3) stability of prediction results. Finally, recommendations are made regarding small-sample validation predicament.
URI: http://hdl.handle.net/1783.1/882
Appears in Collections:MARK Working Papers

Files in This Item:

File Description SizeFormat
mktg97096.pdf1557KbAdobe PDFView/Open

All items in this Repository are protected by copyright, with all rights reserved.