Affordable Access

Publisher Website

Oracle properties of SCAD-penalized support vector machine

Authors
Journal
Journal of Statistical Planning and Inference
0378-3758
Publisher
Elsevier
Volume
142
Issue
8
Identifiers
DOI: 10.1016/j.jspi.2012.03.002
Keywords
  • Classification
  • Fisher Consistency
  • Oracle Property
  • Smoothly Clipped Absolute Deviation

Abstract

Abstract In many scientific investigations, a large number of input variables are given at the early stage of modeling and identifying the variables predictive of the response is often a main purpose of such investigations. Recently, the support vector machine has become an important tool in classification problems of many fields. Several variants of the support vector machine adopting different penalties in its objective function have been proposed. This paper deals with the Fisher consistency and the oracle property of support vector machines in the setting where the dimension of inputs is fixed. First, we study the Fisher consistency of the support vector machine over the class of affine functions. It is shown that the function class for decision functions is crucial for the Fisher consistency. Second, we study the oracle property of the penalized support vector machines with the smoothly clipped absolute deviation penalty. Once we have addressed the Fisher consistency of the support vector machine over the class of affine functions, the oracle property appears to be meaningful in the context of classification. A simulation study is provided in order to show small sample properties of the penalized support vector machines with the smoothly clipped absolute deviation penalty.

There are no comments yet on this publication. Be the first to share your thoughts.