Discriminative Densities from Maximum Contrast Estimation

Meinicke P, Twellmann T, Ritter H (2002)
In: Advances in Neural Information Processing Systems 15. Advances in neural information processing systems : .. proceedings of the .. conference, . Cambridge, Mass.: MIT-Press: 985-992.

Conference Paper | Published | English

No fulltext has been uploaded

Author
Abstract
We propose a framework for classifier design based on discriminative densities for representation of the differences of the class-conditional distributions in a way that is optimal for classification. The densities are selected from a parametrized set by constrained maximization of some objective function which measures the average (bounded) difference, i.e. the contrast between discriminative densities. We show that maximiza- tion of the contrast is equivalent to minimization of an approximation of the Bayes risk. Therefore using suitable classes of probability density functions, the resulting maximum contrast classifiers(MCCs) can approximate the Bayes rule for the general multiclass case. In particular for a certain parametrization of the density functions we obtain MCCs which have the same functional form as the well-known Support Vector Machines (SVMs). We show that MCC-training in general requires some nonlinear optimization but under certain conditions the problem is concave and can be tackled by a single linear program. We indicate the close relation between SVM- and MCC-training and in particular we show that Linear Programming Machines can be viewed as an approxi- mate realization of MCCs. In the experiments on benchmark data sets, the MCC shows a competitive classification performance.
Publishing Year
Conference
Neural Information Processing Systems 2002
Location
Cambridge, Mass.
PUB-ID

Cite this

Meinicke P, Twellmann T, Ritter H. Discriminative Densities from Maximum Contrast Estimation. In: Advances in Neural Information Processing Systems 15. Advances in neural information processing systems : .. proceedings of the .. conference. Cambridge, Mass.: MIT-Press; 2002: 985-992.
Meinicke, P., Twellmann, T., & Ritter, H. (2002). Discriminative Densities from Maximum Contrast Estimation. Advances in Neural Information Processing Systems 15, 985-992.
Meinicke, P., Twellmann, T., and Ritter, H. (2002). “Discriminative Densities from Maximum Contrast Estimation” in Advances in Neural Information Processing Systems 15 Advances in neural information processing systems : .. proceedings of the .. conference (Cambridge, Mass.: MIT-Press), 985-992.
Meinicke, P., Twellmann, T., & Ritter, H., 2002. Discriminative Densities from Maximum Contrast Estimation. In Advances in Neural Information Processing Systems 15. Advances in neural information processing systems : .. proceedings of the .. conference. Cambridge, Mass.: MIT-Press, pp. 985-992.
P. Meinicke, T. Twellmann, and H. Ritter, “Discriminative Densities from Maximum Contrast Estimation”, Advances in Neural Information Processing Systems 15, Advances in neural information processing systems : .. proceedings of the .. conference, Cambridge, Mass.: MIT-Press, 2002, pp.985-992.
Meinicke, P., Twellmann, T., Ritter, H.: Discriminative Densities from Maximum Contrast Estimation. Advances in Neural Information Processing Systems 15. Advances in neural information processing systems : .. proceedings of the .. conference. p. 985-992. MIT-Press, Cambridge, Mass. (2002).
Meinicke, Peter, Twellmann, Thorsten, and Ritter, Helge. “Discriminative Densities from Maximum Contrast Estimation”. Advances in Neural Information Processing Systems 15. Cambridge, Mass.: MIT-Press, 2002. Advances in neural information processing systems : .. proceedings of the .. conference. 985-992.
This data publication is cited in the following publications:
This publication cites the following data publications:

Export

0 Marked Publications

Open Data PUB

Search this title in

Google Scholar
ISBN Search