Please use this identifier to cite or link to this item:
http://dspace.mediu.edu.my:8181/xmlui/handle/1721.1/6723Full metadata record
| DC Field | Value | Language |
|---|---|---|
| dc.creator | Mukherjee, Sayan | - |
| dc.creator | Golland, Polina | - |
| dc.creator | Panchenko, Dmitry | - |
| dc.date | 2004-10-08T20:39:06Z | - |
| dc.date | 2004-10-08T20:39:06Z | - |
| dc.date | 2003-08-28 | - |
| dc.date.accessioned | 2013-10-09T02:46:33Z | - |
| dc.date.available | 2013-10-09T02:46:33Z | - |
| dc.date.issued | 2013-10-09 | - |
| dc.identifier | AIM-2003-019 | - |
| dc.identifier | http://hdl.handle.net/1721.1/6723 | - |
| dc.identifier.uri | http://koha.mediu.edu.my:8181/xmlui/handle/1721 | - |
| dc.description | We introduce and explore an approach to estimating statistical significance of classification accuracy, which is particularly useful in scientific applications of machine learning where high dimensionality of the data and the small number of training examples render most standard convergence bounds too loose to yield a meaningful guarantee of the generalization ability of the classifier. Instead, we estimate statistical significance of the observed classification accuracy, or the likelihood of observing such accuracy by chance due to spurious correlations of the high-dimensional data patterns with the class labels in the given training set. We adopt permutation testing, a non-parametric technique previously developed in classical statistics for hypothesis testing in the generative setting (i.e., comparing two probability distributions). We demonstrate the method on real examples from neuroimaging studies and DNA microarray analysis and suggest a theoretical analysis of the procedure that relates the asymptotic behavior of the test to the existing convergence bounds. | - |
| dc.format | 22 p. | - |
| dc.format | 1135156 bytes | - |
| dc.format | 662639 bytes | - |
| dc.format | application/postscript | - |
| dc.format | application/pdf | - |
| dc.language | en_US | - |
| dc.relation | AIM-2003-019 | - |
| dc.subject | AI | - |
| dc.subject | Classification | - |
| dc.subject | Permutation testing | - |
| dc.subject | Statistical significance. | - |
| dc.title | Permutation Tests for Classification | - |
| Appears in Collections: | MIT Items | |
Files in This Item:
There are no files associated with this item.
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.