Oct 22nd, 2009| 07:08 pm | Posted by hlee
[arXiv:stat.ME:0910.2585]
Variable Selection and Updating In Model-Based Discriminant Analysis for High Dimensional Data with Food Authenticity Applications
by Murphy, Dean, and Raftery
Classifying or clustering (or semi supervised learning) spectra is a very challenging problem from collecting statistical-analysis-ready data to reducing the dimensionality without sacrificing complex information in each spectrum. Not only how to estimate spiky (not differentiable) curves via statistically well defined procedures of estimating equations but also how to transform data that match the regularity conditions in statistics is challenging.
Continue reading ‘[ArXiv] classifying spectra’ »
Tags:
BIC,
Classification,
clustering,
cross-validation,
curse of dimensionality,
discriminant analysis,
graphical model,
mclust,
model based,
semi-supervised learning,
statistical learning,
variable selection Category:
Algorithms,
arXiv,
Cross-Cultural,
Data Processing,
Jargon,
Methods,
Spectral,
Stat |
Comment
Jan 18th, 2008| 02:24 pm | Posted by hlee
Seven preprints were chosen this week and two mentioned model selection. Continue reading ‘[ArXiv] 3rd week, Jan. 2008’ »
Tags:
AIC,
Bayesian,
BIC,
CLT,
correlation,
F-test,
FoF,
hypothesis testing,
Kolmogorov-Smirnoff test,
LRT,
Model Selection,
modeling,
sunspots Category:
arXiv |
Comment
Jan 11th, 2008| 03:44 pm | Posted by hlee
It is notable that there’s an astronomy paper contains AIC, BIC, and Bayesian evidence in the title. The topic of the paper, unexceptionally, is cosmology like other astronomy papers discussed these (statistical) information criteria (I only found a couple of papers on model selection applied to astronomical data analysis without articulating CMB stuffs. Note that I exclude Bayes factor for the model selection purpose).
To find the paper or other interesting ones, click Continue reading ‘[ArXiv] 2nd week, Jan. 2007’ »
Tags:
AIC,
Bayesian evidence,
BIC,
catalog,
Classification,
CMB,
confidence interval,
consistency,
correlation,
GRB,
information criterion,
Model Selection,
SDSS,
test,
WMAP Category:
arXiv |
Comment
Jun 25th, 2007| 01:27 pm | Posted by hlee
One of the papers from arxiv/astro-ph discusses kernel regression and model selection to determine photometric redshifts astro-ph/0706.2704. This paper presents their studies on choosing bandwidth of kernels via 10 fold cross-validation, choosing appropriate models from various combination of input parameters through estimating root mean square error and AIC, and evaluating their kernel regression to other regression and classification methods with root mean square errors from literature survey. They made a conclusion of flexibility in kernel regression particularly for data at high z.
Continue reading ‘[ArXiv] Kernel Regression, June 20, 2007’ »
Tags:
AIC,
BIC,
Classification,
cross-validation,
kernel,
photometric redshifts,
regression,
SDSS Category:
arXiv,
Frequentist,
Galaxies,
Stat |
Comment