Abstract
Several authors have studied the performance of optimal, squared error loss (SEL) estimated ranks. Though these are effective, in many applications interest focuses on identifying the relatively good (e.g., in the upper 10%) or relatively poor performers. We construct loss functions that address this goal and evaluate candidate rank estimates, some of which optimize specific loss functions. We study performance for a fully parametric hierarchical model with a Gaussian prior and Gaussian sampling distributions, evaluating performance for several loss functions. Results show that though SEL-optimal ranks and percentiles do not specifically focus on classifying with respect to a percentile cut point, they perform very well over a broad range of loss functions. We compare inferences produced by the candidate estimates using data from The Community Tracking Study.
Disciplines
Statistical Methodology | Statistical Models | Statistical Theory
Suggested Citation
Lin, Rongheng; Louis, Thomas A.; Paddock, Susan M.; and Ridgeway, Greg , "Loss Function Based Ranking in Two-Stage, Hierarchical Models" (November 2003). Johns Hopkins University, Dept. of Biostatistics Working Papers. Working Paper 6.
https://biostats.bepress.com/jhubiostat/paper6
Comments
This has been submitted to JASA/T&M (and to the ENAR student paper competition.