Abstract
Clustering algorithms have been widely applied to gene expression data. For both hierarchical and partitioning clustering algorithms, selecting the number of significant clusters is an important problem and many methods have been proposed. Existing methods for selecting the number of clusters tend to find only the global patterns in the data (e.g.: the over and under expressed genes). We have noted the need for a better method in the gene expression context, where small, biologically meaningful clusters can be difficult to identify. In this paper, we define a new criteria, Mean Split Silhouette (MSS), which is a measure of cluster heterogeneity. We propose to choose the number of clusters as the minimizer of MSS. In this way, the number of significant clusters is defined as that which produces the most homogeneous clusters. The power of this method compared to existing methods is demonstrated on simulated microarray data. The minimum MSS method is an example of a general approach that can be applied to any clustering routine with any global criteria.
Disciplines
Microarrays | Multivariate Analysis | Statistical Methodology | Statistical Theory
Suggested Citation
Pollard, Katherine S. and van der Laan, Mark J., "A Method to Identify Significant Clusters in Gene Expression Data" (April 2002). U.C. Berkeley Division of Biostatistics Working Paper Series. Working Paper 107.
https://biostats.bepress.com/ucbbiostat/paper107
Included in
Microarrays Commons, Multivariate Analysis Commons, Statistical Methodology Commons, Statistical Theory Commons
Comments
Published 2002 in Proceedings, SCI (World Multiconference on Systemics, Cybernetics and Informatics), V. II, 318-325.