A divisive clustering method for functional data with special consideration of outliers Articles uri icon

authors

  • JUSTEL EUSEBIO, ANA MARIA
  • Svarc, Marcela

publication date

  • September 2018

start page

  • 637

end page

  • 656

volume

  • 12

International Standard Serial Number (ISSN)

  • 1862-5347

Electronic International Standard Serial Number (EISSN)

  • 1862-5355

abstract

  • This paper presents DivClusFD, a new divisive hierarchical method for the non-supervised classification of functional data. Data of this type present the peculiarity that the differences among clusters may be caused by changes as well in level as in shape. Different clusters can be separated in different subregion and there may be no subregion in which all clusters are separated. In each step of division, the DivClusFD method explores the functions and their derivatives at several fixed points, seeking the subregion in which the highest number of clusters can be separated. The number of clusters is estimated via the gap statistic. The functions are assigned to the new clusters by combining the k-means algorithm with the use of functional boxplots to identify functions that have been incorrectly classified because of their atypical local behavior. The DivClusFD method provides the number of clusters, the classification of the observed functions into the clusters and guidelines that may be for interpreting the clusters. A simulation study using synthetic data and tests of the performance of the DivClusFD method on real data sets indicate that this method is able to classify functions accurately.

keywords

  • hierarchical clustering; functional boxplot; gap statistic; 62h30