A tool to validate the assumptions on ratios of nearest neighbors’ distances: the Consecutive Ratio Paths

Francesco Denti*, Antonietta Mira

*Corresponding author

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The estimation of the intrinsic dimension is an essential step in many data analyses involving, for example, dimensionality reduction. Likelihood-based estimators, which rely on the distributions of the ratios of distances between nearest neighbors, have been recently proposed. However, these distributional results de- pend on several assumptions. One of the most important is the local homogeneity of the point process characterizing the data-generating mechanism. By exploiting a recent theoretical result, we develop the Consecutive Ratio Paths, a graphical tool to assess the validity of the local-homogeneity assumption in a dataset. This tool is also helpful to uncover the presence of multiple latent manifolds, a potential indicator of the existence of heterogeneous intrinsic dimensions.
Original languageEnglish
Title of host publicationBook of Short Paper SIS 2022
Pages1233-1238
Number of pages6
Publication statusPublished - 2022
EventSIS 2022 - Caserta
Duration: 22 Jun 202224 Jun 2022

Conference

ConferenceSIS 2022
CityCaserta
Period22/6/2224/6/22

Keywords

  • Pareto distribution
  • graphic tool
  • intrinsic dimension
  • model- based estimation
  • nearest neighbors

Fingerprint

Dive into the research topics of 'A tool to validate the assumptions on ratios of nearest neighbors’ distances: the Consecutive Ratio Paths'. Together they form a unique fingerprint.

Cite this