This article is within the scope of WikiProject Computer science, a collaborative effort to improve the coverage of Computer science related articles on Wikipedia. If you would like to participate, please visit the project page, where you can join the discussion and see a list of open tasks.Computer scienceWikipedia:WikiProject Computer scienceTemplate:WikiProject Computer scienceComputer science articles
This article is within the scope of WikiProject Statistics, a collaborative effort to improve the coverage of statistics on Wikipedia. If you would like to participate, please visit the project page, where you can join the discussion and see a list of open tasks.StatisticsWikipedia:WikiProject StatisticsTemplate:WikiProject StatisticsStatistics articles
The article is completely inaccessible to somebody even with a modest computer science or mathematics background. Launching into phrases such as "k-nearest neighbors" only communicates information to those familiar with graph theory. --- Whpq (talk) 22:55, 15 November 2008 (UTC)[reply]
I agree that this article is inaccessible. Here's my suggestions to fix it:
I don't think the phrase "k-nearest neighbors" can be removed. All manifold learners try to project data into fewer dimensions data while preserving some local metric. By far, the most common local metric to preserve is the distance from each point to its k-nearest neighbors. It would be redundant to re-explain this in every article about a manifold learning algorithm. So I propose that the phrase "k-nearest neighbors" should link to a new article that explains this concept. Unfortunately, the K-nearest_neighbor_algorithm article is too specific in that it assumes you are finding the k-nearest neighbors for the purpose of classification, which is not the case here. (Further, that article completely lacks discussion of the use of L-Norms and Hamming distance with KNN, linear weighting for regression, etc.) So I propose that we begin by splitting that article into two parts, and then linking the "k-nearest neighbors" term to the appropriate half.
I'd like to see some clarification on why neighbor distances constitute a discrete approximation of the manifold. It's also unclear from this article exactly what is the purpose of the inner-product matrix that is learned. Does this matrix transform points from the input-space to the unfolded-space? Or does this matrix hold/encode the points after their projecting into the unfolded-space? I think it is the former, but the article makes it sound like the latter.
I also think it would help a lot more clear to give more intuition for the steps. For example, it would help to say things like: "Semi-definite programming is used to 'unfold' the manifold by maximizing the distance between non-neighboring points, while preserving the constraints that neighboring points must retain their original distances", or "After the manifold has been 'unfolded', the points will lie on a nearly linear manifold, so at that point, any simple/linear dimensionality reduction algorithm (like PCA or multi-dimensional scaling) can be used to project the points from the unfolded manifold into low-dimensional space."
