k-means - get the sizes of clusters and every element in a cluster

[varvaralitvinova]

I have used k-means clustering on 180K vectors, I have 20 clusters and I would like to see how many elements each cluster contains. How can I do that?

[mdouze]

np.bincount(assign) should do the trick

[Lorisyy]

np.bincount(assign) should do the trick

As far as I'm concerned, it just shows the histogram of each element in the whole 180K vector's appearing count, but not actually the sizes of clusters and every element in a cluster

[Lorisyy]

Oops, btw you can use the tools mentioned here: https://github.com/facebookresearch/faiss/wiki/Faiss-building-blocks:-clustering,-PCA,-quantization#assignment
This computes the mapping from your set of vectors to the cluster centroids after Kmeans has finished training.
:)

[dzenilee]

I'm not sure @Lorisyy's link has the answer to @varvaralitvinova's question, but for getting counts, we can do:

from collections import Counter

counter = Counter()
for c in I.reshape(-1):
    counter[c] += 1 

sorted(counter.items())

Returns:

# (cluster id, count of elements)

[(0, 55),
 (1, 31),
 (2, 16),
 (3, 76),
 (4, 42),
 (5, 33),
 (6, 50),
...

However, it'd really be nice to have a built-in method to extract the elements of each cluster easily.