- Divisive Clustering takes into account the global distribution of data and so forms more accurate clusters ( i.e. doesn't get thrown off by local minima/maxima ) than Agglomerative Clustering.
- Agglomerative Clustering has O($n^2$) complexity in the most efficient implementation of the algorithm. Divisive Clustering is linear in the number of clusters.

University of Michigan - Ann Arbor

One cluster for each observation, then clusters are moved together as one moves up the hierarchy of clusters

Steps: 
1. Each data point is initially in its own cluster with one item 
2. Most similar cluster of each stage is merged 
3. Stopping measure: number of clusters 

Linkage criteria
- Ward's method
- least increase in total variance (around cluster centroids) 
2. Average linkage 
- average distance between clusters
3. Complete linkage 
- max distance between clusters




Agglomerative: Bottom-up approach

Start with all observations in one cluster, then splits form as one moves down the hierarchy.

Divisive: Top-down approach

```Python
# imports
from sklearn.cluster import AgglomerativeClustering
import numpy as np

#create 100 samples with 10 features
X = np.random.rand(100,10)

# create model, then fit the data to the model, then generate clustering predictions
clustering = AgglomerativeClustering().fit_predict(X)

# show cluster labels for each sample
clustering
```


Python Code for Agglomerative Clustering

1. Consider all data points to be their own cluster
2. Identify and merge pairs of clusters that are most similar
 3. Continue merging pairs until only one cluster remains

link: [towardsdatascience.com/understanding-the-concept-of-hierarchical-clustering-technique-c6e8243758ec](https://towardsdatascience.com/understanding-the-concept-of-hierarchical-clustering-technique-c6e8243758ec)  

Medium: Agglomerative Hierarchical Clustering Algorithm

A really good paper that goes into the implementations of agglomerative clustering.
[arxiv.org/pdf/1109.2378.pdf](https://arxiv.org/pdf/1109.2378.pdf) 

Modern Heirarchical, agglomerative clustering methods

Divisive vs. Agglomerative Clustering Algorithms

1. Consider all data points as one cluster
2. Identify and split the least similar observations
3. Repeat splitting until all clusters are divided

link: [towardsdatascience.com/understanding-the-concept-of-hierarchical-clustering-technique-c6e8243758ec](https://towardsdatascience.com/understanding-the-concept-of-hierarchical-clustering-technique-c6e8243758ec) 

Learn Before

Related