Depth Size is important for both sparse and dense vectors. When vectors are computed with short context windows we collect a syntagmatic association (neighboring words) resulting in relational association, and when vectors are computed from long context windows we collect a Paradigmatic association (similar neighbors) resulting in topic word association.