Formula
Computational Cost of Exhaustive Search in Sequence-to-Sequence Models
While exhaustive search guarantees finding the optimal sequence, it incurs a prohibitive computational cost of , where is the vocabulary size and is the sequence length. This exponential growth makes it practically infeasible; for instance, evaluating a sequence of length with a vocabulary of would require assessing sequences, which is beyond the capabilities of foreseeable computers.
0
1
Updated 2026-05-14
Tags
D2L
Dive into Deep Learning @ D2L