If we consider different languages as different domains, then the cross-lingual transfer can be regarded as a special case of cross-domain transfer. A unified network architecture across all tasks is not obvious in cross-lingual learning because the vocabularies in different tasks are different. Before multilingual pre-trained models are available, unified word embeddings across languages are required.