Learn Before
Vector Multiplication over Concatenated Matrices
When a vector is multiplied by a matrix that is formed by the horizontal concatenation of several sub-matrices (), the operation is distributive. This means the result is equivalent to a new matrix formed by concatenating the products of the vector with each individual sub-matrix. This property is mathematically expressed as: .

0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Vector Multiplication over Concatenated Matrices
A larger matrix, W, is constructed by horizontally concatenating two smaller matrices, W¹ and W², such that W = [W¹ W²]. Given W¹ = [[1, 5], [3, 7]] and W² = [[2, 6], [4, 8]], what is the resulting matrix W?
A large matrix is constructed by horizontally joining four smaller matrices of equal size: . If the final matrix has dimensions of 50 rows and 200 columns, what are the dimensions of a single sub-matrix, such as ?
A large matrix with dimensions $10 \times 120 is created by horizontally joining a sequence of smaller, identical sub-matrices. If each of these sub-matrices has dimensions $10 \times 30, how many sub-matrices were joined together to form ?
Shape of a Concatenated Weight Sub-Matrix ()
Learn After
Consider a row vector
h = [2, 3]and two matrices,W_1 = [[1, 0], [0, 1]]andW_2 = [[4], [5]]. If a larger matrixW_his formed by horizontally concatenatingW_1andW_2(i.e.,W_h = [W_1 W_2]), what is the result of the multiplicationh * W_h?True or False: When a row vector
his multiplied by a matrixWthat is formed by horizontally concatenating two matricesW_1andW_2(i.e.,W = [W_1 W_2]), the resulting vector is equivalent to the sum of the individual productsh * W_1andh * W_2.Optimizing Matrix Computations