Learn Before
Shape of a Concatenated Weight Sub-Matrix ()
Each sub-matrix within a larger weight matrix —which is constructed by concatenating sub-matrices—has dimensions of . In this specification, denotes the number of rows, is the total number of columns for the complete matrix , and is the total count of sub-matrices. This guarantees that joining the sub-matrices horizontally results in the combined matrix having exactly columns.
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Vector Multiplication over Concatenated Matrices
A larger matrix, W, is constructed by horizontally concatenating two smaller matrices, W¹ and W², such that W = [W¹ W²]. Given W¹ = [[1, 5], [3, 7]] and W² = [[2, 6], [4, 8]], what is the resulting matrix W?
A large matrix is constructed by horizontally joining four smaller matrices of equal size: . If the final matrix has dimensions of 50 rows and 200 columns, what are the dimensions of a single sub-matrix, such as ?
A large matrix with dimensions $10 \times 120 is created by horizontally joining a sequence of smaller, identical sub-matrices. If each of these sub-matrices has dimensions $10 \times 30, how many sub-matrices were joined together to form ?
Shape of a Concatenated Weight Sub-Matrix ()