Alternative Dimensions of LLM Scaling

Large-Scale Pre-training for LLMs

A development team is working on enhancing their company's language model. They are considering two different projects. Project Alpha involves training a new, much larger model from scratch on a petabyte-scale dataset to create a more powerful and knowledgeable general-purpose assistant. Project Beta involves modifying their existing model to enable it to accurately summarize entire books, which requires processing text inputs that are hundreds of times longer than what it can currently handle. Which statement correctly classifies the strategy used in each project?

Large-Scale Pre-training of LLMs

LLM Strategy for a Financial Tech Startup

Match each primary strategy for scaling Large Language Models with its corresponding description and goal.