Learn Before
Informal View of Task Difficulty in Neural Networks
Machine learning does not yet have a precise formal way to measure how difficult a task is. In practice, a task is often described as easier when it can be solved with fewer processing steps, which corresponds to a shallower neural network. A task is considered harder when it needs more processing steps, which corresponds to a deeper neural network.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Informal View of Task Difficulty in Neural Networks
Which binary classification task is likely the easiest and needs the fewest training examples?
True or False: A simpler binary classification problem usually needs fewer labeled examples than a more difficult one.
Simpler tasks need less data
Match each vision task to its relative difficulty rank in the ordered list (1 = easiest, 5 = hardest).
Order these five classification tasks from easiest (1) to hardest (5).
How does task difficulty influence data needs when dividing a pipeline into subtasks?
A model that must distinguish two very similar bird species usually needs less training data than a model that only decides whether a photo is indoors or outdoors.
Binary Output in Several Toy Image Tasks
Match each image task description to the difficulty category it best fits.
Put the task-formulation steps in a sensible order when choosing a component for a text-classification pipeline.
How Task Difficulty Affects Training Data Needs
Choosing the Easier Image Classification Task
Why Some Classification Tasks Need Less Training Data
Learn After
What is the current theoretical status of measuring task difficulty in machine learning?
A task is formally “easy” if a shallow neural network can solve it and “hard” if it requires a deeper one.
An easy task can often be handled by a _____ neural network.
Match task-size descriptions to the appropriate model depth.
Arrange the informal steps for judging task difficulty.
What usually represents a more difficult task for a deep neural network?
Are tasks that take fewer computation steps considered easier?
Machine learning still lacks a _____ way to define how hard a task is.
Match terms to their meanings about task difficulty.
Arrange the tasks from the simplest network to the most complex network.
How practitioners estimate whether a task is easy or hard
Classifying Neural Network Task Difficulty
How Step Count Signals Task Difficulty