Case Study

Evaluating pipeline architecture for a new self-driving car startup

Case context: A new autonomous driving startup has a limited budget and timeline. They are choosing between building a pure end-to-end steering system and a multi-stage pipeline that utilizes intermediate car and pedestrian detectors. They notice that public computer vision datasets contain a massive number of labeled car and pedestrian images, but they do not have pre-collected datasets of driver steering logs mapped to front-facing camera footage.

Question: Based on the concept of data availability for autonomous driving, which architectural approach should the startup select and why? Detail the specific data constraints that influence this decision.

Sample answer: The startup should select a multi-stage, non-end-to-end pipeline that utilizes intermediate car and pedestrian detectors. A pure end-to-end approach requires a large dataset of image and steering-direction pairs, which is expensive and time-consuming to collect since it requires recording manual driving. Because labeled car and pedestrian image data is already relatively easy to obtain from existing computer vision datasets, building intermediate detectors is much more feasible under their budget and timeline constraint. Therefore, the availability of intermediate data favors a multi-stage pipeline design.

Key points:

  • Recommend a multi-stage, non-end-to-end pipeline with intermediate detectors.
  • Contrast the high cost/time of collecting image and steering-direction pairs against the ease of obtaining labeled car and pedestrian images.
  • Explain that high availability of data for intermediate modules favors a multi-stage approach.

Rubric: The student should identify the multi-stage pipeline (with intermediate detectors) as the better choice, noting that image-steering pairs are expensive/time-consuming to collect whereas labeled car/pedestrian images are easy to obtain.

0

1

Updated 2026-05-26

Contributors are:

Who are from:

Tags

Machine Learning

Deep Learning

Supervised Learning

Dive into Deep Learning @ D2L

Data Science

Machine Learning Strategy

Related