Learn Before
Trade-offs of High-Level APIs in Deep Learning
High-level APIs in deep learning frameworks offer significant convenience by abstracting complex and potentially unstable operations, such as numerical stability, and allowing users to implement models concisely. This abstraction dramatically increases accessibility, enabling individuals without advanced statistical training to utilize deep learning. However, relying solely on high-level APIs presents drawbacks: it discourages the creation of custom, non-standard components and leaves practitioners unequipped to debug edge cases when the framework's abstractions fail. To invent novel architectures that frameworks do not natively support, deep learning practitioners must understand both the fundamental, from-scratch implementations and the concise, framework-based versions.
0
1
Tags
D2L
Dive into Deep Learning @ D2L
Related
Criterion for Choosing a Deep Learning Framework
Deep Learning Frameworks References
Keras
TensorFlow
PyTorch
Theano
PaddlePaddle
mxnet
Lasagne
DL4J
CNTK
Caffe
PyTorch vs TensorFlow
Trade-offs of High-Level APIs in Deep Learning
Productivity Gains in Deep Learning Implementation
DistBelief
Symbolic Programming
Comparison of Imperative and Symbolic Programming
Frontend and Backend in Deep Learning Frameworks