Concept

Neural Network Representation

A neural network is typically structured with an input layer, one or more hidden layers, and an output layer. Its design is historically inspired by biological neurons: dendrites are modeled as inputs xix_i, synapses as synaptic weights wiw_i, and the nucleus as an aggregator that computes a weighted sum y=ixiwi+by = \sum_i x_i w_i + b, potentially followed by a nonlinear activation function σ(y)\sigma(y). The resulting signal is then transmitted to the output, analogous to a biological axon. A positive weight reflects an excitatory connection, while a negative value signifies an inhibitory connection.

Image 0

1

5

Updated 2026-05-02

Tags

Data Science

D2L

Dive into Deep Learning @ D2L