Neural Networks, Actually Explained

You have heard the term a thousand times. Now let's actually look inside: neurons, weights, activations, and what happens in a single pass.

35 min · Reviewed 2026

The Artificial Neuron

A neural network is built out of tiny units called neurons. Each neuron is simple. It takes in a few numbers, multiplies each by a weight, adds them up, and runs the total through a simple squishing function. That is it.

One neuron, step by step

Receive inputs: x1, x2, x3
Multiply by weights: w1·x1 + w2·x2 + w3·x3
Add a bias number: total + b
Pass through an activation function like ReLU or sigmoid
Send the result to the next neuron

Stacking into layers

A layer is many neurons working at the same time, each with its own weights. Stack many layers in a row and you have a deep neural network. The output of one layer becomes the input to the next.

# A tiny feed-forward network in pseudo-code h1 = relu(W1 @ x + b1) h2 = relu(W2 @ h1 + b2) output = softmax(W3 @ h2 + b3)Three layers: input → hidden → hidden → output. @ means matrix multiplication.

What gets learned

The weights W and biases b in every layer
Nothing else — the structure stays fixed during training
A modern LLM has hundreds of billions of these numbers

Why deep beats shallow

Early layers pick up simple features like edges in images or letter patterns in text. Middle layers combine those into shapes or word parts. Late layers pull it all together into concepts like dog or sarcasm. Depth lets the model build up abstractions.

The network's layers are a ladder from pixels to meaning.
— Yoshua Bengio, paraphrased

The big idea: a neural network is a huge stack of very simple math units, wired together in layers. Depth and scale turn that simplicity into something that can translate languages and write poetry.

End-of-lesson check

8 questions · take it digitally for instant feedback at tendril.neural-forge.io/learn/quiz/end-builders-neural-networks-explained

What is the main idea of "Neural Networks, Actually Explained"?
1. You have heard the term a thousand times. Now let's actually look inside: neurons, weights, activations, and what happens in a single pass.
2. Use AI as the final authority for the whole decision
3. Avoid checking the answer once it sounds polished
4. Focus only on speed instead of judgment
Which concept is most central to "Neural Networks, Actually Explained"?
1. neurons
2. neural network
3. weights
4. activation
Which use of AI fits this topic best?
1. Let the AI decide what matters without your review
2. Use the answer before checking whether it fits the situation
3. Receive inputs: x1, x2, x3
4. Use the first answer without checking it
What should a careful learner remember about "Activation functions"?
1. Use AI to draft or organize ideas about neural network, then verify before acting.
2. Skip the context so the tool can guess faster
3. Treat the output as private even after sharing it online
4. Use the answer without checking the source
You want to use AI after this lesson. What is the safest next step?
1. Act immediately because the AI answer is written clearly
2. Use the AI answer as a draft, then check it against a reliable source.
3. Hide uncertainty so the final answer looks cleaner
4. Use private or sensitive details before checking permission
How should AI output about neural network be treated?
1. As proof that no other source is needed
2. As a replacement for context, consent, or expert review
3. As a draft or helper output that still needs human judgment and verification
4. As something that becomes correct when it sounds confident
Name one way to verify an AI answer about neural network.
Which action would help you apply "Neural Networks, Actually Explained" responsibly?
1. Use the tool to avoid thinking through the tradeoff
2. Keep going even if the output conflicts with a trusted source
3. Use the first answer without checking it
4. Multiply by weights: w1·x1 + w2·x2 + w3·x3

← Back to interactive lesson

Tendril · Builders · AI Foundations

Neural Networks, Actually Explained

You have heard the term a thousand times. Now let's actually look inside: neurons, weights, activations, and what happens in a single pass.

35 min · Reviewed 2026

The Artificial Neuron

One neuron, step by step

Receive inputs: x1, x2, x3
Multiply by weights: w1·x1 + w2·x2 + w3·x3
Add a bias number: total + b
Pass through an activation function like ReLU or sigmoid
Send the result to the next neuron

Stacking into layers

A layer is many neurons working at the same time, each with its own weights. Stack many layers in a row and you have a deep neural network. The output of one layer becomes the input to the next.

# A tiny feed-forward network in pseudo-code h1 = relu(W1 @ x + b1) h2 = relu(W2 @ h1 + b2) output = softmax(W3 @ h2 + b3)Three layers: input → hidden → hidden → output. @ means matrix multiplication.

What gets learned

The weights W and biases b in every layer
Nothing else — the structure stays fixed during training
A modern LLM has hundreds of billions of these numbers

Why deep beats shallow

The network's layers are a ladder from pixels to meaning.
— Yoshua Bengio, paraphrased

The big idea: a neural network is a huge stack of very simple math units, wired together in layers. Depth and scale turn that simplicity into something that can translate languages and write poetry.

End-of-lesson check

8 questions · take it digitally for instant feedback at tendril.neural-forge.io/learn/quiz/end-builders-neural-networks-explained

What is the main idea of "Neural Networks, Actually Explained"?
1. You have heard the term a thousand times. Now let's actually look inside: neurons, weights, activations, and what happens in a single pass.
2. Use AI as the final authority for the whole decision
3. Avoid checking the answer once it sounds polished
4. Focus only on speed instead of judgment
Which concept is most central to "Neural Networks, Actually Explained"?
1. neurons
2. neural network
3. weights
4. activation
Which use of AI fits this topic best?
1. Let the AI decide what matters without your review
2. Use the answer before checking whether it fits the situation
3. Receive inputs: x1, x2, x3
4. Use the first answer without checking it
What should a careful learner remember about "Activation functions"?
1. Use AI to draft or organize ideas about neural network, then verify before acting.
2. Skip the context so the tool can guess faster
3. Treat the output as private even after sharing it online
4. Use the answer without checking the source
You want to use AI after this lesson. What is the safest next step?
1. Act immediately because the AI answer is written clearly
2. Use the AI answer as a draft, then check it against a reliable source.
3. Hide uncertainty so the final answer looks cleaner
4. Use private or sensitive details before checking permission
How should AI output about neural network be treated?
1. As proof that no other source is needed
2. As a replacement for context, consent, or expert review
3. As a draft or helper output that still needs human judgment and verification
4. As something that becomes correct when it sounds confident
Name one way to verify an AI answer about neural network.
Which action would help you apply "Neural Networks, Actually Explained" responsibly?
1. Use the tool to avoid thinking through the tradeoff
2. Keep going even if the output conflicts with a trusted source
3. Use the first answer without checking it
4. Multiply by weights: w1·x1 + w2·x2 + w3·x3

← Back to interactive lesson