Linearity in Vector Spaces

If you know what happens to basic pieces, then you know what happens to any combination of those pieces, because the combinations are formed only by scaling and adding. It means complex behavior can be reconstructed from simpler components without distortion of the combination rules. This is why linear systems are tractable. They preserve structure.

Linear example

$$f(x) = 3x$$

Then:

$$f(x + y) = 3(x + y) = 3x + 3y = f(x) + f(y)$$

and

$$f(\alpha x) = 3\alpha x = \alpha \cdot 3x = \alpha f(x).$$

So this is linear.

Nonlinear example

$$f(x) = x^2$$

Then:

$$f(x + y) = (x + y)^2 = x^2 + 2xy + y^2$$

which is not usually $f(x) + f(y)$.

The extra $2xy$ term is the hallmark of nonlinearity here. The combination produces interaction terms not already present in the original pieces.

That is a good intuitive marker: nonlinearity introduces new interactions between parts.

Links to this note:
Vector Space