What is a neural network?

By Tejas V.

If you have heard the term ‘Deep Learning’, you would also come across ‘Neural Network’. Woah sounds ominous. In this blog post, let’s unpack the term ‘Neural Network’ and take a peek inside the closet. Is it really a monster hiding inside? Or a harmless cat?

The term ‘neural network’ comes from the human brain. The human brain contains billions of neurons which pass signals. A huge network of these neurons passing signals is called a neural network.

The neurons used in deep learning are inspired by the human brain. You can consider them to be a simple form of the same concept.

As an example consider the below table

X. Y.

1 3

2 6

3 9

Here Y = 3X represents the function or relationship between the input X and output Y. In deep learning, neural networks attempt to do the same thing.

In this figure, we see how a single neuron acts as a function between inputs and outputs. In deep learning, we create a network of these neurons all working together to do the same. This increases the capability of the neural network to learn more complex relationships.

When it comes down to the fundamentals, neural network predictions are just maths, not magic. So let’s walk through a simple prediction. Some concepts are simplified for understanding.

The input to a neural network is a vector. A vector is just a series of numerical inputs. Therefore any data (such as text, images, audio etc) you want the neural network to process must first be converted to numerical vector form before the neural network can process it.

Let’s say the input is [x1, x2, x3….]

Each layer in the neural network has a weight matrix associated with it. [w1, w2, w3…..]

As the input passes through each layer, it is multiplied with the respective weight matrix and in the process it is transformed into something different.

After all the layers are processed in this way, we are left with the output vector [y1, y2, y3…..]

This is the output of the neural network.

If the task is to predict whether the input image is a cat or a dog, the output vector could look like this,

[ycat, ydog]

[1, 0] is a cat

[0, 1] is a dog

We saw how neural networks make predictions, but how do they learn the weights for each layer in the first place?

Neural networks learn their weights using a process called ‘Training’.

Training happens when we feed a lot of data where the inputs and outputs are known, also called ‘Training Data’.

A Neural network is an advanced algorithm which is capable of learning complex relationships in the data and make accurate predictions. I like to compare them with ‘Play Doh’. A clay which children play with which can be moulded and stretched to be anything you want them to be.

Related posts:

The blurring of the separation between “church and state” has been the stock and trade of the religious right for a very long time. Certainly, there have been both Republicans (former Sen. John…

In 2015 the United Nation created 17 core sustainable development goals (SDGs) to create a visible roadmap of issues that need to be addressed for the long-term prosperity of people and planet. While…

Is a protocol that lets users on client computers access files on a network. So basically lets companies and users share files over a network. Ok now we know NFS (somewhat). Lets exploit it.