At what point can a neural network be considered trained?

At what point can a neural network be considered trained?

Neural Networks Explained - Machine Learning Tutorial for Beginners

Previous questionDoes the American population use any other smartphones besides the iphone?
Next questionIs it true that the solar system rotates in a spiral? How this video tells https://www.youtube.com/watch?v=SdtY4-TJNiQ

answers (2)

Answer 1
August, 2021

There are different ways of teaching non-networks. Most often, networks are trained on a fixed dataset that is predefined, for example, in problems of text or image classification.

Some networks can learn from a dynamically generated set of training examples that are updated depending on the current state of the network, for example, networks are trained to play games (for example, Atari games). The network is constantly improving its strategy by playing the same game, and new tutorials are generated as you progress through it.

And there are networks that are trained on the outputs of other networks, and thus can continuously train each other. For example, some image generation methods work this way. Also the well-known algorithm AlphaGo Zero is trained according to this scheme.

But all these different methods have something in common.

  1. The loss function is a function that allows the network to calculate how well or poorly it responds to a specific training example. This function is used to update the model weights at each step. The weights are updated in such a way as to reduce the loss function.

  2. The learning process - the way the network will receive new data for training is fixed and determined by the initial parameters and state of the network.

When the moment comes when the loss function reaches its minimum, convergence occurs, the network stops learning and changing its state, the set of training examples also stops changing significantly. Then we can assume that the network has been trained and, for the given initial parameters, it is no longer possible to train it better.

It also happens that the loss function continues to fall on the training set, but on the test set it has reached a minimum (overfitting effect). Then they also think that the network is trained and it is necessary to stop training, but this indicates that the architecture of the network is not suitable for the task, or insufficient regularization is chosen.

https://i.stack.imgur.com/SVYbE.png
Answer 2
August, 2021

In order to answer this question, we must first discuss the problem of assessing the quality of the neural network. Depending on the task, we can evaluate the accuracy of the result in different ways. In addition, the accuracy requirements can also vary.
In practice, different quantitative estimates are usually used to select the best network. During the learning process, these assessments are constantly monitored, and a conclusion is made about whether it is worth continuing learning. Learning can be stopped for two reasons. Either the network has trained to acceptable indicators and the quality of its work suits us, or its indicators stop improving. In the first case, we consider the network trained. In the second case, you need to think about changing the parameters of the network or the learning process.

Related question

Can a story written by a neural network be considered a literary work?

Read more

Can a person be a neural network?

Read more

Can one neural network write and train another?

Read more

Neural Network In 5 Minutes | What Is A Neural Network? | How Neural Networks Work | Simplilearn

How are neural networks trained?

Read more

Can I create my own neural network and train it myself? If so, how?

Read more

Can a neural network learn bad things?

Read more

How can neural networks be applied in banking?

Read more

How to become a neural network specialist? Where to begin? Where can I find courses?

Read more

How a Neural Network Learns explained

Where and how are neural networks used? Where and how can you learn to use them at a basic level?

Read more

What is a neural network? And how does it work?

Read more

The neural network was taught to create photographs of people. How soon can we expect the appearance of a neural network that creates songs in a certain genre?

Read more

Is there a neural network translator?

Read more

What are the advantages of biocomputers and artificial neural networks?

Read more

Training Neural Networks: Crash Course AI #4

How to make a neural network out of bots?

Read more

What is known about a neural network that can tell everything about an applicant from just one photo?

Read more

Explain in simple terms, what is a neural network? Marketing ploy?

Read more

The US has created a drone that will be controlled by a neural network. How is this possible?

Read more

How to explain to a 5-year-old child what a neural network is?

Read more

Training a Neural Network explained

Will programmers cease to be in demand in the future with the development of neural networks / AI?

Read more

What's the difference between artificial intelligence, machine learning, and neural networks?

Read more