Skip to main content

Machine learning needs stimulus for making solutions.

 Machine learning needs stimulus for making solutions. 




"A barren plateau is a trainability problem that occurs in machine learning optimization algorithms when the problem-solving space turns flat as the algorithm is run. Researchers at Los Alamos National Laboratory have developed theorems to prove that any given algorithm will avoid a barren plateau as it scales up to run on a quantum computer." (https://www.lanl.gov/discover/news-release-archive/2021/March/0319-barren-plateaus.php)

Have you heard of a "barren plateaus" problem? The name of that problem is coming from the J.R.R Tolkien book. Wherein the fictive Middle land is the very dry and hot place. The image, above this text, introduces the "barren plateaus" problem very well. 

In the next example, the food and water are the information. If a creature lives in the "fresh plateaus" it can take nutrients from nature. There is a bigger chance to make mistakes. But the nutrient is versatile and finding and testing new things makes the creature in the work. When a creature searches for things from nature there are many possibilities to test which type of vegetables or other nutrient sources the creature uses. Of course, that thing requires sometimes rise to the mountains. 

In that image, the problem is the mountain. The thing is that if the creature lives on the landscape at the higher image. That creature has stimulus. The green landscape offers motivation and the grass is the food and the creature wants to go to the mountain. The grass and water are everywhere and the creature has the motivation to rise to the mountain. And that could be willing to see the farter places. Or maybe the creature wants to get fresh air. 

The lower image introduces the situation. Where the creature lives in the "barren plateau". The water and food are in a pocket or bag and of course, the creature never makes mistakes if that creature wants to get a certain sandwich. The creature knows which pocket that creature can get sausage sandwich and where is the drinking bottle. But sooner or later, the nutrient would turn unilateral. In barren plateaus problem, the creature will get pre-made food. 

So if we are transferring that model to the information technology the creature will get pre-made solutions that fit in certain situations. And that makes this kind of model very limited. The situation is like that creature lives in the desert or "barren plateaus". The supporter brings water and sandwich to a certain point at a certain time. The food is guaranteed but it's always the same. 

And what the creature gets depends on the supporter. If the supporter wants to give the sausage sandwich that is the food. If someday the supporter wants to give the cheese sandwich that creature will get a cheese sandwich. 

When everything is pre-made the creature doesn't want to try itself to find food. There is difficult to make mistakes if some other person makes the food. The same way is in data science. If all problems are pre-solved that thing means that it's very hard to make wrong solutions. 

The term "flatten landscape" means that when the creature is living in "barren plateaus" the limited information sources makes the problems look harder to solve. Because the creature always is at a certain point where the supporter will bring a sandwich and water the creature is not even trying to climb mountains or solve the problem. 


"A barren plateau is a trainability problem that occurs in machine learning optimization algorithms when the problem-solving space turns flat as the algorithm is running".

"In that situation, the algorithm can’t find the downward slope in what appears to be a featureless landscape and there’s no clear path to the energy minimum. Lacking landscape features, machine learning can’t train itself to find the solution". (LosAlamos National laboratories, Solving ‘barren plateaus’ is the key to quantum machine learning)


https://www.lanl.gov/discover/news-release-archive/2021/March/0319-barren-plateaus.php


Image:https://www.lanl.gov/discover/news-release-archive/2021/March/0319-barren-plateaus.php


Comments

Popular posts from this blog

Chinese innovations and space lasers are interesting combinations.

Above: "Tiangong is China's operational space station located in low Earth orbit. (Image credit: Alejomiranda via Getty Images)" (Scpace.com, China's space station, Tiangong: A complete guide) Chinese are close to making nuclear-powered spacecraft.  Almost every day, we can read about Chinese technical advances. So are, the Chinese more innovative than Western people? Or is there some kind of difference in culture and morale between Western and Chinese societies? The Chinese superiority in hypersonic technology is one of the things that tells something about the Chinese way of making things.  In China, the mission means. And the only thing that means is mission. That means that things like budgets and safety orders are far different from Western standards. If some project serves the Chinese communist party and PLA (People's Liberation Army) that guarantees unlimited resources for those projects. Chinese authorities must not care about the public opinion.  If we th

Iron Dome is one of the most effective air defense systems.

The Iron Dome is a missile defense system whose missiles operate with highly sophisticated and effective artificial intelligence. The power of this missile defense base is in selective fire. The system calculates the incoming missile's trajectory. And it shoots only missiles that will hit the inhabited area. The system saves missiles and focuses defense on areas that mean something. The system shares the incoming missiles in, maybe two groups. Another is harmless and another is harmful.  Things like killer drones are also problematic because their trajectories are harder to calculate than ballistic missiles. The thing that makes drones dangerous is that they can make masks for ballistic missiles. And even if those drones are slow, all of them must be shot down.  The thing is that the cooperation between drone swarms and ballistic missiles is the next danger in conflict areas. In the film, you can see how drones make light images of the skies. The killer drones can also carry LED li

The innovative shield that protects OSIRIS-APEX can also protect the new hypersonic aircraft.

"NASA’s OSIRIS-APEX spacecraft successfully completed its closest solar pass, protected by innovative engineering solutions and showing improvements in onboard instruments. Credit: NASA’s Goddard Space Flight Center/CI Lab" (ScitechDaily, Innovative Engineering Shields NASA’s OSIRIS-APEX During Close Encounter With the Sun) The OSIRIS-APEX probe travels close to the sun. The mission plan is to research the sun. And especially find things that can warn about solar storms. Solar storms are things that can danger satellites at the Earth orbiter. And the purpose of OSIRIS-APEX is to find the method of how to predict those solar storms. Another thing is that the OSIRIS-APEX tests the systems and materials that protect this probe against heat and plasma impacts.  The same technology. The researchers created for OSIRIS-APEX can used in the materials and structures. That protects satellites against nuclear explosions. That means this kind of system delivers information on how to prot