Man versus Machine: Can AI do Science?

Over the last few decades, machine learning has revolutionised many sectors of society, with machines learning to drive cars, identify tumors and play chess - often surpassing their human counterparts. Now, a team of scientists based at the Okinawa Institute of Science and Technology Graduate University (OIST), the University of Munich and the CNRS at the University of Bordeaux have shown that machines can also beat theoretical physicists at their own game, solving complex problems just as accurately as scientists, but considerably faster.

In the study, recently published in Physical Review B, a machine learned to identify unusual magnetic phases in a model of pyrochlore - a naturally-occurring mineral with a tetrahedral lattice structure. Remarkably, when using the machine, solving the problem took only a few weeks, whereas previously the OIST scientists needed six years.

"This feels like a really significant step," said Professor Nic Shannon, who leads the Theory of Quantum Matter (TQM) Unit at OIST. "Computers are now able to carry out science in a very meaningful way and tackle problems that have long frustrated scientists."

The Source of Frustration

In all magnets, every atom is associated with a tiny magnetic moment - also known as "spin." In conventional magnets, like the ones that stick to fridges, all the spins are ordered so that they point in the same direction, resulting in a strong magnetic field. This order is like the way atoms order in a solid material.

But just as matter can exist in different phases - solid, liquid and gas - so too can magnetic substances. The TQM unit is interested in more unusual magnetic phases called "spin liquids", which could have uses in quantum computation. In spin liquids, there are competing, or "frustrated" interactions between the spins, so instead of ordering, the spins continuously fluctuate in direction - similar to the disorder seen in liquid phases of matter.

Previously, the TQM unit set out to establish which different types of spin liquid could exist in frustrated pyrochlore magnets. They constructed a phase diagram, which showed how different phases could occur when the spins interacted in different ways as the temperature changed, with their findings published in Physical Review X in 2017.

But piecing together the phase diagram and identifying the rules governing the interactions between spins in each phase was an arduous process.

"These magnets are quite literally frustrating," joked Prof. Shannon. "Even the simplest model on a pyrochlore lattice took our team years to solve."

Enter the machines

With increasing advances in machine learning, the TQM unit were curious as to whether machines could solve such a complex problem.

"To be honest, I was fairly sure that the machine would fail," said Prof. Shannon. "This is the first time I've been shocked by a result - I've been surprised, I've been happy, but never shocked."

The OIST scientists teamed up with machine learning experts from the University of Munich, led by Professor Lode Pollet, who had developed a "tensorial kernel" - a way of representing spin configurations in a computer. The scientists used the tensorial kernel to equip a "support vector machine", which is able to categorize complex data into different groups.

"The advantage of this type of machine is that unlike other support vector machines, it doesn't require any prior training and it isn't a black box - the results can be interpreted. The data are not only classified into groups; you can also interrogate the machine to see how it made its final decision and learn about the distinct properties of each group," said Dr Ludovic Jaubert, a CNRS researcher at the University of Bordeaux.

The Munich scientists fed the machine a quarter of a million spin configurations generated by the OIST supercomputer simulations of the pyrochlore model. Without any information about which phases were present, the machine successfully managed to reproduce an identical version of the phase diagram.

Importantly, when the scientists deciphered the "decision function" which the machine had constructed to classify different types of spin liquid, they found that the computer had also independently figured out the exact mathematical equations that exemplified each phase - with the whole process taking a matter of weeks.

"Most of this time was human time, so further speed ups are still possible," said Prof. Pollet. "Based on what we now know, the machine could solve the problem in a day."

"We are thrilled by the success of the machine, which could have huge implications for theoretical physics," added Prof. Shannon. "The next step will be to give the machine an even more difficult problem, that humans haven't managed to solve yet, and see whether the machine can do better."

Jonas Greitemann, Ke Liu (刘科 子竞), Ludovic DC Jaubert, Han Yan (闫寒), Nic Shannon, Lode Pollet.
Identification of emergent constraints and hidden order in frustrated magnets using tensorial kernel methods of machine learning.
Phys. Rev. B 100, November 2019. doi: 10.1103/PhysRevB.100.174408.

Most Popular Now

Unlocking the 10 Year Health Plan

The government's plan for the NHS is a huge document. Jane Stephenson, chief executive of SPARK TSL, argues the key to unlocking its digital ambitions is to consider what it...

Alcidion Grows Top Talent in the UK, wit…

Alcidion has today announced the addition of three new appointments to their UK-based team, with one internal promotion and two external recruits. Dr Paul Deffley has been announced as the...

AI can Find Cancer Pathologists Miss

Men assessed as healthy after a pathologist analyses their tissue sample may still have an early form of prostate cancer. Using AI, researchers at Uppsala University have been able to...

New Training Year Starts at Siemens Heal…

In September, 197 school graduates will start their vocational training or dual studies in Germany at Siemens Healthineers. 117 apprentices and 80 dual students will begin their careers at Siemens...

AI, Full Automation could Expand Artific…

Automated insulin delivery (AID) systems such as the UVA Health-developed artificial pancreas could help more type 1 diabetes patients if the devices become fully automated, according to a new review...

How AI could Speed the Development of RN…

Using artificial intelligence (AI), MIT researchers have come up with a new way to design nanoparticles that can more efficiently deliver RNA vaccines and other types of RNA therapies. After training...

MIT Researchers Use Generative AI to Des…

With help from artificial intelligence, MIT researchers have designed novel antibiotics that can combat two hard-to-treat infections: drug-resistant Neisseria gonorrhoeae and multi-drug-resistant Staphylococcus aureus (MRSA). Using generative AI algorithms, the research...

AI Hybrid Strategy Improves Mammogram In…

A hybrid reading strategy for screening mammography, developed by Dutch researchers and deployed retrospectively to more than 40,000 exams, reduced radiologist workload by 38% without changing recall or cancer detection...

Penn Developed AI Tools and Datasets Hel…

Doctors treating kidney disease have long depended on trial-and-error to find the best therapies for individual patients. Now, new artificial intelligence (AI) tools developed by researchers in the Perelman School...

Are You Eligible for a Clinical Trial? C…

A new study in the academic journal Machine Learning: Health discovers that ChatGPT can accelerate patient screening for clinical trials, showing promise in reducing delays and improving trial success rates. Researchers...

Global Study Reveals How Patients View M…

How physicians feel about artificial intelligence (AI) in medicine has been studied many times. But what do patients think? A team led by researchers at the Technical University of Munich...

New AI Tool Addresses Accuracy and Fairn…

A team of researchers at the Icahn School of Medicine at Mount Sinai has developed a new method to identify and reduce biases in datasets used to train machine-learning algorithms...