Share this article

Latest news

With KB5043178 to Release Preview Channel, Microsoft advises Windows 11 users to plug in when the battery is low

Copilot in Outlook will generate personalized themes for you to customize the app

Microsoft will raise the price of its 365 Suite to include AI capabilities

Death Stranding Director’s Cut is now Xbox X|S at a huge discount

Outlook will let users create custom account icons so they can tell their accounts apart easier

Chinese want to develop scientific AI bots infused with prior knowledge

AI doesn’t know anything about physics right now

3 min. read

Published onMarch 14, 2024

published onMarch 14, 2024

Share this article

Read our disclosure page to find out how can you help Windows Report sustain the editorial teamRead more

Creating scientific AI bots is nothing new. Many researchers worldwide have programmed their own science AI bots to resolve specific tasks in chemistry, biology, physics, and more. However, anew studypublished in the Hong Kong Polytechnic University journal delivers another approach to creating such bots by infusing them with prior knowledge in the areas where they are needed.

In other words, the Chinese will train the LLMs to becomeAI scientistsin their field of expertise by teaching them some advanced rules, just instructing students before giving them tasks.

AI bots don’t know anything about physics, yet

AI bots don’t know anything about physics, yet

Although we got used to the fast-paced development of AI, we still feel amazed by howSora AIcan create elaborate video clips just from text input. Yet, the text-to-video LLM doesn’t have the slightest idea about the laws of physics. It doesn’t know how to extract a piece of cookie from the image after someone bites it or the direction in which the flames of candles should lean when someone blows at them in a clip.

LLMs are traditionally trained using localized data and inputs and don’t start from ground rules in mathematics or physics. Copilot doesn’t even know how to count some objects in a generated image. We gave it hundreds of tests to generate a fixed number of a particular object, and the bot failed at determining the number of items. However, it will respond flawlessly if you ask it to solve a simple math equation.

The Chinese scientists believe that the AI bots will deliver more accurate results by creating aninformed machine learningmodel through base knowledge training. However, they admit it takes work to establish which functional relationships, equations, and logic to include in the training. They found out that inserting too many rules would crash the LLM.

Embedding human knowledge into AI models has the potential to improve their efficiency and ability to make inferences. Still, the question is how to balance the influence of data and knowledge. Our framework can be employed to evaluate different expertise and rules to enhance the predictive capability of deep learning models.

According to the paper, the Chinese created a framework that assesses rule importance by examining how certain rules or combinations affect the predictive accuracy of the LLM.

The researchers tested their framework to predict a chemistry experiment’s results and optimize a model for solving multivariate equations, and the output was a success.

However, there is an inherent problem with this type of training. During the study, the scientists discovered that if they added more data to the model, the general rules they applied became more important than the local rules. This is an issue because biology and chemistry often don’t havereadily available general rules akin to governing equations.

The scientists are creating an open source plugin tool for developers to advance this training model further.

More about the topics:AI

Claudiu Andone

Windows Toubleshooting Expert

Oldtimer in the tech and science press, Claudiu is focused on whatever comes new from Microsoft.

His abrupt interest in computers started when he saw the first Home Computer as a kid. However, his passion for Windows and everything related became obvious when he became a sys admin in a computer science high school.

With 14 years of experience in writing about everything there is to know about science and technology, Claudiu also likes rock music, chilling in the garden, and Star Wars. May the force be with you, always!

User forum

0 messages

Sort by:LatestOldestMost Votes

Comment*

Name*

Email*

Commenting as.Not you?

Save information for future comments

Comment

Δ

Claudiu Andone

Windows Toubleshooting Expert

Oldtimer in the tech and science press, with 14 years of experience in writing on everything there is to know about science, technology, and Microsoft