Share this article

With KB5043178 to Release Preview Channel, Microsoft advises Windows 11 users to plug in when the battery is low

Copilot in Outlook will generate personalized themes for you to customize the app

Microsoft will raise the price of its 365 Suite to include AI capabilities

Death Stranding Director’s Cut is now Xbox X|S at a huge discount

Outlook will let users create custom account icons so they can tell their accounts apart easier

Apparently, spreadsheets are all you need to understand how a LLM works

GPT-2 Small was embedded in an Excel spreadsheet

2 min. read

Published onMarch 18, 2024

published onMarch 18, 2024

Share this article

Read our disclosure page to find out how can you help Windows Report sustain the editorial teamRead more

We all use LLM right now, whether is ChatGPT, Gemini, or the newestGrok-1 released as open source. But do you know how they work to provide you with an answer?

Ishan Anand, a software developer who also admits he’s passionate about spreadsheets, conducted an experiment to explain the mechanism behind LLMs that everyone can understand.

He embedded a small version of GPT-2 into an Excel spreadsheet and tracked its algorithm on how it answers a simple question.

How does ChatGPT 2.0 work in Excel?

First, you must understand that GPT -2 was released in 2019, and it has not been possible to converse. The first conversational AI bot came in 2022 with GPT-3.

While it was all over in the media headlines, GPT-2 could only use 1,5 billion parameters while GPT-3 extended that figure to 175 billion parameters.

Open AI didn’t release it as a conversational bot simply because it had limited input tokens. Ishan Anand’s GPT-2 in Excel can only handle 10 tokens of input which is a tiny amount for any possible query.

However, in his experiment, he tested the LLM to complete the sentenceMike is quick. He moves… If you watch the video above, you will see exactly how GPT-2 used the spreadsheet to come with the deduction that the missing word wasquickly.

The point of the developer was to make us believe that if we understand Excel spreadsheets, we can also understand how a LLM works. If you want to experiment yourself, you can grab the spreadsheet from theGitHub page. You can also read more about it onTom’s hardware.

Did you understand the explanation in the video? Let’s discuss in the comments section below.

More about the topics:AI,ChatGPT,Microsoft Excel

Claudiu Andone

Windows Toubleshooting Expert

Oldtimer in the tech and science press, Claudiu is focused on whatever comes new from Microsoft.

His abrupt interest in computers started when he saw the first Home Computer as a kid. However, his passion for Windows and everything related became obvious when he became a sys admin in a computer science high school.

With 14 years of experience in writing about everything there is to know about science and technology, Claudiu also likes rock music, chilling in the garden, and Star Wars. May the force be with you, always!

User forum

0 messages

Sort by:LatestOldestMost Votes

Comment*

Name*

Email*

Commenting as.Not you?

Save information for future comments

Comment

Claudiu Andone

Windows Toubleshooting Expert

Oldtimer in the tech and science press, with 14 years of experience in writing on everything there is to know about science, technology, and Microsoft

With KB5043178 to Release Preview Channel, Microsoft advises Windows 11 users to plug in when the battery is low#

Copilot in Outlook will generate personalized themes for you to customize the app#

Microsoft will raise the price of its 365 Suite to include AI capabilities#

Death Stranding Director’s Cut is now Xbox X|S at a huge discount#

Outlook will let users create custom account icons so they can tell their accounts apart easier#

Apparently, spreadsheets are all you need to understand how a LLM works#

How does ChatGPT 2.0 work in Excel?#