Jeremy Howard has been using spreadsheets to teach NNs for years. Instructive and intuitive.
Now instead of "it's just curve fitting" I can tell my friends "it's just a spreadsheet."
Spreadsheet link https://github.com/ianand/spreadsheets-are-all-you-need/rele...
> Aside from the minuscule context length, it also lacks the instruction tuning and reinforcement learning from human feedback (RLHF) that turn a large language model into a chatbot.
Is RLHF even strictly necessary?
Why can't a spreadsheet implement GPT-3 or GPT-4?
An AI company going for investment banks as customers, eh? Pretty smart idea!
Maybe purchase sayn.ai. Saayn.ai is unvailable.
Awesome stuff.
The introduction video on the page is very nice indeed to get a basic idea on the inner working of the Excel sheet.
This is a great project! Just forwarded to 7 people to help them work through LLMs. Kudos.
Classic scenario in legacy finance tech: the hotshot trader or investment banker shakes his fist furiously demanding to be given back his Excel spreadsheets and the entire tech department be fired.
Wow! Impressive. How did they manage to fit GPT-2 in a spreadsheet?
A question for the author: will it be open sourced?
Brilliant idea/URL.
It’s often true though. So many things I think “I could make an app for that” I wind up just using a spreadsheet for. At least it helps me explore the use cases more deeply for when I’d want to actually take it to the next level.
I hung out with a friend while they solved Advent of Code challenges in Excel, that was a trip to watch.
Related to strange things running in spreadsheets, if you want to see how a 16-bit CPU works, Inkbox has created one in a spreadsheet:
* https://github.com/InkboxSoftware/excelCPU
* https://www.youtube.com/watch?v=5rg7xvTJ8SU
A twenty-four instruction assembly language is also provided.
Turns out folks are solving PDEs in excel: https://sie.scholasticahq.com/article/4654-spreadsheet-imple... (i knew about FFTs and special functions , but this looks fun/interesting)
Damn why didn’t I think of that! Well done. And I wonder if in memory spreadsheets are similar to (and as efficient as) Pytorch Tensors anyway!
worked with Ishan back in the day at Moovweb and he is truly a genius and had ideas way ahead of their time when it came to the web!
Could we summarize that spreadsheets are one of the best practical representations (UX/UI wise) and integration tech for databases? From the technological architecture point of view, don't we should separate Spreadsheets = UX/UI + DAG (directed acyclic graph) + Database + Integrations ?
Now we wait for a GPU-accelerated Excel calculation engine to close the loop.
Spreadsheet, tensor... same difference.
I've downloaded the sheet. If I click on Calculate Sheet it doesn't do anything. Is the Sheet working?
Breakout inside Google Calendar, an LLM inside Excel... What's next, a VR environment using Slack?
It is truly amazing!
Funny thing is that excel can do such thing but cannot replace dates within the sheet. For example on Windows in Office 2021 if I want to replace text cell which has value 2023-10-10 with new value 2023-10-11 I have only two options as the result: 10/11/2023 or 45210.
> What about Google Sheets? > This project actually started on Google Sheets but the full 124M model was too big and switched to Excel. I’m still exploring ways to make this work in Google Sheets but it is unlikely to fit into a single file as it can with Excel.
I wonder if it would work in https://rowzero.io/home ?
Any way to try it without an Office 365 subscription?
sentient spreadsheets, i don't think ill be able to sleep now.
Super cool stuff!
The OG deep learning Excel:
Jokes on you, my Excel regularily thinks that two cells are not equal, despite both of them having exactly the same value and type (also no trailing spaces or these things). Copy and pasting it around sometimes solves the problem, but it never is apparent to me why that happens.
Related? I was copy'n'pasting a few chars from one column from to another in gsheets.
Gsheets intuited that I wanted to do this multiple times and offered this formula:
> =RIGHT(A7,LEN(A7) - (FIND(CHAR(160),SUBSTITUTE(A7," ",CHAR(160),2))))
Doesn't work in LibreOffice. Doesn't work with web Excel(too big).
Cool, the modern equivalent of 1-800-i-really-enjoy-carpeting.
Why wasn't that a link to a .xls file from the spreadsheet sharing network (/s)? (in other news, SQL is all you need, sometimes.)
Spreadsheet is the grandfather dataframe
I occasionally need to loan people money, and usually they need to pay me back in multiple payments, sometimes over several months.
Being a proper geek, my first inclination was to build a web app to keep track of that and so the people I am loaning cash to can also view their balance, but I realized that would involve maintaining state and login creds and a bunch of other variables I haven’t even considered, and maintaining this app would become a second, unpaid job.
Then I thought “I could just use a Google sheet and share it”, which is what I ended up doing. It’s easy to set permissions, I don’t have to worry about hosting, I can have it do any amount of arithmetic and light programming that I might need, as well as being automatic and reactive as I add information. It will be slower than something I would write in C obviously, but realistically for something involving budgeting the time savings will be on the order of milliseconds.
I love spreadsheets. They provide a gateway to programming for non-programmers, and they provide a low-effort means of playing with data.
Tried the prompt "Mike is hungry and wants to eat some" and the predicted next token is "body". Is that how bad gpt-2 was?
[dead]
The content on the web page is directly converted into Excel. I enter a Propmt and there is no return value.
Harper Reed said this at an 1871 event after Obama got his second term.
[dead]
[dead]
[flagged]
Creator here. Thanks for posting this! Happy to answer questions or take suggestions and hope it helps folks better understand LLMs.
Next video will be on embeddings and hopefully done soon-ish.