I think the first and most important part is the context. In ChatGPT I need to feed in the context every time. An AI agent sitting in my spreadsheet already has access to all my sheets and workbooks. Therefore it can help me with the task right then and there.
Similarly, an AI on a writing platform such as Overleaf can suggest better sentences because it already has the context of the entire essay.
The second important part is actions. ChatGPT can output a table, but an AI agent in my spreadsheet app can directly make changes to the tables. Similarly, the AI agent can summarize an online meeting, and email / slack the team members their respective tasks as discussed.
I am building llmpad.com yeah you can think of it as a GPT wrapper I think differently. I started building it 18 months ago, actually because I wanted to customise the system prompt and keep my data. Then I wanted to use other AI's Anthropic, Groq etc. Then I wanted to generate images. Then I wanted to work with tools for search, or UI cards. Then I wanted to work with realtime audio api's. Then I wanted to create react components kinda like V0. this week I wanted to work on tasks, that run and chain scheduled prompts, its turning into a little agent. All the time using one UI that looks the same, is tweaked to my liking and has some nice power user features like Shift Arrow on input for history, switching models etc.
I am also sure tomorrow there will be another new thing.
I think of a little like Notepad++ for llm's instead of just Notepad.
I use it hourly, in the morning I have a summery of HN from overnight along with news, and reminders.
I host it on Digital Ocean, it uses about 15-20 API's from AI companies but also web search, document and kv stores etc.
Interested in trying it let me know.
For one thing I like agents that live inside my IDE and can directly make patches that affect various files. If it is patching things and then I tell it "I still see a squggle on line 75" I feel like I am collaborating with it. If I am having to cut and paste code out of Copilot and then fix up the imports and then I have to tell it the code is wrong I feel stupid.