I tested it with two videos, the first one it does the summary quite well: https://youtu.be/Cy-NgpRN1FU, I love how it mentions the dogs name is Ernie, that made me smile :)
But in the second video https://www.youtube.com/watch?v=NBFyvOV7fz8 the app keeps mentioning things like: "The text discusses...", but the content is not a text, it's a video.
Really cool app, it's really quick too!
Pretty nice! Very useful idea, especially for videos on my watchlist I never get to because I feel they're too long.
Would love if I could ask follow up questions. Would be awesome to ask "Is X also explained?" and get a little summary back with the timestamp so I can jump to that point in the video.
Also it feels a bit slow and doesn't really give feedback whether it's making progress. That would be a good UX improvement.
How many tokens do you allow per session? I've been thinking about creating a similar app, but I'm a little bit concerned about the unintended costs.
Awesome work! I used it to summarize an hour long podcast I had been meaning to watch and it worked fabulously. What's amazing is that the transcript is auto-generated and of a conversation between two individuals without any indication of who's actually speaking. Yet GPT-3.5 is able to make sense of it.
Out of curiosity I downloaded the transcript myself with `youtube_transcript_api --format text` and counted the tokens via ttok [0], it was a tad over 16k. So what does your site do in that case? Is the transcript truncated?
Two videos that give a 500 internal server error in the Network tab and an infinite spinner:
https://www.youtube.com/watch?v=GuiTN4tOBr4 (edit: this has no captions so maybe it's expected, but a proper error would be better)
https://www.youtube.com/watch?v=iShzzAK9zxk (edit: this may be because I marked the subtitles as UK English)
Not bad - fed in one of my videos and it’s surprisingly readable. Are you using a particular prompt? Would you be willing to share it?
Seems to be an arms race between youtube forcing creators to make videos 8 mins long min to be able to get mid roll ads and people coming up with ways to summarize the transcript.
Idea for the future: Use the summarize to re-cut the videos to the most important parts. Like a super to the point tiktok style video that is nothing but dopamine being injected into your veins. There seems to already be "auto podcast clipper ai agents" out there but nothing for consumers to use. those are more video editor adjacent. If anyone wants to work on something like this, lemme know.
Plugged in this meme video and it gave me the "As a AI I can't...": https://www.youtube.com/watch?v=NlZzftmtGJY
Are you using celery for your async workers? Cool project!
It hang on non - english video. I tried this one: https://youtu.be/B4kRwlHTcLM?si=3kp3pvQ4M4l6eRTT Otherwise, brilliant
Interesting, very cool!
However, how does it do on videos where there's not a lot of speaking? Any plans to do actual video (image) processing?
It's hanging for everything I try.
I suggest a progress bar rather than a spinny thingy. Give the user some sense that a conclusion is on the horizon.
From my own experiments, I think you'll get better summaries with a prompt like "This is a transcription of a youtube video. Please etc etc etc". Context seems to help.
I tried to do something similar, but I could only get transcripts for videos with transcript files attached, which isnt a huge number of videos. How did you get around this?
Is GPT-4 performance better enough paying would be worth it?
Edit: Thank you!
Looks great, it gave a quick response. Are you putting the whole transcript in context? Have you encountered issues with transcripts that are too large?
Giving it either a long (2.5hr) video, or a non-youtube URL (e.g. an invidious link) appears to leave it spinning forever - no error message.
This tool finally makes Thunderf00t videos watchable, I mean readable, without wasting 30 minutes. Thanks.
It should always append the message "This could have been a blog post" to everything it summarizes.
Would be nice to add a textarea to give it more specific instructions or to change the summarization prompt.
Also try www.askYouTube.ai for q&a across multiple videos!
Nice!
For those interested in comparing, https://www.summarize.tech/ also builds summaries from YouTube videos but includes an overview, then a summary of each 5 min segment
Totally missed what this was supposed to do and tried to get a summary of a video discussing some music with captions. Got back garbage. Thought it might process the text from the frames. Shrug. Good idea for the use case you intended tho!
The off centre spinning wheel bothers me too much.
That's so evil. Please correct the alignment!
Just used this to clear out my watch later list without having to watch anything. Nice!
Only note I have at this time is that it seemed to time out or hang or something on a long video (>2h) -- I'm guessing that there might be limitations to how much transcript you can chuck into GPT, it might be worth throwing an error of some sort in that scenario rather than the forever load
E: Seen you've asked for an example to the other person mentioning this. In my case it was this video https://www.youtube.com/watch?v=hFL6qRIJZ_Y