Comment by kylebenzle 3 days ago
Nothing, it means nothing, like most of this "AI" hype nonsense.
They copy paste text transcripts into an Llm and have it generate more text based on its training and prompt data. You can't "chat" with a text document of course.
Ahh ok.
So rather than watch the video or read the transcript you just ask the one thing you want to know.
Could it take you to the moment in the video that is useful too?
You could ask it for a couple of verbatim sentences from the transcript that are most related to what you are interested in, then find the timestamp for that text. (There could be UI for this.)
Another solution would be to skip the LLM prompting part altogether and
1. break the transcript into short sections
2. create embeddings from them and remember the timestamps for each
3. embed your query (what are you interested in)
4. calculate the closest embedding in the transcript to your query
5. return the original timestamp
That's a good idea. However, I believe the challenging part lies in first reconstructing the short utterances into coherent, meaningful paragraphs.
Currently, with the API [1], you can retrieve a JSON with timestamps. The main issue, though, is how to parse the text effectively into meaningful sentences, and then add the timestamps at the beginning of the paragraph. WIP.
[1]: https://textube.olivares.cl/watch?v=9iqn1HhFJ6c&format=JSON
I’m not sure I follow. Can you explain ‘you can’t chat with a text document’ because you clearly can.
Is anyone even chomping at the bit to hear a pedant explain how "chatting with a text document" isn't the most precise way to phrase this concept that we all understand?
Chat with the document means chat about that document with an LLM who has “read” it.
It can be useful; it's not hype nonsense.