context window of hedy, 35 sessions, under topic only 4-5 considered for summary and actionable plan
P
Philipp Schweiger
I have a list of over 35 TED talks, each with summaries and transcripts, mostly from YouTube, all around 15 minutes long. All on desktop app.
Now when I go to the topic and I've given a context like be my growing agent in career etc and provide me actionable insights from the talks for growth, only 4-5 of the talks content are even considered, even after reprocessing the AI summaries etc. the considered sessions stay the same as well as the topic output from AI.
So my question is, how big is the context window of Hedy with local transcripts and such? As from my point of view there should be way more insights from that amount of sessions and a broader variety with all the various topics I've converted.
Julian Pscheid
Hi Philipp Schweiger, thanks for sharing this experience. Due to the context lengths available in our LLM models, we do need to manage how much data is passed in from older sessions. We use a progressive strategy, where newer sessions have more context passed in, and older sessions less context. This really is geared to real-life conversations, where more recent conversations matter more. I can see how it's not ideal for how you are using topics.
We're working on enabling file uploads through a more traditional rag system, and we might be able to leverage that to enable a larger backlog of topic sessions to be searched better.
P
Philipp Schweiger
Julian Pscheid then the possibility to at least get all transcripts of sessions in a topic as markdown or txt or pdf in a sorted manner by session and info like session name etc would be helpful. So one can use these for another AI like notebook LM with broader context window.
Julian Pscheid
Philipp Schweiger Good idea! We'll work on that.
Julian Pscheid
Export feature will be live in next week's update!
P
Philipp Schweiger
Julian Pscheid Cool, thanks. Just wondering if it is much work to enable the possibility to get a markdown or file for each session of the topic. With that it is possible to A upload individual markdowns/session of a topic and B Upload all single session files of a topic that then can be activated or deactivated as context in for example notebook lm when needed or not needed. Things one cannot do with a single markdown file with all sessions of a topic.
Julian Pscheid
Philipp Schweiger it's something we were trying to avoid due to the complexity of multi-file downloads in zip files. But I understand your use case, so we'll revisit that.
Julian Pscheid
Ok, we were able to add the multifile download, so you can split out sessions into separate MD or JSON files. This will be live in the next version.
P
Philipp Schweiger
Julian Pscheid I kinda don't get why you hid the export function in the app settings for the windows app. Such functions should be where they are used and needed -> sessions and topics overview.
If your team lacks a dedicated UX designer or engineer, consider leveraging AI to assess your UI/UX choices for both desktop and mobile applications BEFORE shipping features or even planning features.
UX will be the bottleneck of your success in the longterm, I can promise you this. You can have the best features if you don't put effort into understanding how your customers use and interact with your app.
Julian Pscheid
Philipp Schweiger Thanks for the feedback. We're in the middle of a redesign of the application that will solve many of the UX challenges we are facing now.
P
Philipp Schweiger
Julian Pscheid And I'll say it again, you should let users take part in the journey of the new UI/UX. In the end, you are developing for them and not into a void... Break the app interface into design sprints, share your mockups and interaction patterns for people to give feedback. It is demanding enough to redesign an app once but doing it twice because you have not taken advantage of hardcore fans and users in your community...