I’m currently working with Notion pages that include webinar summaries, each starting with a link to the webinar’s replay. I’m developing a bot that should provide content based on a subject I input. The bot successfully finds the correct Notion page with the webinar, but it can’t extract the link that redirects directly to the webinar replay.
I’ve tried providing examples, explaining where the link is on the page, and mentioning that the link starts with <https://app.getcontrast.io/videos/>. However, it keeps making different errors. Sometimes it only gives me the base URL <https://app.getcontrast.io/videos/>, other times it combines it with the page name instead of the actual URL, or it appends random letters that lead to an unknown page.
No matter what I try, it doesn’t work.
Do you have any suggestions or solutions for this issue?
Unfortunately LLMs tend to hallucinate on long links so there can be a lot of trial and error to make them use only provided links and not invent any.
What’s your prompt and which model are you using?
The bot receives a content request from the sales person, related to a customer who has expressed a specific concern or interest.
Search on the Figures Blog and Webinar Notion Pages
The bot explores blog articles and Notion pages dedicated to webinars to identify content relevant to the customer’s concerns.
For webinars, the bot must find the app.getcontrast.io link that corresponds to the webinar on the page used. Random or unvalidated links should not be used. On each notion page an app.getcontrast.io link is written at the beginning of the notion page (app.getcontrast.io) is the beginning of the link I give you so that you can identify which link to copy, you must use the whole link which changes according to each webinar). It’s this link that must be given in the answer if you’re using a notion page.
Synthesis and proposal
The bot compiles the results and proposes resources in the form of suggestions, sorted in order of relevance, from the most to the least relevant content.
But were the reference links correct?
Most of the time LLMs are not great at producing links, that’s why we’re adding reference links at the bottom ourselves that are managed by us and not the LLMs
I’m not sure to completely understand - Dust is good at finding the content and retrieving the links for you and attaches them as references at the bottom of your conversation. It looks like this:
I had to manually insert the webinar links into the bot’s instructions one by one for it to redirect properly, as the bot isn’t able to detect the links from the Notion page. This is somewhat frustrating.
Understood - sorry about that !
Just to make sure, what did you put in the ‘describe your data’ input in the search tool when plugging your notion datasource?
