Hey team, I'm building a system to aggregate user feedback from various sources. The goal is to first summarize everything into a table, and then use a separate agent to prioritize problems based on ICPs, product direction, and company knowledge. The final output will be an exhaustive list of problem statements, including feedback frequency, severity, verbatims, and sources. I've split this into multiple specialized agents, and I'm wondering if this architecture is correct or perhaps overly complex. My aim was to specialize each agent's instructions. To help define these instructions, I used a separate Dust Agent to generate the specific instructions for each individual agent (including the orchestrator agent). I ensured that every agent comprehends its role within this ecosystem and the data structure it analyzes. Furthermore, I defined a common result template, ensuring that all generated results from specific agents adhere to a similar structure. I've reviewed the existing guides, but some of them seem a bit outdated for this specific challenge. Any advice or insights you have would be greatly appreciated! I'm particularly wondering:
Is the architecture I've chosen correct, or is it overly complex for this problem?
Are there any patterns or best practices for inter-agent communication within Dust that I should be leveraging more explicitly?
Productboard has almost 40,000 notes; will the system only be able to sample, or can I effectively use the query table feature to process all of it? Or should I give Productboard feature summaries instead of getting notes?
Do you think this quest has any chance of providing good results or i should use specific agents independently
Thanks!
I recommend starting small with a single main agent using a reasoning model and tools. In the prompt add a "process" section which clearly states the steps it should take (step 1: orchestrate, step 2: review productboard etc...) For the custom instructions, add them in the main prompt. => I got pretty good results with it and it allowed me to iterate fast. Once you have a good understanding of your challenges, you can go the specialised agent root.
Hey Rémi Fayolle 👋 Really cool use case! I am aligned with Hugo's input. But the overall structure you have should work once you have functional sub agent (probably using "extract data" tools) Note: sometimes adding the following in the orchastrating agents' instructions can be helpful: "execute steps in parallel to save as much time as possible". Agents will have a tendency to execute sequentially which will take forever in your case.
