Exploring Screenshot Analysis with Dust for Product Questions

·

Hello ! On chatgpt today it's possible to share a photo and ask a question based on the picture we gave to it. Would it be possible at some point using Dust to share a screenshot from our product (given that we've shared as data source a lot of screenshots of every part of our product + access to its code) and then asks questions based on the screenshot ?

7 comments

Daphné
·
·
Hi, you can already do that on Dust!
🤯1
Henri
·
·
Damn !!! Do you have a FAQ for that ?
Daphné
·
·
You can make some tests by uploading a picture of your product on a conversation and ask a question about it!
Henri
·
·
Is there guidelines on how to give relevant source for this usage ? Because i guess the model as to be retrained on a lot of screenshots of our product ? or at least have as data source a lot of screenshots ?
Daphné
·
·
Depends what you want to achieve exactly, models are not trained on your data but they are able to read images so you can start experimenting already by giving access let's say to our Design system from your codebase (if you have any) and then share screenshots to ask question about it and see how it goes
🙌1
Henri
·
·
Titouan Aubrun 👀
Henri
·
·
Thanks Daphné! 🙏