FlowBridge is taking integrations to the next level by adding image & file modality to its capabilities. From analyzing pictures to delivering contextually rich responses, the possibilities are endless. Here’s a quick explanation of how it works and what you can achieve.
When a user sends an image, FlowBridge generates a URL for the image/file.
This URL is sent to your Voiceflow project and processed via integrations like the OpenAI Vision API.
It is recommended to run a check to validate if the message being sent to voiceflow is indeed a URL to a file or not for a proper user experience
Handle complex image-based queries, from analyzing objects to generating recommendations.
Leverage the FlowBridge Function Marketplace to connect tools like OpenAI Vision API effortlessly.
Request image in Voiceflow Message step In your flow, you ask the user to send a picture of their fridge
User Sends an Image
On WhatsApp, I send a picture of my fridge.
FlowBridge Processes the Image
FlowBridge generates a URL for the image and sends it to your Voiceflow project.
Use a normal capture step to retrieve the URL
You accept a normal capture step as if the user is sending a text message, but validate that it is indeed a URL to an image
Process the image Use the image URL to send it to the Open AI vision API (or any other vision based model) with the query "Provide dinner ideas based on what ingredients are in the image"
AI Agent Responds with Suggestions
After processing, the AI agent replies:"Based on the contents of your fridge, here are some dinner ideas: seed salad with grilled chicken, an omelette frittata, or a deli sandwich/wrap."
From meal planning to object recognition, FlowBridge empowers your AI agents to handle visual data effortlessly. This opens up exciting new possibilities for client interactions and business automation.
Last updated
