Docs are current in the making

Image, Files & Video

FlowBridge is taking integrations to the next level by adding image & file modality to its capabilities. From analyzing pictures to delivering contextually rich responses, the possibilities are endless. Here’s a quick explanation of how it works and what you can achieve.

Showcase:

How It Works

1. Seamless Integration with Voiceflow and APIs

  • When a user sends an image, FlowBridge generates a URL for the image/file.

  • This URL is sent to your Voiceflow project and processed via integrations like the OpenAI Vision API.

  • It is recommended to run a check to validate if the message being sent to voiceflow is indeed a URL to a file or not for a proper user experience

2. Flexible and Versatile Use Cases

  • Handle complex image-based queries, from analyzing objects to generating recommendations.

  • Leverage the FlowBridge Function Marketplace to connect tools like OpenAI Vision API effortlessly.

Step-by-Step Example

  1. Request image in Voiceflow Message step In your flow, you ask the user to send a picture of their fridge

  2. User Sends an Image

    On WhatsApp, I send a picture of my fridge.

  3. FlowBridge Processes the Image

    FlowBridge generates a URL for the image and sends it to your Voiceflow project.

  4. Use a normal capture step to retrieve the URL

    You accept a normal capture step as if the user is sending a text message, but validate that it is indeed a URL to an image

  5. Process the image Use the image URL to send it to the Open AI vision API (or any other vision based model) with the query "Provide dinner ideas based on what ingredients are in the image"

  6. AI Agent Responds with Suggestions

    After processing, the AI agent replies:"Based on the contents of your fridge, here are some dinner ideas: seed salad with grilled chicken, an omelette frittata, or a deli sandwich/wrap."

Endless Applications

From meal planning to object recognition, FlowBridge empowers your AI agents to handle visual data effortlessly. This opens up exciting new possibilities for client interactions and business automation.

PreviousVoice ModalityNextCustom Functions (Voiceflow)

Last updated