# DeepInfra Querying Function

{% hint style="info" %}
With the DeepInfra Querying function, you can easily query the DeepInfra API to use OpenAI compatible models such as ***meta-llama/Meta-Llama-3-8B-Instruct*** and optimize costs for your Voiceflow builds.
{% endhint %}

### Guide:

{% embed url="<https://youtu.be/_yxVaP0uVXg?t=62>" %}

### Input Variables

**License** - Your FlowBridge Custom Function license key

**Model** - [The DeepInfra model that is OpenAI compatible](https://deepinfra.com/models)

**Api Key** - The API key for your DeepInfra account

**System Prompt** - The system prompt you want to include (You can set this to "manual" and change the prompt in the code)

**User Prompt** - The user prompt you want to include, generally your *{last\_utterence}* variable (You can set this to "manual" and change the prompt in the code)

**Max Tokens** - The maximum tokens you want the model to use

### Step by Step guide

Here is the URL for the official support page showcasing the steps visually: <https://support.flowbridge.app/hc/en-us/articles/19033382413714-DeepInfra-Querying-Use-cheaper-open-source-models>

1. Navigate to the FlowBridge admin panel
2. Click "Custom Functions"

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/3b39554b-c508-46f7-94ca-228bae396b05/ascreenshot.jpeg?tl_px=0,70\&br_px=859,551\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=88,212)

3. Click "Download" on DeepInfra Querying function

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/a29d5c19-758a-4fce-93dc-de55c35166d2/ascreenshot.jpeg?tl_px=1119,505\&br_px=1979,986\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=402,212)

4. Go to your Voiceflow Project
5. Click "Functions"

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/ae197204-43a5-4a20-b075-9182beb7b517/ascreenshot.jpeg?tl_px=0,68\&br_px=859,549\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=158,212)

6. Click this icon to import the function code

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/063226e3-0d65-430d-ae35-de99e2d3151d/ascreenshot.jpeg?tl_px=2523,0\&br_px=3383,480\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=800,61)

7. Click "Browse"

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/c58b4578-c27f-48a7-b1e9-c89d8f22c940/ascreenshot.jpeg?tl_px=1277,0\&br_px=2137,480\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=402,143)

8. Click "Import" after selecting the downloaded JSON file

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/bb283b38-e5d3-42a1-8210-43a03ba90095/ascreenshot.jpeg?tl_px=1367,74\&br_px=2227,555\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=402,212)

9. Click "Workflows"

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/6ce5fd76-2cef-43fe-bb37-886fd604dc37/ascreenshot.jpeg?tl_px=0,0\&br_px=859,480\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=215,87)

10. Double-click here.

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/7bf089b2-5d9e-4208-b140-7396dc41f25f/ascreenshot.jpeg?tl_px=221,0\&br_px=1081,480\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=402,157)

11. Click "Capture" and drag it in to the project

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/e0ef67d2-db46-424e-8e90-cdd2c3c6442c/ascreenshot.jpeg?tl_px=0,141\&br_px=859,622\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=399,212)

12. Click here to connect the Start block and Capture block

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/8f2981f3-d40d-4102-a810-b5e54bf3799c/ascreenshot.jpeg?tl_px=968,209\&br_px=1828,690\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=402,212)

13. Click "Function" and drag it in to the project

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/62dc6906-15de-42fb-b2c3-a07b86fa3363/ascreenshot.jpeg?tl_px=0,197\&br_px=859,678\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=369,212)

14. Click here to connect the capture block and function block

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/e92bc9b8-9622-4ac0-ab0e-2a8b9157d369/ascreenshot.jpeg?tl_px=989,289\&br_px=1849,770\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=402,212)

15. Click on the function block and click on "Select existing function"

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/7db461ac-ce2a-47a5-89b1-d7e1dce8b90c/ascreenshot.jpeg?tl_px=2523,0\&br_px=3383,480\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=688,116)

16. Click "DeepInfra Querying (OpenAI Standard)"

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/1d12dfbc-cb47-4eaf-ac7f-336d09917a5c/ascreenshot.jpeg?tl_px=2523,0\&br_px=3383,480\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=654,203)

17. Go to the FlowBridge custom function page and copy your license
18. Paste the license code here

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/a0c02983-443d-40bf-8030-64cc296a8597/ascreenshot.jpeg?tl_px=2523,17\&br_px=3383,498\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=581,212)

19. Click here.

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/6bfab9fe-510e-4673-8285-d3c92b60a9da/ascreenshot.jpeg?tl_px=2523,51\&br_px=3383,532\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=576,212)

20. Write the number of maximum tokens you want the LLM to use
21. Click here.

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/a45882ba-a1e5-4b9e-8a12-b7d0aa281354/ascreenshot.jpeg?tl_px=2523,87\&br_px=3383,568\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=564,212)

22. In a new tab, navigate to <https://deepinfra.com/>
23. Click "Models"

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/54e5f843-de08-4282-9dba-383821212040/ascreenshot.jpeg?tl_px=1182,0\&br_px=2042,480\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=402,16)

24. Click this icon which will copy the chosen LLM model you want to use (Make sure its a OpenAI compatible model).

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/637958f5-848e-48bd-aa07-a550affc91b9/ascreenshot.jpeg?tl_px=990,788\&br_px=1850,1269\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=402,259)

25. Paste the model here

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/d61b2df7-16d2-46de-afa9-368a2def1f90/ascreenshot.jpeg?tl_px=2523,92\&br_px=3383,573\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=569,212)

26. Go back to DeepInfra, if you do not have an account yet, create one. If you do, click "Dashboard"

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/334b4c69-e63a-45d2-a180-6f3d7f76b3cb/ascreenshot.jpeg?tl_px=1847,0\&br_px=2707,480\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=402,17)

27. Click "API Keys"

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/12736c07-8cff-4715-8780-b216ea36b261/user_cropped_screenshot.jpeg?tl_px=0,0\&br_px=859,480\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=91,145)

28. Click "New API key"

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/58e9c2f5-1c2d-4752-b241-2efc0aba836e/ascreenshot.jpeg?tl_px=2523,0\&br_px=3383,480\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=680,62)

29. Click the "API Key name" field.

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/00dbd978-ec7c-4eae-9482-38d683332fe8/ascreenshot.jpeg?tl_px=1139,429\&br_px=1999,910\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=402,212)

30. Type what you want to label this API key
31. Click "Generate API key"

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/0c1234c7-9a2a-491b-a89f-07ee6b811261/ascreenshot.jpeg?tl_px=1190,479\&br_px=2050,960\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=402,212)

32. Click this icon to copy the API key.

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/0045bce2-ec68-4248-8e14-32ba86420a76/ascreenshot.jpeg?tl_px=1463,456\&br_px=2323,937\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=402,212)

33. Paste the API key here

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/9d539b12-f437-4221-ad23-baa45fa2dea8/ascreenshot.jpeg?tl_px=2523,129\&br_px=3383,610\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=570,212)

34. Click here.

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/419820ad-fa33-4a28-be6e-0e99c367b53f/ascreenshot.jpeg?tl_px=2523,160\&br_px=3383,641\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=554,212)

35. Type you're system prompt, like "Be a pirate"
36. Click here.

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/b858e701-1b15-4e43-93d3-42b5350f3382/ascreenshot.jpeg?tl_px=2523,194\&br_px=3383,675\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=562,212)

37. Type "Say hello to me" or use the {last\_utterence} variable to use the message from the user
38. Click here.

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/f91e97c8-49a3-407e-b46f-0eaa1be2f9aa/ascreenshot.jpeg?tl_px=2523,296\&br_px=3383,777\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=706,212)

39. Type "{"
40. Click "Create variable"

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/28d08156-9cca-40bd-a508-547b846b992d/ascreenshot.jpeg?tl_px=2523,633\&br_px=3383,1114\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=592,212)

41. Click the "Name" field.

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/55366f76-a3fe-46c4-bf97-3271d3a9bde9/ascreenshot.jpeg?tl_px=1205,0\&br_px=2065,480\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=402,120)

42. Type "deepinfra\_response"
43. Click "Create variable"

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/13391405-2fce-4eb9-b7e2-8378d2fb3a54/ascreenshot.jpeg?tl_px=1326,184\&br_px=2186,665\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=402,212)

44. Click here and drag a line somewhere

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/75db1e57-8f3b-4f0e-9373-f6b2dd1540bd/ascreenshot.jpeg?tl_px=1326,449\&br_px=2186,930\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=402,212)

45. Click "Text"

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/bdce5b78-c489-4984-bd49-144739ec09ab/ascreenshot.jpeg?tl_px=1750,450\&br_px=2610,931\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=402,212)

46. Click here.

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/24d3827d-be52-4dbc-a846-225258bdd4cc/ascreenshot.jpeg?tl_px=2523,0\&br_px=3383,480\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=489,169)

47. Type "{deepinfra\_response}" to show the response from the LLM to the user


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://docs.flowbridge.app/documentation/basics/custom-functions-voiceflow/deepinfra-querying-function.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.