> For the complete documentation index, see [llms.txt](https://docs.flowbridge.app/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.flowbridge.app/documentation/basics/custom-functions-voiceflow/deepinfra-querying-function.md).

# DeepInfra Querying Function

{% hint style="info" %}
With the DeepInfra Querying function, you can easily query the DeepInfra API to use OpenAI compatible models such as ***meta-llama/Meta-Llama-3-8B-Instruct*** and optimize costs for your Voiceflow builds.
{% endhint %}

### Guide:

{% embed url="<https://youtu.be/_yxVaP0uVXg?t=62>" %}

### Input Variables

**License** - Your FlowBridge Custom Function license key

**Model** - [The DeepInfra model that is OpenAI compatible](https://deepinfra.com/models)

**Api Key** - The API key for your DeepInfra account

**System Prompt** - The system prompt you want to include (You can set this to "manual" and change the prompt in the code)

**User Prompt** - The user prompt you want to include, generally your *{last\_utterence}* variable (You can set this to "manual" and change the prompt in the code)

**Max Tokens** - The maximum tokens you want the model to use

### Step by Step guide

Here is the URL for the official support page showcasing the steps visually: <https://support.flowbridge.app/hc/en-us/articles/19033382413714-DeepInfra-Querying-Use-cheaper-open-source-models>

1. Navigate to the FlowBridge admin panel
2. Click "Custom Functions"

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/3b39554b-c508-46f7-94ca-228bae396b05/ascreenshot.jpeg?tl_px=0,70\&br_px=859,551\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=88,212)

3. Click "Download" on DeepInfra Querying function

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/a29d5c19-758a-4fce-93dc-de55c35166d2/ascreenshot.jpeg?tl_px=1119,505\&br_px=1979,986\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=402,212)

4. Go to your Voiceflow Project
5. Click "Functions"

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/ae197204-43a5-4a20-b075-9182beb7b517/ascreenshot.jpeg?tl_px=0,68\&br_px=859,549\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=158,212)

6. Click this icon to import the function code

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/063226e3-0d65-430d-ae35-de99e2d3151d/ascreenshot.jpeg?tl_px=2523,0\&br_px=3383,480\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=800,61)

7. Click "Browse"

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/c58b4578-c27f-48a7-b1e9-c89d8f22c940/ascreenshot.jpeg?tl_px=1277,0\&br_px=2137,480\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=402,143)

8. Click "Import" after selecting the downloaded JSON file

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/bb283b38-e5d3-42a1-8210-43a03ba90095/ascreenshot.jpeg?tl_px=1367,74\&br_px=2227,555\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=402,212)

9. Click "Workflows"

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/6ce5fd76-2cef-43fe-bb37-886fd604dc37/ascreenshot.jpeg?tl_px=0,0\&br_px=859,480\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=215,87)

10. Double-click here.

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/7bf089b2-5d9e-4208-b140-7396dc41f25f/ascreenshot.jpeg?tl_px=221,0\&br_px=1081,480\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=402,157)

11. Click "Capture" and drag it in to the project

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/e0ef67d2-db46-424e-8e90-cdd2c3c6442c/ascreenshot.jpeg?tl_px=0,141\&br_px=859,622\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=399,212)

12. Click here to connect the Start block and Capture block

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/8f2981f3-d40d-4102-a810-b5e54bf3799c/ascreenshot.jpeg?tl_px=968,209\&br_px=1828,690\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=402,212)

13. Click "Function" and drag it in to the project

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/62dc6906-15de-42fb-b2c3-a07b86fa3363/ascreenshot.jpeg?tl_px=0,197\&br_px=859,678\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=369,212)

14. Click here to connect the capture block and function block

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/e92bc9b8-9622-4ac0-ab0e-2a8b9157d369/ascreenshot.jpeg?tl_px=989,289\&br_px=1849,770\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=402,212)

15. Click on the function block and click on "Select existing function"

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/7db461ac-ce2a-47a5-89b1-d7e1dce8b90c/ascreenshot.jpeg?tl_px=2523,0\&br_px=3383,480\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=688,116)

16. Click "DeepInfra Querying (OpenAI Standard)"

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/1d12dfbc-cb47-4eaf-ac7f-336d09917a5c/ascreenshot.jpeg?tl_px=2523,0\&br_px=3383,480\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=654,203)

17. Go to the FlowBridge custom function page and copy your license
18. Paste the license code here

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/a0c02983-443d-40bf-8030-64cc296a8597/ascreenshot.jpeg?tl_px=2523,17\&br_px=3383,498\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=581,212)

19. Click here.

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/6bfab9fe-510e-4673-8285-d3c92b60a9da/ascreenshot.jpeg?tl_px=2523,51\&br_px=3383,532\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=576,212)

20. Write the number of maximum tokens you want the LLM to use
21. Click here.

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/a45882ba-a1e5-4b9e-8a12-b7d0aa281354/ascreenshot.jpeg?tl_px=2523,87\&br_px=3383,568\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=564,212)

22. In a new tab, navigate to <https://deepinfra.com/>
23. Click "Models"

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/54e5f843-de08-4282-9dba-383821212040/ascreenshot.jpeg?tl_px=1182,0\&br_px=2042,480\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=402,16)

24. Click this icon which will copy the chosen LLM model you want to use (Make sure its a OpenAI compatible model).

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/637958f5-848e-48bd-aa07-a550affc91b9/ascreenshot.jpeg?tl_px=990,788\&br_px=1850,1269\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=402,259)

25. Paste the model here

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/d61b2df7-16d2-46de-afa9-368a2def1f90/ascreenshot.jpeg?tl_px=2523,92\&br_px=3383,573\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=569,212)

26. Go back to DeepInfra, if you do not have an account yet, create one. If you do, click "Dashboard"

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/334b4c69-e63a-45d2-a180-6f3d7f76b3cb/ascreenshot.jpeg?tl_px=1847,0\&br_px=2707,480\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=402,17)

27. Click "API Keys"

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/12736c07-8cff-4715-8780-b216ea36b261/user_cropped_screenshot.jpeg?tl_px=0,0\&br_px=859,480\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=91,145)

28. Click "New API key"

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/58e9c2f5-1c2d-4752-b241-2efc0aba836e/ascreenshot.jpeg?tl_px=2523,0\&br_px=3383,480\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=680,62)

29. Click the "API Key name" field.

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/00dbd978-ec7c-4eae-9482-38d683332fe8/ascreenshot.jpeg?tl_px=1139,429\&br_px=1999,910\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=402,212)

30. Type what you want to label this API key
31. Click "Generate API key"

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/0c1234c7-9a2a-491b-a89f-07ee6b811261/ascreenshot.jpeg?tl_px=1190,479\&br_px=2050,960\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=402,212)

32. Click this icon to copy the API key.

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/0045bce2-ec68-4248-8e14-32ba86420a76/ascreenshot.jpeg?tl_px=1463,456\&br_px=2323,937\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=402,212)

33. Paste the API key here

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/9d539b12-f437-4221-ad23-baa45fa2dea8/ascreenshot.jpeg?tl_px=2523,129\&br_px=3383,610\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=570,212)

34. Click here.

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/419820ad-fa33-4a28-be6e-0e99c367b53f/ascreenshot.jpeg?tl_px=2523,160\&br_px=3383,641\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=554,212)

35. Type you're system prompt, like "Be a pirate"
36. Click here.

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/b858e701-1b15-4e43-93d3-42b5350f3382/ascreenshot.jpeg?tl_px=2523,194\&br_px=3383,675\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=562,212)

37. Type "Say hello to me" or use the {last\_utterence} variable to use the message from the user
38. Click here.

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/f91e97c8-49a3-407e-b46f-0eaa1be2f9aa/ascreenshot.jpeg?tl_px=2523,296\&br_px=3383,777\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=706,212)

39. Type "{"
40. Click "Create variable"

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/28d08156-9cca-40bd-a508-547b846b992d/ascreenshot.jpeg?tl_px=2523,633\&br_px=3383,1114\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=592,212)

41. Click the "Name" field.

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/55366f76-a3fe-46c4-bf97-3271d3a9bde9/ascreenshot.jpeg?tl_px=1205,0\&br_px=2065,480\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=402,120)

42. Type "deepinfra\_response"
43. Click "Create variable"

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/13391405-2fce-4eb9-b7e2-8378d2fb3a54/ascreenshot.jpeg?tl_px=1326,184\&br_px=2186,665\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=402,212)

44. Click here and drag a line somewhere

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/75db1e57-8f3b-4f0e-9373-f6b2dd1540bd/ascreenshot.jpeg?tl_px=1326,449\&br_px=2186,930\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=402,212)

45. Click "Text"

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/bdce5b78-c489-4984-bd49-144739ec09ab/ascreenshot.jpeg?tl_px=1750,450\&br_px=2610,931\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=402,212)

46. Click here.

![](https://ajeuwbhvhr.cloudimg.io/colony-recorder.s3.amazonaws.com/files/2024-05-20/24d3827d-be52-4dbc-a846-225258bdd4cc/ascreenshot.jpeg?tl_px=2523,0\&br_px=3383,480\&force_format=png\&width=860\&wat_scale=76\&wat=1\&wat_opacity=0.7\&wat_gravity=northwest\&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png\&wat_pad=489,169)

47. Type "{deepinfra\_response}" to show the response from the LLM to the user