diff --git a/.gitbook/includes/bulk-run-credit-warning.md b/.gitbook/includes/bulk-run-credit-warning.md new file mode 100644 index 0000000..1bf25a3 --- /dev/null +++ b/.gitbook/includes/bulk-run-credit-warning.md @@ -0,0 +1,7 @@ +--- +title: Bulk Run Credit Warning +--- + +{% hint style="warning" %} +NOTE: If your "Saved Workflow" costs 4 credits per run, in the Bulk Runner and Evaluation Tools each of your CSV rows. So, if you have 100 CSV rows with data, your credit consumption will be `100 row * 4 Credits = 400 Credits.` +{% endhint %} diff --git a/guides/understanding-bulk-runner-and-evaluation/README.md b/guides/understanding-bulk-runner-and-evaluation/README.md index 4cf0dde..bfe2c45 100644 --- a/guides/understanding-bulk-runner-and-evaluation/README.md +++ b/guides/understanding-bulk-runner-and-evaluation/README.md @@ -33,6 +33,8 @@ Here are the **quickstart guides** for Bulk Runner and Evaluation:
How to set up Bulk Runner?how-to-set-up-bulk-runner.mdBulk Runner.png_400x400.png
How to set up Evaluation?how-to-set-up-evaluations.mdW.I.9.png_400x400.png
+{% include "../../.gitbook/includes/bulk-run-credit-warning.md" %} + ## How Does Bulk Runner Work? ### Bulk Run Overview @@ -41,6 +43,8 @@ This diagram details the process of generating AI-driven answers to a set of tes ![](<../../.gitbook/assets/Understanding Bulk run and Evaluations.jpg>) + + **1. Test Question Set** The process begins with a curated set of questions. Examples of such questions include: diff --git a/guides/understanding-bulk-runner-and-evaluation/how-to-set-up-bulk-runner.md b/guides/understanding-bulk-runner-and-evaluation/how-to-set-up-bulk-runner.md index d47a1e4..f9e0f15 100644 --- a/guides/understanding-bulk-runner-and-evaluation/how-to-set-up-bulk-runner.md +++ b/guides/understanding-bulk-runner-and-evaluation/how-to-set-up-bulk-runner.md @@ -4,6 +4,8 @@ In this example scenario, we are setting up a simple bulk run to check regressio
Check out the example run here: BULK RUNNER (Regression Only)https://gooey.ai/bulk/farmerchat-bulk-evaluator-regression-only-ggzy9gld1eae/
Check out the example run here: BULK RUNNER (Bulk and Evaluation)https://gooey.ai/bulk/farmerchat-bulk-evaluator-gpt-4o-mixtral-claude-vs-gemini-pro-15-b0o8aos3rj8y/
+{% include "../../.gitbook/includes/bulk-run-credit-warning.md" %} + ### Step 1: Select Gooey Workflows Choose the “SAVED” run from Gooey.AI Workflows that you would like to use. diff --git a/guides/understanding-bulk-runner-and-evaluation/how-to-set-up-evaluations.md b/guides/understanding-bulk-runner-and-evaluation/how-to-set-up-evaluations.md index 9ed6c4c..8c6563f 100644 --- a/guides/understanding-bulk-runner-and-evaluation/how-to-set-up-evaluations.md +++ b/guides/understanding-bulk-runner-and-evaluation/how-to-set-up-evaluations.md @@ -4,6 +4,8 @@ In this example scenario, we are comparing and evaluating the quality of the ans
Check out the example run here: Evaluation only https://gooey.ai/eval/copilot-evaluator-artpuhzwvily/
+{% include "../../.gitbook/includes/bulk-run-credit-warning.md" %} + ### Step 1: Select Gooey Workflows to evaluate Choose the “SAVED” run from Gooey.AI Workflows that you would like to use.