In the context of chatbots, rubrics are guidelines or criteria used to evaluate the chatbot's performance and quality. These rubrics typically break down the evaluation into several key areas, such as accuracy, relevance, tone, and/or efficiency.
Given the following request to a chatbot, evaluate whether the response successfully addresses the rubrics.
Prompt:
How do I make a London Fog? Write the instructions as a bullet point list where each step is only one sentence. Please first greet me in a formal, polite manner. I need the main recipe and then I also need 2 variations, one being a flavor variation and one being a vegan alternative (but fyi I hate soy milk). The variation recipes don't need to have their own bullet lists, just short blurbs explaining what they are and the differences please. Make sure that after that you include a comma-separated list of all the ingredients I need and if there are any variation ingredients you can list those in parentheses. Oh and I can't have sugar.
Response:
Greetings,
It is a pleasure to assist you with this request. Here are the instructions for preparing a London Fog.
London Fog
- Steep one Earl Grey tea bag in half a cup of hot water.
- Froth half a cup of milk of your choice.
- Add one teaspoon of vanilla extract to the tea.
- Pour the frothed milk over the tea.
- Stir to combine all ingredients.
Flavor Variation: Lavender London Fog
For a floral twist, a Lavender London Fog incorporates a touch of lavender. Simply add a small amount of lavender simple syrup to the tea along with the vanilla extract before adding the milk. This creates a more fragrant and unique beverage, with the lavender simple syrup adding sweetness.
Given the following request to a chatbot, evaluate whether the response successfully addresses the rubrics.
Prompt:
How do I make a London Fog? Write the instructions as a bullet point list where each step is only one sentence. Please first greet me in a formal, polite manner. I need the main recipe and then I also need 2 variations, one being a flavor variation and one being a vegan alternative (but fyi I hate soy milk). The variation recipes don't need to have their own bullet lists, just short blurbs explaining what they are and the differences please. Make sure that after that you include a comma-separated list of all the ingredients I need and if there are any variation ingredients you can list those in parentheses. Oh and I can't have sugar.
Response:
Greetings,
It is a pleasure to assist you with this request. Here are the instructions for preparing a London Fog.
London Fog
Flavor Variation: Lavender London Fog
For a floral twist, a Lavender London Fog incorporates a touch of lavender. Simply add a small amount of lavender simple syrup to the tea along with the vanilla extract before adding the milk. This creates a more fragrant and unique beverage, with the lavender simple syrup adding sweetness.