PromptSource

Prompts from PromptSource

• zest: answerable_or_not

  text

  Decide whether this question is answerable. Metric: F1 Score with modified precision and recall, please refer to the paper https://arxiv.org/abs/2011.08115

  by BigScience Workshop

• zest: gpt3_instruct_format

  text

  Template format from GPT3 instruct. Metric: F1 Score with modified precision and recall, please refer to the paper https://arxiv.org/abs/2011.08115

  by BigScience Workshop

• zest: concat_quest_context

  text

  Concatenate question and context. Metric: F1 Score with modified precision and recall, please refer to the paper https://arxiv.org/abs/2011.08115

  by BigScience Workshop

• yelp_review_full: format_score

  text

  Simulating webpage

  by BigScience Workshop

• yelp_review_full: format_rating

  text

  It's simulating the format of a webpage.

  by BigScience Workshop

• yelp_review_full: based_on_that

  text

  PromptSource template for the yelp_review_full dataset.

  by BigScience Workshop

• yelp_polarity: format_come_again

  text

  Simulating website

  by BigScience Workshop

• yelp_polarity: experience_good_bad

  text

  PromptSource template for the yelp_polarity dataset.

  by BigScience Workshop

• yelp_polarity: come_again

  text

  PromptSource template for the yelp_polarity dataset.

  by BigScience Workshop

• yahoo_answers_topics: question_answer

  text

  The prompt asks to answer the question

  by BigScience Workshop

• yahoo_answers_topics: generate_question_from_answer

  text

  Prompt template generates the question from the answer

  by BigScience Workshop

• yahoo_answers_qa: hint_question_answer

  text

  Template asks the model to generate the answer for the question. The template provides a hint.

  by BigScience Workshop

• yahoo_answers_qa: exam_style_prompt

  text

  Template asks the model to answer the exam style prompt

  by BigScience Workshop

• yahoo_answers_qa: best_answer

  text

  The template asks to generate the correct answer

  by BigScience Workshop

• xsum: DOC_how_would_you_rephrase_few_words

  text

  http://gptprompts.wikidot.com/prompt:summarization

  by BigScience Workshop

• xsum: DOC_given_above_write_one_sentence

  text

  PromptSource template for the xsum dataset.

  by BigScience Workshop

• xsum: DOC_boils_down_to_simple_idea_that

  text

  http://gptprompts.wikidot.com/prompt:summarization

  by BigScience Workshop

• xquad_r/en: answer_the_question

  text

  PromptSource template for the xquad_r/en dataset.

  by BigScience Workshop

• xquad_r/en: answer_question_given_context

  text

  PromptSource template for the xquad_r/en dataset.

  by BigScience Workshop

• xquad_r/en: answer_given_context_and_question

  text

  PromptSource template for the xquad_r/en dataset.

  by BigScience Workshop

• xquad/xquad.en: answer_the_question

  text

  PromptSource template for the xquad/xquad.en dataset.

  by BigScience Workshop

• xquad/xquad.en: answer_question_given_context

  text

  PromptSource template for the xquad/xquad.en dataset.

  by BigScience Workshop

• xquad/xquad.en: answer_given_context_and_question

  text

  PromptSource template for the xquad/xquad.en dataset.

  by BigScience Workshop

• xnli/en: based on the previous passage

  text

  Adapted from the BoolQ prompts in Schick & Schütze 2021.

  by BigScience Workshop

• xnli/en: MNLI crowdsource

  text

  Adapted from Williams et al. 2018's instructions to crowdsourcing workers.

  by BigScience Workshop

• xnli/en: GPT-3 style

  text

  Same as reported in Figure G7 of the GPT-3 paper, except that there is no task identifying tokens like "anli R1: ".

  by BigScience Workshop

• winogrande/winogrande_xs: fill in the blank

  text

  PromptSource template for the winogrande/winogrande_xs dataset.

  by BigScience Workshop

• winogrande/winogrande_xs: does underscore refer to

  text

  PromptSource template for the winogrande/winogrande_xs dataset.

  by BigScience Workshop

• winogrande/winogrande_xs: Replace

  text

  PromptSource template for the winogrande/winogrande_xs dataset.

  by BigScience Workshop

• winogrande/winogrande_xl: fill in the blank

  text

  PromptSource template for the winogrande/winogrande_xl dataset.

  by BigScience Workshop