{ "cells": [ { "cell_type": "markdown", "id": "a51ae982-cad6-4d26-a18a-83472879325b", "metadata": {}, "source": [ "# Setup" ] }, { "cell_type": "markdown", "id": "538e8d9b-74c8-4684-80be-623778bdaa90", "metadata": {}, "source": [ "## Config" ] }, { "cell_type": "code", "execution_count": 1, "id": "cf368153-eb55-42f4-887f-889c4e9d7c60", "metadata": {}, "outputs": [], "source": [ "INPUT_DATASET = 'layoric/labeled-multiple-choice-explained'\n", "REVISION = '536f3b8'\n", "OUTPUT_DATASET = 'derek-thomas/labeled-multiple-choice-explained-falcon-reasoning'\n", "NAMESPACE = 'HF-test-lab' # Use your username or wherever you have the ability to deploy inference endpoints\n", "BASE_MODEL = 'tiiuae/Falcon3-7B-Instruct'\n", "MAX_WORKERS = 16\n", "MAX_TOKENS = 1650" ] }, { "cell_type": "code", "execution_count": 2, "id": "c5a12bab-97bf-4a1d-989b-89f50a7fc272", "metadata": {}, "outputs": [ { "data": { "application/vnd.jupyter.widget-view+json": { "model_id": "4439ab58168e4bbcbf4da1051b8f9ada", "version_major": 2, "version_minor": 0 }, "text/plain": [ "VBox(children=(HTML(value='
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
formatted_questioncombinedfactanswerKeytopic__index_level_0__explanation
0what is satellite technology used for predicti...satellite technology is used for predicting wh...ctechnology35972.0a) Seconds and minutes: This option is incorre...
1what does irradiating food do? (a) relieve pai...irradiated food improves food safety.cfood science20412.0(a) Relieve pain: This option is not correct b...
2what protects a mammal's skin? (a) fiber folli...fiber follicles protect mammal skinabiology5779.0b) Exfoliation: Exfoliation is the process of ...
3what do earthworms do when a segment breaks of...earthworms can regrow segments that break offbbiology4064.0a) Dies: This option is not correct because ea...
4lightning can be bad for what? (a) the environ...lightning can be bad for the environment.aelectricity34080.0b) Rainstorms: Lightning is actually a natural...
.....................
9093organisms that can cause infection do what? (a...organisms that can cause infection make humans...gbiology33485.0a) Bandaging open sores is not the correct ans...
9094fungi are living things that cannot make thei...fungi are living things that cannot make their...abiology12097.0b) Fungi are living things that can make their...
9095an overheated body can use water for: (a) meta...the evaporation of water from the skin cools t...gbiology6522.0a) Metabolic reaction: This option is incorrec...
9096what is essential for cellular respiration for...plants are essential for cellular respiration ...fbiology27144.0a) Electrons are involved in cellular respirat...
9097what helps insulate and protect the body? (a) ...living cells in follicles help insulate and pr...bbiology18522.0a) H2O: Water is essential for life, but it do...
\n", "

9098 rows × 6 columns

\n", "" ], "text/plain": [ " formatted_question \\\n", "0 what is satellite technology used for predicti... \n", "1 what does irradiating food do? (a) relieve pai... \n", "2 what protects a mammal's skin? (a) fiber folli... \n", "3 what do earthworms do when a segment breaks of... \n", "4 lightning can be bad for what? (a) the environ... \n", "... ... \n", "9093 organisms that can cause infection do what? (a... \n", "9094 fungi are living things that cannot make thei... \n", "9095 an overheated body can use water for: (a) meta... \n", "9096 what is essential for cellular respiration for... \n", "9097 what helps insulate and protect the body? (a) ... \n", "\n", " combinedfact answerKey \\\n", "0 satellite technology is used for predicting wh... c \n", "1 irradiated food improves food safety. c \n", "2 fiber follicles protect mammal skin a \n", "3 earthworms can regrow segments that break off b \n", "4 lightning can be bad for the environment. a \n", "... ... ... \n", "9093 organisms that can cause infection make humans... g \n", "9094 fungi are living things that cannot make their... a \n", "9095 the evaporation of water from the skin cools t... g \n", "9096 plants are essential for cellular respiration ... f \n", "9097 living cells in follicles help insulate and pr... b \n", "\n", " topic __index_level_0__ \\\n", "0 technology 35972.0 \n", "1 food science 20412.0 \n", "2 biology 5779.0 \n", "3 biology 4064.0 \n", "4 electricity 34080.0 \n", "... ... ... \n", "9093 biology 33485.0 \n", "9094 biology 12097.0 \n", "9095 biology 6522.0 \n", "9096 biology 27144.0 \n", "9097 biology 18522.0 \n", "\n", " explanation \n", "0 a) Seconds and minutes: This option is incorre... \n", "1 (a) Relieve pain: This option is not correct b... \n", "2 b) Exfoliation: Exfoliation is the process of ... \n", "3 a) Dies: This option is not correct because ea... \n", "4 b) Rainstorms: Lightning is actually a natural... \n", "... ... \n", "9093 a) Bandaging open sores is not the correct ans... \n", "9094 b) Fungi are living things that can make their... \n", "9095 a) Metabolic reaction: This option is incorrec... \n", "9096 a) Electrons are involved in cellular respirat... \n", "9097 a) H2O: Water is essential for life, but it do... \n", "\n", "[9098 rows x 6 columns]" ] }, "execution_count": 6, "metadata": {}, "output_type": "execute_result" } ], "source": [ "df" ] }, { "cell_type": "code", "execution_count": 7, "id": "a1ec5678-13a5-4602-9d67-8406248fa414", "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "Before Cleaning: 9098 rows\n", "After Cleaning: 8413 rows\n" ] } ], "source": [ "print(f\"Before Cleaning: {len(df)} rows\")\n", "\n", "# Drop the __index_level_0__ column if it exists\n", "df.drop(columns=['__index_level_0__'], errors='ignore', inplace=True)\n", "\n", "# Ensure all values in 'formatted_question' are strings\n", "df['formatted_question'] = df['formatted_question'].astype(str)\n", "\n", "# Filter on topic so that we can stratify later\n", "df['topic'] = df['topic'].fillna('unknown')\n", "topic_counts = df['topic'].value_counts()\n", "valid_topics = topic_counts[topic_counts >= 5].index\n", "df = df[df['topic'].isin(valid_topics)]\n", "df = df[~df['topic'].isin(['unknown'])]\n", "\n", "df.rename(columns={\n", " 'combinedfact': 'combined_fact',\n", " 'answerKey': 'answer_key' \n", "}, inplace=True)\n", "\n", "\n", "# Drop the index level 0 if it exists\n", "df.reset_index(drop=True, inplace=True)\n", "print(f\"After Cleaning: {len(df)} rows\")" ] }, { "cell_type": "code", "execution_count": 8, "id": "71337823-91b9-4946-95cd-71810f5c5101", "metadata": {}, "outputs": [ { "data": { "text/html": [ "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
formatted_questioncombined_factanswer_keytopicexplanation
0what is satellite technology used for predicti...satellite technology is used for predicting wh...ctechnologya) Seconds and minutes: This option is incorre...
1what does irradiating food do? (a) relieve pai...irradiated food improves food safety.cfood science(a) Relieve pain: This option is not correct b...
2what protects a mammal's skin? (a) fiber folli...fiber follicles protect mammal skinabiologyb) Exfoliation: Exfoliation is the process of ...
3what do earthworms do when a segment breaks of...earthworms can regrow segments that break offbbiologya) Dies: This option is not correct because ea...
4lightning can be bad for what? (a) the environ...lightning can be bad for the environment.aelectricityb) Rainstorms: Lightning is actually a natural...
..................
8408organisms that can cause infection do what? (a...organisms that can cause infection make humans...gbiologya) Bandaging open sores is not the correct ans...
8409fungi are living things that cannot make thei...fungi are living things that cannot make their...abiologyb) Fungi are living things that can make their...
8410an overheated body can use water for: (a) meta...the evaporation of water from the skin cools t...gbiologya) Metabolic reaction: This option is incorrec...
8411what is essential for cellular respiration for...plants are essential for cellular respiration ...fbiologya) Electrons are involved in cellular respirat...
8412what helps insulate and protect the body? (a) ...living cells in follicles help insulate and pr...bbiologya) H2O: Water is essential for life, but it do...
\n", "

8413 rows × 5 columns

\n", "
" ], "text/plain": [ " formatted_question \\\n", "0 what is satellite technology used for predicti... \n", "1 what does irradiating food do? (a) relieve pai... \n", "2 what protects a mammal's skin? (a) fiber folli... \n", "3 what do earthworms do when a segment breaks of... \n", "4 lightning can be bad for what? (a) the environ... \n", "... ... \n", "8408 organisms that can cause infection do what? (a... \n", "8409 fungi are living things that cannot make thei... \n", "8410 an overheated body can use water for: (a) meta... \n", "8411 what is essential for cellular respiration for... \n", "8412 what helps insulate and protect the body? (a) ... \n", "\n", " combined_fact answer_key \\\n", "0 satellite technology is used for predicting wh... c \n", "1 irradiated food improves food safety. c \n", "2 fiber follicles protect mammal skin a \n", "3 earthworms can regrow segments that break off b \n", "4 lightning can be bad for the environment. a \n", "... ... ... \n", "8408 organisms that can cause infection make humans... g \n", "8409 fungi are living things that cannot make their... a \n", "8410 the evaporation of water from the skin cools t... g \n", "8411 plants are essential for cellular respiration ... f \n", "8412 living cells in follicles help insulate and pr... b \n", "\n", " topic explanation \n", "0 technology a) Seconds and minutes: This option is incorre... \n", "1 food science (a) Relieve pain: This option is not correct b... \n", "2 biology b) Exfoliation: Exfoliation is the process of ... \n", "3 biology a) Dies: This option is not correct because ea... \n", "4 electricity b) Rainstorms: Lightning is actually a natural... \n", "... ... ... \n", "8408 biology a) Bandaging open sores is not the correct ans... \n", "8409 biology b) Fungi are living things that can make their... \n", "8410 biology a) Metabolic reaction: This option is incorrec... \n", "8411 biology a) Electrons are involved in cellular respirat... \n", "8412 biology a) H2O: Water is essential for life, but it do... \n", "\n", "[8413 rows x 5 columns]" ] }, "execution_count": 8, "metadata": {}, "output_type": "execute_result" } ], "source": [ "df" ] }, { "cell_type": "markdown", "id": "eb6efb48-1282-4539-a726-450a17fd7f12", "metadata": {}, "source": [ "## Process and Format Questions and Answer Choices\n", "I do some minor cleaning since the original dataset is a bit messy." ] }, { "cell_type": "code", "execution_count": 9, "id": "c3ac53c9-664a-4d8e-9820-7be788d120fa", "metadata": {}, "outputs": [], "source": [ "# Split before the first occurrence of \"(a)\" to separate question and answer choices\n", "df['topic'] = df['topic'].str.capitalize()\n", "df['question_text'] = df['formatted_question'].str.extract(r'^(.*?)(?=\\(a\\)|$)')[0]\n", "df['answer_choices'] = df['formatted_question'].str.extract(r'(\\(a\\).*)$')[0]\n", "\n", "# Function to check if the text needs a question mark\n", "def add_question_mark_if_needed(text):\n", " text = text.strip().capitalize()\n", " if not text.endswith('?'):\n", " return text + '?'\n", " return text\n", "\n", "# Apply the function to the 'question_text' column\n", "df['question_text'] = df['question_text'].apply(add_question_mark_if_needed)\n", "\n", "# Function to capitalize each answer choice item\n", "def capitalize_answer_choices(answer_choices):\n", " import re\n", " pattern = r'\\(([a-z])\\)\\s*([^\\(]+)'\n", " matches = re.findall(pattern, answer_choices)\n", " capitalized_choices = []\n", " for match in matches:\n", " label, text = match\n", " capitalized_choices.append(f'({label}) {text.strip().capitalize()}')\n", " return ' '.join(capitalized_choices)\n", "\n", "# Apply function to format answer choices\n", "df['answer_choices'] = df['answer_choices'].apply(capitalize_answer_choices)" ] }, { "cell_type": "code", "execution_count": 10, "id": "f96ed8a7-77d2-4ee4-b3a1-7dcb30f5966e", "metadata": {}, "outputs": [ { "data": { "text/html": [ "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
formatted_questioncombined_factanswer_keytopicexplanationquestion_textanswer_choices
0what is satellite technology used for predicti...satellite technology is used for predicting wh...cTechnologya) Seconds and minutes: This option is incorre...What is satellite technology used for predicting?(a) Seconds and minutes (b) The strength and m...
1what does irradiating food do? (a) relieve pai...irradiated food improves food safety.cFood science(a) Relieve pain: This option is not correct b...What does irradiating food do?(a) Relieve pain (b) Enhance food's nutrients ...
2what protects a mammal's skin? (a) fiber folli...fiber follicles protect mammal skinaBiologyb) Exfoliation: Exfoliation is the process of ...What protects a mammal's skin?(a) Fiber follicles (b) Exfoliation (c) Resist...
3what do earthworms do when a segment breaks of...earthworms can regrow segments that break offbBiologya) Dies: This option is not correct because ea...What do earthworms do when a segment breaks off?(a) Dies (b) Regrows it (c) Reproduces (d) Sed...
4lightning can be bad for what? (a) the environ...lightning can be bad for the environment.aElectricityb) Rainstorms: Lightning is actually a natural...Lightning can be bad for what?(a) The environment (b) Rainstorms (c) Destruc...
........................
8408organisms that can cause infection do what? (a...organisms that can cause infection make humans...gBiologya) Bandaging open sores is not the correct ans...Organisms that can cause infection do what?(a) Bandage open sores (b) Keep flesh clean (c...
8409fungi are living things that cannot make thei...fungi are living things that cannot make their...aBiologyb) Fungi are living things that can make their...Fungi are living things that cannot make their...(a) Food (b) Cells (c) Energy (d) Fruits (e) H...
8410an overheated body can use water for: (a) meta...the evaporation of water from the skin cools t...gBiologya) Metabolic reaction: This option is incorrec...An overheated body can use water for:?(a) Metabolic reaction (b) Dehydrating (c) Rai...
8411what is essential for cellular respiration for...plants are essential for cellular respiration ...fBiologya) Electrons are involved in cellular respirat...What is essential for cellular respiration for...(a) Electron (b) Glucose (c) Energy (d) Energy...
8412what helps insulate and protect the body? (a) ...living cells in follicles help insulate and pr...bBiologya) H2O: Water is essential for life, but it do...What helps insulate and protect the body?(a) H2o (b) Living cells in follicles (c) Laye...
\n", "

8413 rows × 7 columns

\n", "
" ], "text/plain": [ " formatted_question \\\n", "0 what is satellite technology used for predicti... \n", "1 what does irradiating food do? (a) relieve pai... \n", "2 what protects a mammal's skin? (a) fiber folli... \n", "3 what do earthworms do when a segment breaks of... \n", "4 lightning can be bad for what? (a) the environ... \n", "... ... \n", "8408 organisms that can cause infection do what? (a... \n", "8409 fungi are living things that cannot make thei... \n", "8410 an overheated body can use water for: (a) meta... \n", "8411 what is essential for cellular respiration for... \n", "8412 what helps insulate and protect the body? (a) ... \n", "\n", " combined_fact answer_key \\\n", "0 satellite technology is used for predicting wh... c \n", "1 irradiated food improves food safety. c \n", "2 fiber follicles protect mammal skin a \n", "3 earthworms can regrow segments that break off b \n", "4 lightning can be bad for the environment. a \n", "... ... ... \n", "8408 organisms that can cause infection make humans... g \n", "8409 fungi are living things that cannot make their... a \n", "8410 the evaporation of water from the skin cools t... g \n", "8411 plants are essential for cellular respiration ... f \n", "8412 living cells in follicles help insulate and pr... b \n", "\n", " topic explanation \\\n", "0 Technology a) Seconds and minutes: This option is incorre... \n", "1 Food science (a) Relieve pain: This option is not correct b... \n", "2 Biology b) Exfoliation: Exfoliation is the process of ... \n", "3 Biology a) Dies: This option is not correct because ea... \n", "4 Electricity b) Rainstorms: Lightning is actually a natural... \n", "... ... ... \n", "8408 Biology a) Bandaging open sores is not the correct ans... \n", "8409 Biology b) Fungi are living things that can make their... \n", "8410 Biology a) Metabolic reaction: This option is incorrec... \n", "8411 Biology a) Electrons are involved in cellular respirat... \n", "8412 Biology a) H2O: Water is essential for life, but it do... \n", "\n", " question_text \\\n", "0 What is satellite technology used for predicting? \n", "1 What does irradiating food do? \n", "2 What protects a mammal's skin? \n", "3 What do earthworms do when a segment breaks off? \n", "4 Lightning can be bad for what? \n", "... ... \n", "8408 Organisms that can cause infection do what? \n", "8409 Fungi are living things that cannot make their... \n", "8410 An overheated body can use water for:? \n", "8411 What is essential for cellular respiration for... \n", "8412 What helps insulate and protect the body? \n", "\n", " answer_choices \n", "0 (a) Seconds and minutes (b) The strength and m... \n", "1 (a) Relieve pain (b) Enhance food's nutrients ... \n", "2 (a) Fiber follicles (b) Exfoliation (c) Resist... \n", "3 (a) Dies (b) Regrows it (c) Reproduces (d) Sed... \n", "4 (a) The environment (b) Rainstorms (c) Destruc... \n", "... ... \n", "8408 (a) Bandage open sores (b) Keep flesh clean (c... \n", "8409 (a) Food (b) Cells (c) Energy (d) Fruits (e) H... \n", "8410 (a) Metabolic reaction (b) Dehydrating (c) Rai... \n", "8411 (a) Electron (b) Glucose (c) Energy (d) Energy... \n", "8412 (a) H2o (b) Living cells in follicles (c) Laye... \n", "\n", "[8413 rows x 7 columns]" ] }, "execution_count": 10, "metadata": {}, "output_type": "execute_result" } ], "source": [ "df" ] }, { "cell_type": "markdown", "id": "8d911d0a-2097-4d16-8bd8-c1527ebd20ca", "metadata": {}, "source": [ "## Prompt Creation" ] }, { "cell_type": "markdown", "id": "524aa429-fec5-4ba2-add7-e27b70d44854", "metadata": {}, "source": [ "This is the original prompt from layoric. It looks pretty good and is compatible with falcon.\n", "```\n", "{{#role 'system'~}}\n", "You are an AI assistant that helps people find information. User will give you a question. Your task is to answer as faithfully as you can, and most importantly, provide explanation why incorrect answers are not correct. While answering think step-by-step and justify your answer.\n", "{{~/role}}\n", "{{#role 'user'~}}\n", "USER:\n", "Topic: {{topic}}\n", "Question: {{question}}\n", "\n", "### Answer\n", "The correct answer is:\n", "{{answer_key}}). {{answer}}\n", "\n", "### Explanation:\n", "Let's break it down step by step.\n", "\n", "1. Read the question and options carefully.\n", "2. Identify the differences between the options.\n", "3. Determine which options are not logical based on the difference.\n", "4. Go through each incorrect answer providing an explanation why it is incorrect.\n", "{{~/role}}\n", "\n", "{{#role 'assistant'~}}\n", "{{~gen 'explanation'}}\n", "{{~/role}}\n", "```\n", "Changes:\n", "1. We need to move the system instructions to the user message\n", "2. Let's rename `explanation` to `reasoning`\n", "\n", "We want something like this:" ] }, { "cell_type": "code", "execution_count": 11, "id": "0e6b3afc-8f53-490b-92ca-aec1216f62cc", "metadata": {}, "outputs": [], "source": [ "system_prompt = \"\"\"You are an AI assistant that helps people find information. User will give you a question. Your task is to answer as faithfully as you can, and most importantly, provide explanation why incorrect answers are not correct. While answering think step-by-step and justify your answer.\"\"\"\n", "\n", "def create_reasoning_prompt(row):\n", " reasoning_instructions = f\"\"\"Topic: {row['topic']}\n", "Question: {row['question_text']}\n", "Answer Choices: {row['answer_choices']}\n", "\n", "### Answer\n", "The correct answer is: ({row['answer_key']})\n", "\n", "### Explanation Instructions:\n", "Let's break it down step by step.\n", "\n", "1. Read the question and options carefully.\n", "2. Identify the differences between the options.\n", "3. Determine which options are not logical based on the difference.\n", "4. Go through each incorrect answer providing an explanation why it is incorrect.\n", "\n", "### Explanation\n", "\"\"\"\n", "\n", " return [{\"role\": \"system\", \"content\": system_prompt}, {\"role\": \"user\", \"content\": reasoning_instructions}]\n" ] }, { "cell_type": "markdown", "id": "3e759e97-c046-4fd1-a924-7618d1756588", "metadata": {}, "source": [ "Note that I updated the instructions slightly." ] }, { "cell_type": "code", "execution_count": 12, "id": "1e27e8b4-5cb3-42bf-8b2f-d0627c1d1ae9", "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "[{'role': 'system', 'content': 'You are an AI assistant that helps people find information. User will give you a question. Your task is to answer as faithfully as you can, and most importantly, provide explanation why incorrect answers are not correct. While answering think step-by-step and justify your answer.'}, {'role': 'user', 'content': \"Topic: Technology\\nQuestion: What is satellite technology used for predicting?\\nAnswer Choices: (a) Seconds and minutes (b) The strength and magnitude of an earthquake (c) What it's like outside each day (d) 70-75 degrees fahrenheit (e) Rapid changes occur (f) Dead-ends and false starts. (g) Snow, ice, and rock (h) Around 5 to 27 degrees celsius\\n\\n### Answer\\nThe correct answer is: (c)\\n\\n### Explanation Instructions:\\nLet's break it down step by step.\\n\\n1. Read the question and options carefully.\\n2. Identify the differences between the options.\\n3. Determine which options are not logical based on the difference.\\n4. Go through each incorrect answer providing an explanation why it is incorrect.\\n\\n### Explanation\\n\"}]\n", "\n", "---\n", "\n", "You are an AI assistant that helps people find information. User will give you a question. Your task is to answer as faithfully as you can, and most importantly, provide explanation why incorrect answers are not correct. While answering think step-by-step and justify your answer.\n" ] } ], "source": [ "df['falcon_reasoning_prompt'] = df.apply(create_reasoning_prompt, axis=1)\n", "print(df['falcon_reasoning_prompt'].iloc[0])\n", "print('\\n---\\n')\n", "print(df['falcon_reasoning_prompt'].iloc[0][0]['content'])" ] }, { "cell_type": "code", "execution_count": 13, "id": "1f9c248e-fef9-4194-a567-0ee10be7184d", "metadata": {}, "outputs": [ { "data": { "image/png": "iVBORw0KGgoAAAANSUhEUgAAAkQAAAHHCAYAAABeLEexAAAAOnRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjEwLjAsIGh0dHBzOi8vbWF0cGxvdGxpYi5vcmcvlHJYcgAAAAlwSFlzAAAPYQAAD2EBqD+naQAAP35JREFUeJzt3XdcV/X////7C2U5AAEBeauouXc5yZmaOHM1NLeUDXGkWVm9HVlZ7oZlfsv1bmj2LvPtIFFMTcnSJA0NtSwsRMOFoCLC8/dHP16fXgKKyNJzu14u55LneZ7neR7nqeHdM14vmzHGCAAAwMKciroAAACAokYgAgAAlkcgAgAAlkcgAgAAlkcgAgAAlkcgAgAAlkcgAgAAlkcgAgAAlkcgAgAAlkcgAopYlSpVNGzYsKIu47Y3a9YsVatWTSVKlFDjxo0L9Fhff/21bDabPvvsswI9DoD8QyAC8tHSpUtls9m0e/fubLe3b99e9evXv+njrF+/XlOnTr3pcaxi48aNeuaZZ9SqVSstWbJEr776apY+mSEmN8ut6NKlS5o3b55atGghT09Pubm5qWbNmgoLC9OhQ4eKujxJ0s6dOzV16lSdPXu2qEuBBZUs6gIAq4uNjZWT043922T9+vVasGABoSiXIiMj5eTkpA8++EAuLi7Z9qlTp47+85//OLRNmjRJZcqU0QsvvFAYZRaYxMREdenSRXv27FGPHj308MMPq0yZMoqNjdWKFSu0aNEiXb58uajL1M6dOzVt2jQNGzZMXl5eRV0OLIZABBQxV1fXoi7hhqWkpKh06dJFXUaunTx5Uu7u7jmGIUny9/fXoEGDHNpee+01+fr6Zmm/1QwbNkx79+7VZ599pn79+jlsmz59+i0f+ID8wC0zoIhd/QxRWlqapk2bpho1asjNzU0+Pj5q3bq1IiIiJP39l9uCBQskKdvbOCkpKZowYYIqVaokV1dX1apVS7Nnz5YxxuG4Fy9e1JgxY+Tr66uyZcvqvvvu059//imbzeZw5Wnq1Kmy2Ww6cOCAHn74YZUrV06tW7eWJO3bt0/Dhg1TtWrV5ObmpoCAAI0YMUKnTp1yOFbmGIcOHdKgQYPk6emp8uXL69///reMMTp27Jh69eolDw8PBQQEaM6cObmauytXrmj69Om644475OrqqipVquj5559XamqqvY/NZtOSJUuUkpJin6ulS5fmavzs/Prrr3rggQfk7e2tUqVKqWXLllq3bt1190tNTVWPHj3k6empnTt3SpIyMjI0f/581atXT25ubvL399djjz2mM2fOOOxbpUoV9ejRQ998842aN28uNzc3VatWTcuXL7/ucXft2qV169YpNDQ0SxiS/g7ks2fPdmiLjIxUmzZtVLp0aXl5ealXr146ePCgQ59hw4apSpUqWcbL/L3+J5vNprCwMK1evVr169eXq6ur6tWrp/DwcIf9Jk6cKEmqWrWq/ffqt99+kyRFRESodevW8vLyUpkyZVSrVi09//zz1z1/ILe4QgQUgHPnzikxMTFLe1pa2nX3nTp1qmbMmKFHHnlEzZs3V1JSknbv3q0ffvhB9957rx577DHFx8crIiIiyy0eY4zuu+8+bdmyRaGhoWrcuLG++uorTZw4UX/++afmzZtn7zts2DB9+umnGjx4sFq2bKmtW7eqe/fuOdb1wAMPqEaNGnr11Vft4SoiIkK//vqrhg8froCAAMXExGjRokWKiYnRt99+m+Uvxoceekh16tTRa6+9pnXr1unll1+Wt7e33nvvPXXo0EGvv/66PvroIz399NNq1qyZ2rZte825euSRR7Rs2TLdf//9mjBhgnbt2qUZM2bo4MGD+uKLLyRJ//nPf7Ro0SJ99913ev/99yVJd99993V/H7Jz4sQJ3X333bpw4YLGjBkjHx8fLVu2TPfdd58+++wz9enTJ9v9Ll68qF69emn37t3atGmTmjVrJkl67LHHtHTpUg0fPlxjxozR0aNH9fbbb2vv3r3asWOHnJ2d7WMcOXJE999/v0JDQzV06FAtXrxYw4YNU5MmTVSvXr0ca16zZo0kafDgwbk6x02bNqlr166qVq2apk6dqosXL+qtt95Sq1at9MMPP2QbgnLjm2++0eeff64nn3xSZcuW1Ztvvql+/fopLi5OPj4+6tu3rw4dOqRPPvlE8+bNk6+vrySpfPnyiomJUY8ePdSwYUO99NJLcnV11ZEjR7Rjx4481QJkywDIN0uWLDGSrrnUq1fPYZ+goCAzdOhQ+3qjRo1M9+7dr3mcUaNGmez+9129erWRZF5++WWH9vvvv9/YbDZz5MgRY4wxe/bsMZLMuHHjHPoNGzbMSDJTpkyxt02ZMsVIMgMGDMhyvAsXLmRp++STT4wks23btixjjBw50t525coVU7FiRWOz2cxrr71mbz9z5oxxd3d3mJPsREdHG0nmkUcecWh/+umnjSQTGRlpbxs6dKgpXbr0NcfLTr169Uy7du3s6+PGjTOSzPbt2+1t58+fN1WrVjVVqlQx6enpxhhjtmzZYiSZVatWmfPnz5t27doZX19fs3fvXvt+27dvN5LMRx995HDM8PDwLO1BQUFZ5vTkyZPG1dXVTJgw4Zrn0KdPHyPJnDlzJlfn3LhxY+Pn52dOnTplb/vxxx+Nk5OTGTJkiL1t6NChJigoKMv+mb/X/yTJuLi42P/8ZY4pybz11lv2tlmzZhlJ5ujRow77z5s3z0gyf/31V67OAcgLbpkBBWDBggWKiIjIsjRs2PC6+3p5eSkmJkaHDx++4eOuX79eJUqU0JgxYxzaJ0yYIGOMNmzYIEn2WxVPPvmkQ7/Ro0fnOPbjjz+epc3d3d3+60uXLikxMVEtW7aUJP3www9Z+j/yyCP2X5coUUJNmzaVMUahoaH2di8vL9WqVUu//vprjrVIf5+rJI0fP96hfcKECZKUq9tYN2r9+vVq3ry5/ZahJJUpU0YjR47Ub7/9pgMHDjj0P3funDp37qyff/5ZX3/9tcPr/qtWrZKnp6fuvfdeJSYm2pcmTZqoTJky2rJli8NYdevWVZs2bezr5cuXz9U8JSUlSZLKli173fM7fvy4oqOjNWzYMHl7e9vbGzZsqHvvvdc+53nRqVMn3XHHHQ5jenh4XLd+SfYHrL/88ktlZGTkuQbgWghEQAFo3ry5OnXqlGUpV67cdfd96aWXdPbsWdWsWVMNGjTQxIkTtW/fvlwd9/fff1dgYGCWv/zq1Klj3575XycnJ1WtWtWhX/Xq1XMc++q+knT69GmNHTtW/v7+cnd3V/ny5e39zp07l6V/5cqVHdYzX//OvD3yz/arn6O5WuY5XF1zQECAvLy87Oean37//XfVqlUrS/vV85tp3Lhx+v7777Vp06Yst7UOHz6sc+fOyc/PT+XLl3dYkpOTdfLkSYf+V8+dJJUrV+668+Th4SFJOn/+fK7OT1KO55iYmKiUlJTrjpOdvNYv/X2rtVWrVnrkkUfk7++v/v3769NPPyUcIV/xDBFQzLRt21a//PKLvvzyS23cuFHvv/++5s2bp4ULFzpcYSls/7walOnBBx/Uzp07NXHiRDVu3FhlypRRRkaGunTpku1fViVKlMhVm6QsD4HnpDh/LlCvXr20YsUKvfbaa1q+fLnDxytkZGTIz89PH330Ubb7li9f3mE9r/NUu3ZtSdL+/fsdrjDdrJzmPT09Pdv2m/l9dnd317Zt27RlyxatW7dO4eHhWrlypTp06KCNGzfmODZwI7hCBBRD3t7eGj58uD755BMdO3ZMDRs2dHjzK6e/jIKCghQfH5/lasDPP/9s357534yMDB09etSh35EjR3Jd45kzZ7R582Y999xzmjZtmvr06aN7771X1apVy/UYNyPzHK6+tXjixAmdPXvWfq75fczY2Ngs7VfPb6bevXtr8eLF+vjjjzVq1CiHbXfccYdOnTqlVq1aZXs1sVGjRvlSc8+ePSVJH3744XX7Ztaf0zn6+vraP26hXLly2X6A4s1cmbtWuHVyclLHjh01d+5cHThwQK+88ooiIyOz3FoE8opABBQzV7+yXqZMGVWvXt3hVfLMv5Su/gupW7duSk9P19tvv+3QPm/ePNlsNnXt2lWSFBISIkl65513HPq99dZbua4z81/lV/8Lf/78+bke42Z069Yt2+PNnTtXkq75xtzNHPO7775TVFSUvS0lJUWLFi1SlSpVVLdu3Sz7DBkyRG+++aYWLlyoZ5991t7+4IMPKj09XdOnT8+yz5UrV/Lt05qDg4PVpUsXvf/++1q9enWW7ZcvX9bTTz8tSapQoYIaN26sZcuWORz/p59+0saNG+1zLv0d6M6dO+dwO/f48eP2t/vyIqc/16dPn87SN/N5rH/+fwHcDG6ZAcVM3bp11b59ezVp0kTe3t7avXu3PvvsM4WFhdn7NGnSRJI0ZswYhYSEqESJEurfv7969uype+65Ry+88IJ+++03NWrUSBs3btSXX36pcePG2R9qbdKkifr166f58+fr1KlT9tfuM7/CITe3oTw8PNS2bVvNnDlTaWlp+te//qWNGzdmuepUUBo1aqShQ4dq0aJFOnv2rNq1a6fvvvtOy5YtU+/evXXPPffk+zGfe+45ffLJJ+ratavGjBkjb29vLVu2TEePHtV///vfHD9xPCwsTElJSXrhhRfk6emp559/Xu3atdNjjz2mGTNmKDo6Wp07d5azs7MOHz6sVatW6Y033tD999+fL3UvX75cnTt3Vt++fdWzZ0917NhRpUuX1uHDh7VixQodP37c/llEs2bNUteuXRUcHKzQ0FD7a/eenp4OVyn79++vZ599Vn369NGYMWN04cIFvfvuu6pZs2a2D9TnRuaf6xdeeEH9+/eXs7OzevbsqZdeeknbtm1T9+7dFRQUpJMnT+qdd95RxYoVHR5wB25KUb7iBtxuMl+7//7777Pd3q5du+u+dv/yyy+b5s2bGy8vL+Pu7m5q165tXnnlFXP58mV7nytXrpjRo0eb8uXLG5vN5vCa8/nz581TTz1lAgMDjbOzs6lRo4aZNWuWycjIcDhuSkqKGTVqlPH29jZlypQxvXv3NrGxsUaSw2vwma9RZ/fK8x9//GH69OljvLy8jKenp3nggQdMfHx8jq/uXz1GTq/DZzdP2UlLSzPTpk0zVatWNc7OzqZSpUpm0qRJ5tKlS7k6zvVc/dq9Mcb88ssv5v777zdeXl7Gzc3NNG/e3Kxdu9ahzz9fu/+nZ555xkgyb7/9tr1t0aJFpkmTJsbd3d2ULVvWNGjQwDzzzDMmPj7e3icoKCjbj2Jo165dlvpycuHCBTN79mzTrFkzU6ZMGePi4mJq1KhhRo8e7fA6vDHGbNq0ybRq1cq4u7sbDw8P07NnT3PgwIEsY27cuNHUr1/fuLi4mFq1apkPP/wwx9fuR40alWX/q//sG2PM9OnTzb/+9S/j5ORkfwV/8+bNplevXiYwMNC4uLiYwMBAM2DAAHPo0KFcnTuQGzZjcvnkIoDbXnR0tO688059+OGHGjhwYFGXAwCFhmeIAIu6ePFilrb58+fLycnpup8QDQC3G54hAixq5syZ2rNnj+655x6VLFlSGzZs0IYNGzRy5EhVqlSpqMsDgELFLTPAoiIiIjRt2jQdOHBAycnJqly5sgYPHqwXXnhBJUvybyUA1kIgAgAAlsczRAAAwPIIRAAAwPJ4UCAXMjIyFB8fr7Jlyxbr700CAAD/xxij8+fPKzAwMMcPTs1EIMqF+Ph43roBAOAWdezYMVWsWPGafQhEuVC2bFlJf0+oh4dHEVcDAAByIykpSZUqVbL/PX4tBKJcyLxN5uHhQSACAOAWk5vHXXioGgAAWB6BCAAAWB6BCAAAWB6BCAAAWB6BCAAAWB6BCAAAWB6BCAAAWB6BCAAAWB6BCAAAWB6BCAAAWB6BCAAAWB6BCAAAWB6BCAAAWB6BCAAAWF7Joi4ABScuLk6JiYkFMnZqaqpcXV0LZGxfX19Vrly5QMYGACA7BKLbVFxcnGrVrqNLFy8UzAFsTpLJKJCh3dxLKfbng4QiAEChIRDdphITE3Xp4gX59JggZ59K+Tr2xV9369z2Dwtk7LRTx3Rq7RwlJiYSiAAAhYZAdJtz9qkk14Dq+Tpm2qljBTY2AABFgYeqAQCA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RGIAACA5RVpIJoxY4aaNWumsmXLys/PT71791ZsbKxDn0uXLmnUqFHy8fFRmTJl1K9fP504ccKhT1xcnLp3765SpUrJz89PEydO1JUrVxz6fP3117rrrrvk6uqq6tWra+nSpQV9egAA4BZRpIFo69atGjVqlL799ltFREQoLS1NnTt3VkpKir3PU089pf/9739atWqVtm7dqvj4ePXt29e+PT09Xd27d9fly5e1c+dOLVu2TEuXLtXkyZPtfY4eParu3bvrnnvuUXR0tMaNG6dHHnlEX331VaGeLwAAKJ5KFuXBw8PDHdaXLl0qPz8/7dmzR23bttW5c+f0wQcf6OOPP1aHDh0kSUuWLFGdOnX07bffqmXLltq4caMOHDigTZs2yd/fX40bN9b06dP17LPPaurUqXJxcdHChQtVtWpVzZkzR5JUp04dffPNN5o3b55CQkIK/bwBAEDxUqyeITp37pwkydvbW5K0Z88epaWlqVOnTvY+tWvXVuXKlRUVFSVJioqKUoMGDeTv72/vExISoqSkJMXExNj7/HOMzD6ZYwAAAGsr0itE/5SRkaFx48apVatWql+/viQpISFBLi4u8vLycujr7++vhIQEe59/hqHM7ZnbrtUnKSlJFy9elLu7u8O21NRUpaam2teTkpJu/gQBAECxVWyuEI0aNUo//fSTVqxYUdSlaMaMGfL09LQvlSpVKuqSAABAASoWgSgsLExr167Vli1bVLFiRXt7QECALl++rLNnzzr0P3HihAICAux9rn7rLHP9en08PDyyXB2SpEmTJuncuXP25dixYzd9jgAAoPgq0kBkjFFYWJi++OILRUZGqmrVqg7bmzRpImdnZ23evNneFhsbq7i4OAUHB0uSgoODtX//fp08edLeJyIiQh4eHqpbt669zz/HyOyTOcbVXF1d5eHh4bAAAIDbV5E+QzRq1Ch9/PHH+vLLL1W2bFn7Mz+enp5yd3eXp6enQkNDNX78eHl7e8vDw0OjR49WcHCwWrZsKUnq3Lmz6tatq8GDB2vmzJlKSEjQiy++qFGjRsnV1VWS9Pjjj+vtt9/WM888oxEjRigyMlKffvqp1q1bV2TnDgAAio8ivUL07rvv6ty5c2rfvr0qVKhgX1auXGnvM2/ePPXo0UP9+vVT27ZtFRAQoM8//9y+vUSJElq7dq1KlCih4OBgDRo0SEOGDNFLL71k71O1alWtW7dOERERatSokebMmaP333+fV+4BAICkIr5CZIy5bh83NzctWLBACxYsyLFPUFCQ1q9ff81x2rdvr717995wjQAA4PZXLB6qBgAAKEoEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHlFGoi2bdumnj17KjAwUDabTatXr3bYPmzYMNlsNoelS5cuDn1Onz6tgQMHysPDQ15eXgoNDVVycrJDn3379qlNmzZyc3NTpUqVNHPmzII+NQAAcAsp0kCUkpKiRo0aacGCBTn26dKli44fP25fPvnkE4ftAwcOVExMjCIiIrR27Vpt27ZNI0eOtG9PSkpS586dFRQUpD179mjWrFmaOnWqFi1aVGDnBQAAbi0li/LgXbt2VdeuXa/Zx9XVVQEBAdluO3jwoMLDw/X999+radOmkqS33npL3bp10+zZsxUYGKiPPvpIly9f1uLFi+Xi4qJ69eopOjpac+fOdQhOAADAuor9M0Rff/21/Pz8VKtWLT3xxBM6deqUfVtUVJS8vLzsYUiSOnXqJCcnJ+3atcvep23btnJxcbH3CQkJUWxsrM6cOZPtMVNTU5WUlOSwAACA21exDkRdunTR8uXLtXnzZr3++uvaunWrunbtqvT0dElSQkKC/Pz8HPYpWbKkvL29lZCQYO/j7+/v0CdzPbPP1WbMmCFPT0/7UqlSpfw+NQAAUIwU6S2z6+nfv7/91w0aNFDDhg11xx136Ouvv1bHjh0L7LiTJk3S+PHj7etJSUmEIgAAbmPF+grR1apVqyZfX18dOXJEkhQQEKCTJ0869Lly5YpOnz5tf+4oICBAJ06ccOiTuZ7Ts0murq7y8PBwWAAAwO3rlgpEf/zxh06dOqUKFSpIkoKDg3X27Fnt2bPH3icyMlIZGRlq0aKFvc+2bduUlpZm7xMREaFatWqpXLlyhXsCAACgWCrSQJScnKzo6GhFR0dLko4eParo6GjFxcUpOTlZEydO1LfffqvffvtNmzdvVq9evVS9enWFhIRIkurUqaMuXbro0Ucf1XfffacdO3YoLCxM/fv3V2BgoCTp4YcflouLi0JDQxUTE6OVK1fqjTfecLglBgAArK1IA9Hu3bt155136s4775QkjR8/XnfeeacmT56sEiVKaN++fbrvvvtUs2ZNhYaGqkmTJtq+fbtcXV3tY3z00UeqXbu2OnbsqG7duql169YOnzHk6empjRs36ujRo2rSpIkmTJigyZMn88o9AACwy9ND1b/++quqVat20wdv3769jDE5bv/qq6+uO4a3t7c+/vjja/Zp2LChtm/ffsP1AQAAa8hTIKpevbratWun0NBQ3X///XJzc8vvumBxBw8ezPcxfX19Vbly5XwfFwBw68tTIPrhhx+0ZMkSjR8/XmFhYXrooYcUGhqq5s2b53d9sJj05DOSzaZBgwbl+9hu7qUU+/NBQhEAIIs8BaLGjRvrjTfe0Jw5c7RmzRotXbpUrVu3Vs2aNTVixAgNHjxY5cuXz+9aYQEZqcmSMfLpMUHOPvn32U9pp47p1No5SkxMJBABALK4qQ9mLFmypPr27avu3bvrnXfe0aRJk/T000/r+eef14MPPqjXX3/d/oo8cCOcfSrJNaB6UZcBALCIm3rLbPfu3XryySdVoUIFzZ07V08//bR++eUXRUREKD4+Xr169cqvOgEAAApMnq4QzZ07V0uWLFFsbKy6deum5cuXq1u3bnJy+jtfVa1aVUuXLlWVKlXys1YAAIACkadA9O6772rEiBEaNmxYjrfE/Pz89MEHH9xUcQAAAIUhT4Ho8OHD1+3j4uKioUOH5mV4AACAQpWnZ4iWLFmiVatWZWlftWqVli1bdtNFAQAAFKY8BaIZM2bI19c3S7ufn59effXVmy4KAACgMOUpEMXFxalq1apZ2oOCghQXF3fTRQEAABSmPAUiPz8/7du3L0v7jz/+KB8fn5suCgAAoDDlKRANGDBAY8aM0ZYtW5Senq709HRFRkZq7Nix6t+/f37XCAAAUKDy9JbZ9OnT9dtvv6ljx44qWfLvITIyMjRkyBCeIQIAALecPAUiFxcXrVy5UtOnT9ePP/4od3d3NWjQQEFBQfldHwAAQIG7qe8yq1mzpmrWrJlftQAAABSJPAWi9PR0LV26VJs3b9bJkyeVkZHhsD0yMjJfigMAACgMeQpEY8eO1dKlS9W9e3fVr19fNpstv+sCAAAoNHkKRCtWrNCnn36qbt265Xc9AAAAhS5Pr927uLioevXq+V0LAABAkchTIJowYYLeeOMNGWPyux4AAIBCl6dbZt988422bNmiDRs2qF69enJ2dnbY/vnnn+dLcQAAAIUhT4HIy8tLffr0ye9aAAAAikSeAtGSJUvyuw4AAIAik6dniCTpypUr2rRpk9577z2dP39ekhQfH6/k5OR8Kw4AAKAw5OkK0e+//64uXbooLi5Oqampuvfee1W2bFm9/vrrSk1N1cKFC/O7TgAAgAKTpytEY8eOVdOmTXXmzBm5u7vb2/v06aPNmzfnW3EAAACFIU9XiLZv366dO3fKxcXFob1KlSr6888/86UwAACAwpKnK0QZGRlKT0/P0v7HH3+obNmyN10UAABAYcpTIOrcubPmz59vX7fZbEpOTtaUKVP4Og8AAHDLydMtszlz5igkJER169bVpUuX9PDDD+vw4cPy9fXVJ598kt81AgAAFKg8BaKKFSvqxx9/1IoVK7Rv3z4lJycrNDRUAwcOdHjIGgAA4FaQp0AkSSVLltSgQYPysxYAAIAikadAtHz58mtuHzJkSJ6KAQAAKAp5CkRjx451WE9LS9OFCxfk4uKiUqVKEYgAAMAtJU9vmZ05c8ZhSU5OVmxsrFq3bs1D1QAA4JaT5+8yu1qNGjX02muvZbl6BAAAUNzlWyCS/n7QOj4+Pj+HBAAAKHB5eoZozZo1DuvGGB0/flxvv/22WrVqlS+FAQAAFJY8BaLevXs7rNtsNpUvX14dOnTQnDlz8qMuAACAQpOnQJSRkZHfdQAAABSZfH2GCAAA4FaUpytE48ePz3XfuXPn5uUQAAAAhSZPgWjv3r3au3ev0tLSVKtWLUnSoUOHVKJECd111132fjabLX+qBAAAKEB5CkQ9e/ZU2bJltWzZMpUrV07S3x/WOHz4cLVp00YTJkzI1yIBAAAKUp6eIZozZ45mzJhhD0OSVK5cOb388su8ZQYAAG45eQpESUlJ+uuvv7K0//XXXzp//vxNFwUAAFCY8hSI+vTpo+HDh+vzzz/XH3/8oT/++EP//e9/FRoaqr59++Z3jQAAAAUqT88QLVy4UE8//bQefvhhpaWl/T1QyZIKDQ3VrFmz8rVAAACAgpanQFSqVCm98847mjVrln755RdJ0h133KHSpUvna3EAAACF4aY+mPH48eM6fvy4atSoodKlS8sYk191AQAAFJo8BaJTp06pY8eOqlmzprp166bjx49LkkJDQ3nlHgAA3HLyFIieeuopOTs7Ky4uTqVKlbK3P/TQQwoPD8+34gAAAApDnp4h2rhxo7766itVrFjRob1GjRr6/fff86UwAACAwpKnK0QpKSkOV4YynT59Wq6urjddFAAAQGHKUyBq06aNli9fbl+32WzKyMjQzJkzdc899+RbcQAAAIUhT7fMZs6cqY4dO2r37t26fPmynnnmGcXExOj06dPasWNHftcIAABQoPJ0hah+/fo6dOiQWrdurV69eiklJUV9+/bV3r17dccdd+R3jQAAAAXqhq8QpaWlqUuXLlq4cKFeeOGFgqgJAACgUN3wFSJnZ2ft27evIGoBAAAoEnm6ZTZo0CB98MEH+V0LAABAkcjTQ9VXrlzR4sWLtWnTJjVp0iTLd5jNnTs3X4oDAAAoDDcUiH799VdVqVJFP/30k+666y5J0qFDhxz62Gy2/KsOAACgENzQLbMaNWooMTFRW7Zs0ZYtW+Tn56cVK1bY17ds2aLIyMhcj7dt2zb17NlTgYGBstlsWr16tcN2Y4wmT56sChUqyN3dXZ06ddLhw4cd+pw+fVoDBw6Uh4eHvLy8FBoaquTkZIc++/btU5s2beTm5qZKlSpp5syZN3LaAADgNndDgejqb7PfsGGDUlJS8nzwlJQUNWrUSAsWLMh2+8yZM/Xmm29q4cKF2rVrl0qXLq2QkBBdunTJ3mfgwIGKiYlRRESE1q5dq23btmnkyJH27UlJSercubOCgoK0Z88ezZo1S1OnTtWiRYvyXDcAALi95OkZokxXB6Qb1bVrV3Xt2jXHsefPn68XX3xRvXr1kiQtX75c/v7+Wr16tfr376+DBw8qPDxc33//vZo2bSpJeuutt9StWzfNnj1bgYGB+uijj3T58mUtXrxYLi4uqlevnqKjozV37lyH4AQAAKzrhq4Q2Wy2LM8IFdQzQ0ePHlVCQoI6depkb/P09FSLFi0UFRUlSYqKipKXl5c9DElSp06d5OTkpF27dtn7tG3bVi4uLvY+ISEhio2N1ZkzZwqkdgAAcGu5oStExhgNGzbM/gWuly5d0uOPP57lLbPPP//8pgtLSEiQJPn7+zu0+/v727clJCTIz8/PYXvJkiXl7e3t0Kdq1apZxsjcVq5cuSzHTk1NVWpqqn09KSnpJs8GAAAUZzcUiIYOHeqwPmjQoHwtpriYMWOGpk2bVtRlAACAQnJDgWjJkiUFVUcWAQEBkqQTJ06oQoUK9vYTJ06ocePG9j4nT5502O/KlSs6ffq0ff+AgACdOHHCoU/memafq02aNEnjx4+3ryclJalSpUo3d0IAAKDYytMnVReGqlWrKiAgQJs3b7a3JSUladeuXQoODpYkBQcH6+zZs9qzZ4+9T2RkpDIyMtSiRQt7n23btiktLc3eJyIiQrVq1cr2dpkkubq6ysPDw2EBAAC3ryINRMnJyYqOjlZ0dLSkvx+kjo6OVlxcnGw2m8aNG6eXX35Za9as0f79+zVkyBAFBgaqd+/ekqQ6deqoS5cuevTRR/Xdd99px44dCgsLU//+/RUYGChJevjhh+Xi4qLQ0FDFxMRo5cqVeuONNxyuAAEAAGu7qdfub9bu3bt1zz332NczQ8rQoUO1dOlSPfPMM0pJSdHIkSN19uxZtW7dWuHh4XJzc7Pv89FHHyksLEwdO3aUk5OT+vXrpzfffNO+3dPTUxs3btSoUaPUpEkT+fr6avLkybxyDwAA7Io0ELVv3/6an2Vks9n00ksv6aWXXsqxj7e3tz7++ONrHqdhw4bavn17nusEAAC3t2L7DBEAAEBhIRABAADLIxABAADLIxABAADLIxABAADLIxABAADLIxABAADLIxABAADLIxABAADLIxABAADLIxABAADLIxABAADLIxABAADLIxABAADLIxABAADLIxABAADLIxABAADLIxABAADLIxABAADLIxABAADLIxABAADLIxABAADLIxABAADLIxABAADLK1nUBQCF6eDBgwUyrq+vrypXrlwgYwMACh6BCJaQnnxGstk0aNCgAhnfzb2UYn8+SCgCgFsUgQiWkJGaLBkjnx4T5OxTKV/HTjt1TKfWzlFiYiKBCABuUQQiWIqzTyW5BlQv6jIAAMUMgagYiIuLU2JiYr6OWVDPygAAcDsiEBWxuLg41apdR5cuXijqUgAAsCwCURFLTEzUpYsX8v3Zlou/7ta57R/m23gAANzOCETFRH4/25J26li+jQUAwO2OD2YEAACWRyACAACWRyACAACWRyACAACWRyACAACWRyACAACWRyACAACWRyACAACWRyACAACWRyACAACWRyACAACWRyACAACWRyACAACWRyACAACWRyACAACWRyACAACWRyACAACWRyACAACWRyACAACWRyACAACWRyACAACWRyACAACWRyACAACWRyACAACWRyACAACWRyACAACWRyACAACWRyACAACWRyACAACWRyACAACWRyACAACWRyACAACWV6wD0dSpU2Wz2RyW2rVr27dfunRJo0aNko+Pj8qUKaN+/frpxIkTDmPExcWpe/fuKlWqlPz8/DRx4kRduXKlsE8FAAAUYyWLuoDrqVevnjZt2mRfL1ny/0p+6qmntG7dOq1atUqenp4KCwtT3759tWPHDklSenq6unfvroCAAO3cuVPHjx/XkCFD5OzsrFdffbXQzwUAABRPxT4QlSxZUgEBAVnaz507pw8++EAff/yxOnToIElasmSJ6tSpo2+//VYtW7bUxo0bdeDAAW3atEn+/v5q3Lixpk+frmeffVZTp06Vi4tLYZ8OAAAohor1LTNJOnz4sAIDA1WtWjUNHDhQcXFxkqQ9e/YoLS1NnTp1svetXbu2KleurKioKElSVFSUGjRoIH9/f3ufkJAQJSUlKSYmJsdjpqamKikpyWEBAAC3r2IdiFq0aKGlS5cqPDxc7777ro4ePao2bdro/PnzSkhIkIuLi7y8vBz28ff3V0JCgiQpISHBIQxlbs/clpMZM2bI09PTvlSqVCl/TwwAABQrxfqWWdeuXe2/btiwoVq0aKGgoCB9+umncnd3L7DjTpo0SePHj7evJyUlEYoAALiNFesrRFfz8vJSzZo1deTIEQUEBOjy5cs6e/asQ58TJ07YnzkKCAjI8tZZ5np2zyVlcnV1lYeHh8MCAABuX7dUIEpOTtYvv/yiChUqqEmTJnJ2dtbmzZvt22NjYxUXF6fg4GBJUnBwsPbv36+TJ0/a+0RERMjDw0N169Yt9PoBAEDxVKxvmT399NPq2bOngoKCFB8frylTpqhEiRIaMGCAPD09FRoaqvHjx8vb21seHh4aPXq0goOD1bJlS0lS586dVbduXQ0ePFgzZ85UQkKCXnzxRY0aNUqurq5FfHYAAKC4KNaB6I8//tCAAQN06tQplS9fXq1bt9a3336r8uXLS5LmzZsnJycn9evXT6mpqQoJCdE777xj379EiRJau3atnnjiCQUHB6t06dIaOnSoXnrppaI6JQAAUAwV60C0YsWKa253c3PTggULtGDBghz7BAUFaf369fldGgAAuI3cUs8QAQAAFAQCEQAAsDwCEQAAsDwCEQAAsDwCEQAAsDwCEQAAsDwCEQAAsLxi/TlEwK3k4MGD+T6mr6+vKleunO/jAgAcEYiAm5SefEay2TRo0KB8H9vNvZRifz5IKAKAAkYgAm5SRmqyZIx8ekyQs0+lfBs37dQxnVo7R4mJiQQiAChgBCIgnzj7VJJrQPWiLgMAkAc8VA0AACyPQAQAACyPQAQAACyPQAQAACyPQAQAACyPQAQAACyPQAQAACyPQAQAACyPQAQAACyPQAQAACyPQAQAACyPQAQAACyPQAQAACyPQAQAACyPQAQAACyPQAQAACyPQAQAACyPQAQAACyPQAQAACyPQAQAACyPQAQAACyPQAQAACyPQAQAACyPQAQAACyPQAQAACyPQAQAACyPQAQAACyPQAQAACyvZFEXAODaDh48WCDj+vr6qnLlygUyNgDcaghEQDGVnnxGstk0aNCgAhnfzb2UYn8+SCgCABGIgGIrIzVZMkY+PSbI2adSvo6dduqYTq2do8TERAIRAIhABBR7zj6V5BpQvajLAIDbGg9VAwAAyyMQAQAAyyMQAQAAyyMQAQAAyyMQAQAAyyMQAQAAyyMQAQAAyyMQAQAAyyMQAQAAyyMQAQAAyyMQAQAAyyMQAQAAyyMQAQAAy+Pb7gELO3jwYL6P6evrq8qVK+f7uABQkAhEgAWlJ5+RbDYNGjQo38d2cy+l2J8PEooA3FIIRIAFZaQmS8bIp8cEOftUyrdx004d06m1c5SYmEggAnBLIRABFubsU0muAdWLugwAKHI8VA0AACyPQAQAACyPW2YA8l1BvL0m8QYbgIJjqUC0YMECzZo1SwkJCWrUqJHeeustNW/evKjLAm4bBfn2msQbbAAKjmUC0cqVKzV+/HgtXLhQLVq00Pz58xUSEqLY2Fj5+fkVdXnAbaGg3l6TeIMNQMGyTCCaO3euHn30UQ0fPlyStHDhQq1bt06LFy/Wc889V8TVAbeXgnx7jQ+TBFAQLBGILl++rD179mjSpEn2NicnJ3Xq1ElRUVFFWBmA3OLDJAEUJEsEosTERKWnp8vf39+h3d/fXz///HOW/qmpqUpNTbWvnzt3TpKUlJSU77UlJyf/fcyEI8q4fCnfxk07daxAxr1Vx6bmwhm7IGtOjT8oGSOPZn1VwrN8vo2bfu4vJX3/ub766ivVqlUr38bN5OTkpIyMjFtm3Ft1bGounLELsuaAgAAFBATk65iZf28bY67f2VjAn3/+aSSZnTt3OrRPnDjRNG/ePEv/KVOmGEksLCwsLCwst8Fy7Nix62YFS1wh8vX1VYkSJXTixAmH9hMnTmSbRidNmqTx48fb1zMyMnT69Gn5+PjIZrMVeL23uqSkJFWqVEnHjh2Th4dHUZdz22F+Cx5zXLCY34LHHP/NGKPz588rMDDwun0tEYhcXFzUpEkTbd68Wb1795b0d8jZvHmzwsLCsvR3dXWVq6urQ5uXl1chVHp78fDwsPT/iAWN+S14zHHBYn4LHnMseXp65qqfJQKRJI0fP15Dhw5V06ZN1bx5c82fP18pKSn2t84AAIB1WSYQPfTQQ/rrr780efJkJSQkqHHjxgoPD8/yoDUAALAeywQiSQoLC8v2Fhnyl6urq6ZMmZLltiPyB/Nb8JjjgsX8Fjzm+MbZjMnNu2gAAAC3L77tHgAAWB6BCAAAWB6BCAAAWB6BCAAAWB6BCLkyY8YMNWvWTGXLlpWfn5969+6t2NhY+/bTp09r9OjRqlWrltzd3VW5cmWNGTPG/j1wmeLi4tS9e3eVKlVKfn5+mjhxoq5cuVLYp1PsXG9+/8kYo65du8pms2n16tUO25jfnOV2jqOiotShQweVLl1aHh4eatu2rS5evGjffvr0aQ0cOFAeHh7y8vJSaGio/TsJrSw385uQkKDBgwcrICBApUuX1l133aX//ve/Dn2Y35y9++67atiwof3DFoODg7Vhwwb79kuXLmnUqFHy8fFRmTJl1K9fvyzf0MDPiJwRiJArW7du1ahRo/Ttt98qIiJCaWlp6ty5s1JSUiRJ8fHxio+P1+zZs/XTTz9p6dKlCg8PV2hoqH2M9PR0de/eXZcvX9bOnTu1bNkyLV26VJMnTy6q0yo2rje//zR//vxsv0KG+b223MxxVFSUunTpos6dO+u7777T999/r7CwMDk5/d+PyoEDByomJkYRERFau3attm3bppEjRxbFKRUruZnfIUOGKDY2VmvWrNH+/fvVt29fPfjgg9q7d6+9D/Obs4oVK+q1117Tnj17tHv3bnXo0EG9evVSTEyMJOmpp57S//73P61atUpbt25VfHy8+vbta9+fnxHXkS/fngrLOXnypJFktm7dmmOfTz/91Li4uJi0tDRjjDHr1683Tk5OJiEhwd7n3XffNR4eHiY1NbXAa76V5DS/e/fuNf/617/M8ePHjSTzxRdf2Lcxvzcmuzlu0aKFefHFF3Pc58CBA0aS+f777+1tGzZsMDabzfz5558FWu+tJrv5LV26tFm+fLlDP29vb/P//t//M8Ywv3lRrlw58/7775uzZ88aZ2dns2rVKvu2gwcPGkkmKirKGMPPiOvhChHyJPNWmLe39zX7eHh4qGTJvz//MyoqSg0aNHD4dPCQkBAlJSXZ/4WDv2U3vxcuXNDDDz+sBQsWZPulxMzvjbl6jk+ePKldu3bJz89Pd999t/z9/dWuXTt988039n2ioqLk5eWlpk2b2ts6deokJycn7dq1q3BPoJjL7s/w3XffrZUrV+r06dPKyMjQihUrdOnSJbVv314S83sj0tPTtWLFCqWkpCg4OFh79uxRWlqaOnXqZO9Tu3ZtVa5cWVFRUZL4GXE9BCLcsIyMDI0bN06tWrVS/fr1s+2TmJio6dOnO1zqTkhIyPJVKZnrCQkJBVfwLSan+X3qqad09913q1evXtnux/zmXnZz/Ouvv0qSpk6dqkcffVTh4eG666671LFjRx0+fFjS3/Po5+fnMFbJkiXl7e3NHP9DTn+GP/30U6WlpcnHx0eurq567LHH9MUXX6h69eqSmN/c2L9/v8qUKSNXV1c9/vjj+uKLL1S3bl0lJCTIxcUlyxeR+/v72+eOnxHXZqmv7kD+GDVqlH766SeHfzn/U1JSkrp37666detq6tSphVvcbSC7+V2zZo0iIyMdnrVA3mU3xxkZGZKkxx57zP6lz3feeac2b96sxYsXa8aMGUVS660op58R//73v3X27Flt2rRJvr6+Wr16tR588EFt375dDRo0KKJqby21atVSdHS0zp07p88++0xDhw7V1q1bi7qs2wJXiHBDwsLCtHbtWm3ZskUVK1bMsv38+fPq0qWLypYtqy+++ELOzs72bQEBAVneeMhcz+4WkBXlNL+RkZH65Zdf5OXlpZIlS9pvQ/br189+u4H5zZ2c5rhChQqSpLp16zr0r1OnjuLi4iT9PY8nT5502H7lyhWdPn2aOf7/5TS/v/zyi95++20tXrxYHTt2VKNGjTRlyhQ1bdpUCxYskMT85oaLi4uqV6+uJk2aaMaMGWrUqJHeeOMNBQQE6PLlyzp79qxD/xMnTtjnjp8R10YgQq4YYxQWFqYvvvhCkZGRqlq1apY+SUlJ6ty5s1xcXLRmzRq5ubk5bA8ODtb+/fsdfuBFRETIw8Mjy19CVnO9+X3uuee0b98+RUdH2xdJmjdvnpYsWSKJ+b2e681xlSpVFBgYmOVV8UOHDikoKEjS33N89uxZ7dmzx749MjJSGRkZatGiRcGfRDF2vfm9cOGCJDm8sSdJJUqUsF+dY35vXEZGhlJTU9WkSRM5Oztr8+bN9m2xsbGKi4tTcHCwJH5GXFfRPtONW8UTTzxhPD09zddff22OHz9uXy5cuGCMMebcuXOmRYsWpkGDBubIkSMOfa5cuWKMMebKlSumfv36pnPnziY6OtqEh4eb8uXLm0mTJhXlqRUL15vf7Oiqt8yY32vLzRzPmzfPeHh4mFWrVpnDhw+bF1980bi5uZkjR47Y+3Tp0sXceeedZteuXeabb74xNWrUMAMGDCiKUypWrje/ly9fNtWrVzdt2rQxu3btMkeOHDGzZ882NpvNrFu3zj4O85uz5557zmzdutUcPXrU7Nu3zzz33HPGZrOZjRs3GmOMefzxx03lypVNZGSk2b17twkODjbBwcH2/fkZcW0EIuSKpGyXJUuWGGOM2bJlS459jh49ah/nt99+M127djXu7u7G19fXTJgwwf5avpVdb35z2uefgcgY5vdacjvHM2bMMBUrVjSlSpUywcHBZvv27Q7bT506ZQYMGGDKlCljPDw8zPDhw8358+cL8UyKp9zM76FDh0zfvn2Nn5+fKVWqlGnYsGGW1/CZ35yNGDHCBAUFGRcXF1O+fHnTsWNHexgyxpiLFy+aJ5980pQrV86UKlXK9OnTxxw/ftxhDH5G5MxmjDEFfx0KAACg+OIZIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgAAYHkEIgDF0m+//SabzWb/mhIAKEgEIgAFxmazXXOZOnVqUZeYrSNHjmj48OGqWLGiXF1dVbVqVQ0YMEC7d+8u1DoIhUDhKVnUBQC4fR0/ftz+65UrV2ry5MkOX55apkyZoijrmnbv3q2OHTuqfv36eu+991S7dm2dP39eX375pSZMmKCtW7cWdYkACgBXiAAUmICAAPvi6ekpm81mX/fz89PcuXPtV2EaN26s8PDwHMdKT0/XiBEjVLt2bcXFxUmSvvzyS911111yc3NTtWrVNG3aNF25csW+j81m0/vvv68+ffqoVKlSqlGjhtasWZPjMYwxGjZsmGrUqKHt27ere/fuuuOOO9S4cWNNmTJFX375pb3v/v371aFDB7m7u8vHx0cjR45UcnKyfXv79u01btw4h/F79+6tYcOG2derVKmiV199VSNGjFDZsmVVuXJlLVq0yL498xvj77zzTtlsNrVv3/6a8w0g7whEAIrEG2+8oTlz5mj27Nnat2+fQkJCdN999+nw4cNZ+qampuqBBx5QdHS0tm/frsqVK2v79u0aMmSIxo4dqwMHDui9997T0qVL9corrzjsO23aND344IPat2+funXrpoEDB+r06dPZ1hQdHa2YmBhNmDBBTk5Zfzx6eXlJklJSUhQSEqJy5crp+++/16pVq7Rp0yaFhYXd8DzMmTNHTZs21d69e/Xkk0/qiSeesF9F++677yRJmzZt0vHjx/X555/f8PgAcqmIv1wWgEUsWbLEeHp62tcDAwPNK6+84tCnWbNm5sknnzTGGHP06FEjyWzfvt107NjRtG7d2pw9e9bet2PHjubVV1912P8///mPqVChgn1dknnxxRft68nJyUaS2bBhQ7Y1rly50kgyP/zwwzXPZdGiRaZcuXImOTnZ3rZu3Trj5ORkEhISjDHGtGvXzowdO9Zhv169epmhQ4fa14OCgsygQYPs6xkZGcbPz8+8++67DnOwd+/ea9YD4ObxDBGAQpeUlKT4+Hi1atXKob1Vq1b68ccfHdoGDBigihUrKjIyUu7u7vb2H3/8UTt27HC4IpSenq5Lly7pwoULKlWqlCSpYcOG9u2lS5eWh4eHTp48mW1dxphc1X/w4EE1atRIpUuXdqg9IyNDsbGx8vf3z9U4V9eXeUsxp/oAFBxumQEo1rp166Z9+/YpKirKoT05OVnTpk1TdHS0fdm/f78OHz4sNzc3ez9nZ2eH/Ww2mzIyMrI9Vs2aNSVJP//8803X7eTklCVgpaWlZel3I/UBKDgEIgCFzsPDQ4GBgdqxY4dD+44dO1S3bl2HtieeeEKvvfaa7rvvPoc3vO666y7FxsaqevXqWZbsnv/JjcaNG6tu3bqaM2dOtqHk7NmzkqQ6deroxx9/VEpKikPtTk5OqlWrliSpfPnyDm/Zpaen66effrqhelxcXOz7AihYBCIARWLixIl6/fXXtXLlSsXGxuq5555TdHS0xo4dm6Xv6NGj9fLLL6tHjx765ptvJEmTJ0/W8uXLNW3aNMXExOjgwYNasWKFXnzxxTzXZLPZtGTJEh06dEht2rTR+vXr9euvv2rfvn165ZVX1KtXL0nSwIED5ebmpqFDh+qnn37Sli1bNHr0aA0ePNh+u6xDhw5at26d1q1bp59//llPPPGEPVDllp+fn9zd3RUeHq4TJ07o3LlzeT43ANdGIAJQJMaMGaPx48drwoQJatCggcLDw7VmzRrVqFEj2/7jxo3TtGnT1K1bN+3cuVMhISFau3atNm7cqGbNmqlly5aaN2+egoKCbqqu5s2ba/fu3apevboeffRR1alTR/fdd59iYmI0f/58SVKpUqX01Vdf6fTp02rWrJnuv/9+dezYUW+//bZ9nBEjRmjo0KEaMmSI2rVrp2rVqumee+65oVpKliypN998U++9954CAwPtgQxA/rOZ3D5FCAAAcJviChEAALA8AhEAALA8AhEAALA8AhEAALA8AhEAALA8AhEAALA8AhEAALA8AhEAALA8AhEAALA8AhEAALA8AhEAALA8AhEAALC8/w9hWt3cJjgEkgAAAABJRU5ErkJggg==", "text/plain": [ "
" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stdout", "output_type": "stream", "text": [ "310 208\n" ] } ], "source": [ "import matplotlib.pyplot as plt\n", "\n", "token_dist = df['falcon_reasoning_prompt'].apply(lambda x: len(tokenizer.apply_chat_template(x)))\n", "\n", "# Plot the histogram of token counts\n", "plt.hist(token_dist, bins=20, edgecolor='black')\n", "plt.title(\"Histogram of Token Counts\")\n", "plt.xlabel(\"Token Count\")\n", "plt.ylabel(\"Frequency\")\n", "plt.show()\n", "print(max(token_dist), min(token_dist))" ] }, { "cell_type": "markdown", "id": "5a040685-4e01-4b78-9a04-3c4a4342f661", "metadata": {}, "source": [ "# Deployment" ] }, { "cell_type": "code", "execution_count": 14, "id": "8fa1a1a3-5bf3-463d-9ad2-f4a78c07388d", "metadata": {}, "outputs": [], "source": [ "from huggingface_hub import create_inference_endpoint\n", "from huggingface_hub import get_inference_endpoint\n", "\n", "\n", "def get_my_endpoint():\n", " name = f\"poe-reasoning\"\n", " namespace=NAMESPACE\n", " try:\n", " endpoint = get_inference_endpoint(name, namespace=namespace)\n", " endpoint.wait()\n", " except:\n", " # Custom Docker image details\n", " custom_image = {\n", " \"health_route\": \"/health\",\n", " \"url\": \"ghcr.io/huggingface/text-generation-inference:3.0.1\", # This is the min version\n", " \"env\": {\n", " },\n", " }\n", " \n", " secrets = {\n", " \"HF_TOKEN\": get_token()\n", " }\n", " \n", " # Creating the inference endpoint\n", " endpoint = create_inference_endpoint(\n", " name=name,\n", " namespace=namespace,\n", " repository=BASE_MODEL,\n", " framework=\"pytorch\",\n", " accelerator=\"gpu\",\n", " instance_size=\"x1\",\n", " instance_type=\"nvidia-l4\",\n", " region=\"us-east-1\",\n", " vendor=\"aws\",\n", " min_replica=8,\n", " max_replica=8,\n", " task=\"text-generation\",\n", " custom_image=custom_image,\n", " secrets=secrets\n", " )\n", " # endpoint.wait()\n", " \n", " endpoint.wait()\n", " print(\"Your model is ready to use!\")\n", " return endpoint" ] }, { "cell_type": "code", "execution_count": 15, "id": "0f2e2a06-6210-4cca-a96e-25fd2938d73d", "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "Your model is ready to use!\n", "CPU times: user 420 ms, sys: 831 ms, total: 1.25 s\n", "Wall time: 54.3 s\n" ] } ], "source": [ "%%time\n", "endpoint = get_my_endpoint()" ] }, { "cell_type": "code", "execution_count": 16, "id": "b3d76aa7-c97f-4e2d-9400-93b13f22b846", "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "(a) Seconds and minutes: This option is incorrect because satellite technology doesn't predict specific moments like seconds and minutes.\n", "\n", "(b) The strength and magnitude of an earthquake: While satellites can detect seismic activity, they primarily support research after an earthquake to analyze the data rather than predict the specific strength or magnitude beforehand in real-time.\n", "\n", "(c) What it's like outside each day: This is the correct answer. Satellites, including weather satellites, monitor and predict weather patterns, snowfall, temperature, etc., to give us an idea of what it's like outside each day.\n", "\n", "(d) 70-75 degrees fahrenheit: This option is not correct because while satellites can certainly help in predicting temperature, the phrase \"70-75 degrees fahrenheit\" is too specific. Temperature predictions can vary widely and are not confined to a narrow range like this without context about a specific location and time.\n", "\n", "(e) Rapid changes occur: Satellites are used to monitor changes over time, but they don't predict if changes will be rapid. They provide data on changes, and it's interpreted by meteorologists or other scientists to understand the nature of the change.\n", "\n", "(f) Dead-ends and false starts: This option is not relevant to satellite technology as it pertains to screen captions or subtitles in media content, not technology used for prediction.\n", "\n", "(g) Snow, ice, and rock: While satellites can monitor snow cover, ice conditions, and potentially detect rock falls or movements, this phrase is a bit vague. They're used for prediction but the full range of prediction they cover is broader and not limited just to these elements.\n", "\n", "(h) Around 5 to 27 degrees celsius: Similar to (d), this is too specific for a general prediction about temperatures over a wide area. Temperatures can vary greatly and satellites help predict a range of temperatures, but stating a specific narrow range without context is incorrect.\n", "\n", "In conclusion, the correct answer is (c) because satellite technology, specifically remote sensing from satellites, is extensively used for creating weather forecasts and predictions about atmospheric conditions, which includes what it's like outside each day in terms of weather patterns such as temperature, humidity, cloud cover, and precipitation.\n" ] } ], "source": [ "response = endpoint.client.chat_completion(df['falcon_reasoning_prompt'].iloc[0], max_tokens=MAX_TOKENS)\n", "print(response.choices[0].message.content)" ] }, { "cell_type": "code", "execution_count": 17, "id": "9ebd6503-35e4-4805-8603-65aea2947ab8", "metadata": { "scrolled": true }, "outputs": [ { "data": { "application/vnd.jupyter.widget-view+json": { "model_id": "0fbdeab8c90e4cc98f51ee520f4aff27", "version_major": 2, "version_minor": 0 }, "text/plain": [ "Processing Prompts: 0%| | 0/8413 [00:00\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
formatted_questioncombined_factanswer_keytopicexplanationquestion_textanswer_choicesfalcon_reasoning_promptfalcon_reasoning
0what is satellite technology used for predicti...satellite technology is used for predicting wh...cTechnologya) Seconds and minutes: This option is incorre...What is satellite technology used for predicting?(a) Seconds and minutes (b) The strength and m...[{'role': 'system', 'content': 'You are an AI ...- (a) Seconds and minutes: Satellite technolog...
1what does irradiating food do? (a) relieve pai...irradiated food improves food safety.cFood science(a) Relieve pain: This option is not correct b...What does irradiating food do?(a) Relieve pain (b) Enhance food's nutrients ...[{'role': 'system', 'content': 'You are an AI ...(a) Relieve pain: Irradiating food does not ha...
2what protects a mammal's skin? (a) fiber folli...fiber follicles protect mammal skinaBiologyb) Exfoliation: Exfoliation is the process of ...What protects a mammal's skin?(a) Fiber follicles (b) Exfoliation (c) Resist...[{'role': 'system', 'content': 'You are an AI ...(a) **Fiber follicles**: This is the correct a...
3what do earthworms do when a segment breaks of...earthworms can regrow segments that break offbBiologya) Dies: This option is not correct because ea...What do earthworms do when a segment breaks off?(a) Dies (b) Regrows it (c) Reproduces (d) Sed...[{'role': 'system', 'content': 'You are an AI ...1. **Option (a): Dies**\\n - Earthworms are s...
4lightning can be bad for what? (a) the environ...lightning can be bad for the environment.aElectricityb) Rainstorms: Lightning is actually a natural...Lightning can be bad for what?(a) The environment (b) Rainstorms (c) Destruc...[{'role': 'system', 'content': 'You are an AI ...(a) The environment: Lightning can release lar...
..............................
8408organisms that can cause infection do what? (a...organisms that can cause infection make humans...gBiologya) Bandaging open sores is not the correct ans...Organisms that can cause infection do what?(a) Bandage open sores (b) Keep flesh clean (c...[{'role': 'system', 'content': 'You are an AI ...(a) Bandage open sores: This action is typical...
8409fungi are living things that cannot make thei...fungi are living things that cannot make their...aBiologyb) Fungi are living things that can make their...Fungi are living things that cannot make their...(a) Food (b) Cells (c) Energy (d) Fruits (e) H...[{'role': 'system', 'content': 'You are an AI ...1. **Read the question and options carefully.*...
8410an overheated body can use water for: (a) meta...the evaporation of water from the skin cools t...gBiologya) Metabolic reaction: This option is incorrec...An overheated body can use water for:?(a) Metabolic reaction (b) Dehydrating (c) Rai...[{'role': 'system', 'content': 'You are an AI ...- (a) Metabolic reaction: This is incorrect be...
8411what is essential for cellular respiration for...plants are essential for cellular respiration ...fBiologya) Electrons are involved in cellular respirat...What is essential for cellular respiration for...(a) Electron (b) Glucose (c) Energy (d) Energy...[{'role': 'system', 'content': 'You are an AI ...1. **Glucose (b)**: Glucose is one of the reac...
8412what helps insulate and protect the body? (a) ...living cells in follicles help insulate and pr...bBiologya) H2O: Water is essential for life, but it do...What helps insulate and protect the body?(a) H2o (b) Living cells in follicles (c) Laye...[{'role': 'system', 'content': 'You are an AI ...1. **Read the question and options carefully.*...
\n", "

8413 rows × 9 columns

\n", "" ], "text/plain": [ " formatted_question \\\n", "0 what is satellite technology used for predicti... \n", "1 what does irradiating food do? (a) relieve pai... \n", "2 what protects a mammal's skin? (a) fiber folli... \n", "3 what do earthworms do when a segment breaks of... \n", "4 lightning can be bad for what? (a) the environ... \n", "... ... \n", "8408 organisms that can cause infection do what? (a... \n", "8409 fungi are living things that cannot make thei... \n", "8410 an overheated body can use water for: (a) meta... \n", "8411 what is essential for cellular respiration for... \n", "8412 what helps insulate and protect the body? (a) ... \n", "\n", " combined_fact answer_key \\\n", "0 satellite technology is used for predicting wh... c \n", "1 irradiated food improves food safety. c \n", "2 fiber follicles protect mammal skin a \n", "3 earthworms can regrow segments that break off b \n", "4 lightning can be bad for the environment. a \n", "... ... ... \n", "8408 organisms that can cause infection make humans... g \n", "8409 fungi are living things that cannot make their... a \n", "8410 the evaporation of water from the skin cools t... g \n", "8411 plants are essential for cellular respiration ... f \n", "8412 living cells in follicles help insulate and pr... b \n", "\n", " topic explanation \\\n", "0 Technology a) Seconds and minutes: This option is incorre... \n", "1 Food science (a) Relieve pain: This option is not correct b... \n", "2 Biology b) Exfoliation: Exfoliation is the process of ... \n", "3 Biology a) Dies: This option is not correct because ea... \n", "4 Electricity b) Rainstorms: Lightning is actually a natural... \n", "... ... ... \n", "8408 Biology a) Bandaging open sores is not the correct ans... \n", "8409 Biology b) Fungi are living things that can make their... \n", "8410 Biology a) Metabolic reaction: This option is incorrec... \n", "8411 Biology a) Electrons are involved in cellular respirat... \n", "8412 Biology a) H2O: Water is essential for life, but it do... \n", "\n", " question_text \\\n", "0 What is satellite technology used for predicting? \n", "1 What does irradiating food do? \n", "2 What protects a mammal's skin? \n", "3 What do earthworms do when a segment breaks off? \n", "4 Lightning can be bad for what? \n", "... ... \n", "8408 Organisms that can cause infection do what? \n", "8409 Fungi are living things that cannot make their... \n", "8410 An overheated body can use water for:? \n", "8411 What is essential for cellular respiration for... \n", "8412 What helps insulate and protect the body? \n", "\n", " answer_choices \\\n", "0 (a) Seconds and minutes (b) The strength and m... \n", "1 (a) Relieve pain (b) Enhance food's nutrients ... \n", "2 (a) Fiber follicles (b) Exfoliation (c) Resist... \n", "3 (a) Dies (b) Regrows it (c) Reproduces (d) Sed... \n", "4 (a) The environment (b) Rainstorms (c) Destruc... \n", "... ... \n", "8408 (a) Bandage open sores (b) Keep flesh clean (c... \n", "8409 (a) Food (b) Cells (c) Energy (d) Fruits (e) H... \n", "8410 (a) Metabolic reaction (b) Dehydrating (c) Rai... \n", "8411 (a) Electron (b) Glucose (c) Energy (d) Energy... \n", "8412 (a) H2o (b) Living cells in follicles (c) Laye... \n", "\n", " falcon_reasoning_prompt \\\n", "0 [{'role': 'system', 'content': 'You are an AI ... \n", "1 [{'role': 'system', 'content': 'You are an AI ... \n", "2 [{'role': 'system', 'content': 'You are an AI ... \n", "3 [{'role': 'system', 'content': 'You are an AI ... \n", "4 [{'role': 'system', 'content': 'You are an AI ... \n", "... ... \n", "8408 [{'role': 'system', 'content': 'You are an AI ... \n", "8409 [{'role': 'system', 'content': 'You are an AI ... \n", "8410 [{'role': 'system', 'content': 'You are an AI ... \n", "8411 [{'role': 'system', 'content': 'You are an AI ... \n", "8412 [{'role': 'system', 'content': 'You are an AI ... \n", "\n", " falcon_reasoning \n", "0 - (a) Seconds and minutes: Satellite technolog... \n", "1 (a) Relieve pain: Irradiating food does not ha... \n", "2 (a) **Fiber follicles**: This is the correct a... \n", "3 1. **Option (a): Dies**\\n - Earthworms are s... \n", "4 (a) The environment: Lightning can release lar... \n", "... ... \n", "8408 (a) Bandage open sores: This action is typical... \n", "8409 1. **Read the question and options carefully.*... \n", "8410 - (a) Metabolic reaction: This is incorrect be... \n", "8411 1. **Glucose (b)**: Glucose is one of the reac... \n", "8412 1. **Read the question and options carefully.*... \n", "\n", "[8413 rows x 9 columns]" ] }, "execution_count": 22, "metadata": {}, "output_type": "execute_result" } ], "source": [ "df" ] }, { "cell_type": "code", "execution_count": 23, "id": "55bc6940-07e4-402f-9c56-fb830a35290f", "metadata": {}, "outputs": [ { "data": { "application/vnd.jupyter.widget-view+json": { "model_id": "2c00d0ec716c4f8883388c94a66d44d3", "version_major": 2, "version_minor": 0 }, "text/plain": [ "Uploading the dataset shards: 0%| | 0/1 [00:00