notebooks/suggest_intent_data_prep

{ "cells": [ { "cell_type": "markdown", "id": "771600b9-1422-4717-b119-8c45cafb6725", "metadata": {}, "source": [ "Purpose of the notebook:\n", "\n", "Evaluate the current NER approach. This approach uses existing models supported by Transformers.js library.\n", "We see where it fails. \n", "With the hypothesis classifier based approach might be better for we prepare and label the data\n", "(https://www.microsoft.com/en-us/download/details.aspx?id=58227)\n", "\n", "with some improvements in labeling" ] }, { "cell_type": "code", "execution_count": null, "id": "6237221a-0d4c-43ec-b18d-95f99807d653", "metadata": {}, "outputs": [], "source": [ "## imports\n", "\n", "from transformers import pipeline\n", "import pandas as pd\n", "from tqdm import tqdm\n", "from pprint import pprint\n", "import random\n", "import matplotlib.pyplot as plt" ] }, { "cell_type": "markdown", "id": "bd5974fe-47f3-41fd-b496-a25af8668a15", "metadata": {}, "source": [ "#### Some examples of where the NER based approach is failing" ] }, { "cell_type": "code", "execution_count": null, "id": "145a1821-f31a-48f9-9222-d2a7ab1270bf", "metadata": {}, "outputs": [], "source": [ "classifier = pipeline(\"zero-shot-classification\", model='typeform/mobilebert-uncased-mnli', device='cpu')\n", "\n", "\n", "texts = [\n", " \"what is democracy\",\n", " \"restaurants in oakville\",\n", " \"buy iphone\",\n", " \"bank login\",\n", " \"temperature in San Jose\",\n", " \"wood floor buckling repair\",\n", " \"wood floor cost estimator\",\n", " \"panera bread menu price\",\n", " \"how much is hbo now subscription\",\n", " \"how much is a golden retriever puppy\",\n", " \"how much is nebraska's sales tax\",\n", " \"how much is donald trump jr worth\",\n", " \"how much is a liposuction\",\n", " \"does mushroom cause food allergy\",\n", "]\n", "\n", "\n", "\n", "intent_labels_lkp = {\n", " \"yelp_intent\": \"search for local service, food, home repair, maintenance, cost estimation excluding weather intents\",\n", " # \"yelp_intent\": \"to discover, connect and transact with local businesses\",\n", " \"information_intent\": \"search for general knowledge what some concept is and not related to weather, services, or products\",\n", " \"weather_intent\": \"check weather conditions like forecast, temperature, radar, storms, or pollen\",\n", " \"purchase_intent\": \"make an online purchase\",\n", " \"navigation_intent\": \"navigate to a specific website\"\n", "}\n", "\n", "intent_desc_lkp = {intent_desc: intent_key for intent_key, intent_desc in intent_labels_lkp.items()}\n", "\n", "# Refined intent labels\n", "intent_labels = [\n", " intent_labels_lkp[\"yelp_intent\"],\n", " intent_labels_lkp[\"information_intent\"],\n", " intent_labels_lkp[\"weather_intent\"],\n", " intent_labels_lkp[\"purchase_intent\"],\n", " intent_labels_lkp[\"navigation_intent\"],\n", "]\n", "\n", "result = classifier(texts, candidate_labels=intent_labels)\n", "# pprint(result)\n" ] }, { "cell_type": "code", "execution_count": null, "id": "6dd4e9fb-7ea9-48fc-8c81-c17b7efbd094", "metadata": {}, "outputs": [], "source": [ "# result_df = pd.DataFrame(result)\n", "def prepare_df_from_reesult(result):\n", " updated_result = []\n", " for idx, res in enumerate(result):\n", " labels_and_scores = {'sequence': res['sequence']}\n", " for label, score in zip(res['labels'], res['scores']):\n", " labels_and_scores[intent_desc_lkp[label]] = score\n", " updated_result.append(labels_and_scores)\n", " \n", " return pd.DataFrame(updated_result)\n", "\n", "updated_result_df = prepare_df_from_reesult(result)" ] }, { "cell_type": "code", "execution_count": null, "id": "70d1a138-6fe9-4805-955c-0be03395e726", "metadata": { "scrolled": true }, "outputs": [], "source": [ "updated_result_df" ] }, { "cell_type": "markdown", "id": "969dc690-2cf1-421c-9ee4-fd6f6cb06367", "metadata": {}, "source": [ "Some of the above results are bit unclear. `does the mushroom cause food allergy` is more of a information intent than a yelp intent.\n", "There were many other cases which showed that NER alone may not be suitable for this problem. We need to solve the intent classification problem in this use case" ] }, { "cell_type": "markdown", "id": "6ac113fa-b54b-4722-a9b8-a20ef10580a5", "metadata": {}, "source": [ "#### Marco data\n", "\n", "This dataset can be downloaded from https://www.microsoft.com/en-us/download/details.aspx?id=58227" ] }, { "cell_type": "code", "execution_count": null, "id": "99ebeafb-40f7-429c-8714-653f0e930c0e", "metadata": {}, "outputs": [], "source": [ "marco_text_queries = set()\n", "with open(\"../data/full_marco_sessions_ann_split.train.tsv\", \"r\") as f:\n", " marco_texts = f.read().split('\\n')\n", " for text in marco_texts:\n", " for query in text.split(\"\\t\"):\n", " if \"marco-gen-train\" not in query and len(query) >= 3:\n", " marco_text_queries.add(query.lower())\n", "\n", "marco_text_queries_list = list(marco_text_queries)" ] }, { "cell_type": "code", "execution_count": null, "id": "832b930e-92c3-4d2b-a4c2-365871082ac1", "metadata": {}, "outputs": [], "source": [ "len(marco_text_queries_list)" ] }, { "cell_type": "code", "execution_count": null, "id": "4db7dc89-d8c2-4c52-b95a-e0f44298b955", "metadata": {}, "outputs": [], "source": [ "## some example queries\n", "\n", "marco_text_queries_list[:50]" ] }, { "cell_type": "code", "execution_count": null, "id": "67a278b9-c847-4297-8fe5-730ca56d1b1a", "metadata": {}, "outputs": [], "source": [ "marco_df = pd.DataFrame({\"sequence\": marco_text_queries_list})" ] }, { "cell_type": "code", "execution_count": null, "id": "b6d7d8e6-5777-43d2-9594-aa40d51a9dd6", "metadata": {}, "outputs": [], "source": [ "def labeling_stats(df):\n", " if 'target' not in marco_df.columns:\n", " df['target'] = None\n", " print(f\"Size of the dataset = {len(df)}\")\n", " print(f\"Number of examples to be labeled = {df['target'].isna().sum()}\")\n", " print(f\"Number of examples labeled = {(~df['target'].isna()).sum()}\")\n", " print(\"Labels distributed as \\n\", df['target'].value_counts())\n", "\n", "\n", "## Prints labeling stats\n", "labeling_stats(marco_df)" ] }, { "cell_type": "markdown", "id": "3e8a6921-c611-4216-8907-806c8f36211f", "metadata": {}, "source": [ "#### Find potential ngram mappings for targets" ] }, { "cell_type": "code", "execution_count": null, "id": "bb75e0fc-49e7-47e6-9dae-48179bf668a1", "metadata": {}, "outputs": [], "source": [ "from collections import Counter\n", "from itertools import islice\n", "\n", "# Generalize function to extract n-grams\n", "def extract_ngrams(query, n):\n", " words = query.split()\n", " ngrams = zip(*[islice(words, i, None) for i in range(n)]) # Generate n-grams\n", " return [' '.join(ngram) for ngram in ngrams] # Join n-grams into a single string\n", "\n", "# Flatten the n-grams into a list and count them\n", "def count_ngrams(queries_list, n):\n", " all_ngrams = [ngram for query in queries_list for ngram in extract_ngrams(query, n)]\n", " ngram_counter = Counter(all_ngrams)\n", " return ngram_counter\n" ] }, { "cell_type": "code", "execution_count": null, "id": "79654bef-5fbd-4ece-a5dd-3aff12830b46", "metadata": {}, "outputs": [], "source": [ "def search_queries_by_words(search_text, to_be_labelled_sequence_list):\n", " for query in to_be_labelled_sequence_list:\n", " if search_text in query:\n", " yield query" ] }, { "cell_type": "code", "execution_count": null, "id": "6052b55a-3051-4ea8-b625-bf1f4a2a0f1b", "metadata": {}, "outputs": [], "source": [ "cnt = 0\n", "for query in search_queries_by_words(\"24 hour\", marco_text_queries_list):\n", " if cnt >= 100: # Stop after 20 results\n", " break\n", " print(cnt + 1, query)\n", " cnt += 1" ] }, { "cell_type": "code", "execution_count": null, "id": "5dfda4f8-0327-4005-84b8-54b85d8a2f37", "metadata": {}, "outputs": [], "source": [ "\n", "target_mapping = {\n", " 'how do': 'information_intent',\n", " 'how to': 'information_intent',\n", " 'weather in': 'weather_intent',\n", " 'the weather': 'weather_intent',\n", " 'hurricane': 'information_intent',\n", " # 'tornado': 'weather_intent',\n", " 'current temperature': 'weather_intent',\n", " 'current weather': 'weather_intent',\n", " 'weather forecast in': 'weather_intent',\n", " 'temperature in': 'weather_intent',\n", " # 'how much': 'purchase_intent', \n", " # 'cost to': 'purchase_intent',\n", " # 'where is': 'navigation_intent', \n", " 'sign in ': 'navigation_intent',\n", " 'signin ': 'navigation_intent',\n", " 'login ': 'navigation_intent',\n", " 'phone number': 'navigation_intent', \n", " 'customer service': 'navigation_intent',\n", " 'bank routing': 'navigation_intent',\n", " 'phone banking': 'navigation_intent',\n", " 'watch online': 'navigation_intent',\n", " 'help desk': 'navigation_intent',\n", " 'what are': 'information_intent',\n", " 'what county is': 'information_intent',\n", " 'what is a ': 'information_intent',\n", " # 'what is': 'information_intent',\n", " 'what does': 'information_intent',\n", " 'what do': 'information_intent',\n", " 'definition of': 'information_intent',\n", " 'meaning': 'information_intent',\n", " 'symptoms': 'information_intent',\n", " 'zip code': 'information_intent',\n", " 'zipcode': 'information_intent',\n", " 'postal code': 'information_intent',\n", " 'postalcode': 'information_intent',\n", " 'area code': 'information_intent',\n", " 'areacode': 'information_intent',\n", " 'definition': 'information_intent',\n", " 'define': 'information_intent',\n", " 'what is the difference between': 'information_intent',\n", " 'what is the purpose of': 'information_intent',\n", " 'what is the function of': 'information_intent',\n", " 'how long does it take': 'information_intent',\n", " 'what is the name of': 'information_intent',\n", " 'what is the population of': 'information_intent',\n", " 'what is an example of': 'information_intent',\n", " 'which of the following': 'information_intent',\n", " 'what is the purpose': 'information_intent',\n", " # 'what time zone is': 'information_intent',\n", " 'what is the average': 'information_intent',\n", " 'is in what county': 'information_intent',\n", " 'calories in': 'information_intent',\n", " # 'how many calories in': 'information_intent',\n", " \"causes of\": 'information_intent',\n", " \"tom cruise\": 'information_intent',\n", " 'visit': 'travel_intent',\n", " 'travel to': 'travel_intent',\n", " 'cruise': 'travel_intent',\n", " 'tours': 'travel_intent',\n", " 'mortgage rate': 'yelp_intent',\n", " 'interest rate': 'yelp_intent',\n", " 'price of': 'purchase_intent',\n", " 'amazon price': 'purchase_intent',\n", " 'cost of living': 'information_intent',\n", " 'to eat': 'yelp_intent', \n", " 'does it cost': 'yelp_intent', \n", " 'dental': 'yelp_intent',\n", " 'dentist': 'yelp_intent',\n", " # 'what is the current': ?\n", " 'what is the largest': 'information_intent',\n", " 'what is the currency': 'information_intent',\n", " 'how old do you': 'information_intent',\n", " 'how long does a': 'information_intent',\n", " # 'what time is it': 'information_intent',\n", " 'what time': 'information_intent',\n", " 'you have to be': 'information_intent',\n", " 'do you need to': 'information_intent',\n", " 'what is considered a': 'information_intent',\n", " 'dialing code': 'information_intent',\n", " 'side effects': 'information_intent',\n", " 'stock market': 'information_intent',\n", " 'how many calories': 'information_intent',\n", " 'average salary for': 'information_intent',\n", " 'how many grams': 'information_intent',\n", " 'what foods are': 'information_intent',\n", " 'how many ounces': 'information_intent',\n", " 'how many carbs': 'information_intent',\n", " 'what year was': 'information_intent',\n", " 'how old is': 'information_intent',\n", " 'how much is': 'information_intent',\n", " 'what type of': 'information_intent',\n", " 'how do i': 'information_intent',\n", " 'what kind of': 'information_intent',\n", " 'who is the': 'information_intent',\n", " 'where is the': 'information_intent',\n", " # 'different types of': 'information_intent',\n", " 'types': 'information_intent',\n", " 'what is': 'information_intent',\n", " 'how do you': 'information_intent',\n", " 'what was the': 'information_intent',\n", " 'in the world': 'information_intent',\n", " 'how long is': 'information_intent',\n", " 'when was': 'information_intent',\n", " 'when did': 'information_intent',\n", " 'how far is': 'information_intent',\n", " 'how tall is': 'information_intent',\n", " 'what to do': 'information_intent',\n", " 'how long': 'information_intent',\n", " 'types of': 'information_intent',\n", " 'who is': 'information_intent',\n", " 'where is': 'information_intent',\n", " 'what causes': 'information_intent',\n", " 'stock price': 'information_intent',\n", " 'difference between': 'information_intent',\n", " 'social security': 'information_intent',\n", " 'who was': 'information_intent',\n", " 'net worth': 'information_intent',\n", " 'cast of': 'information_intent',\n", " 'how many': 'information_intent',\n", " 'how does': 'information_intent',\n", " 'how is': 'information_intent',\n", " 'what did': 'information_intent',\n", " 'good for': 'information_intent',\n", " 'population of': 'information_intent',\n", " 'can you': 'information_intent',\n", " 'what can': 'information_intent',\n", " 'how big': 'information_intent',\n", " 'what size': 'information_intent',\n", " 'average salary of': 'information_intent',\n", " 'what year': 'information_intent',\n", " 'part of': 'information_intent',\n", " 'another word': 'information_intent',\n", " 'who invented': 'information_intent',\n", " 'what can you': 'information_intent',\n", " 'how much money': 'information_intent',\n", " 'what size': 'information_intent',\n", " 'what state': 'information_intent',\n", " 'what county': 'information_intent',\n", " 'in the us': 'information_intent',\n", " 'how old': 'information_intent',\n", " 'icd code': 'information_intent',\n", " 'what city': 'information_intent',\n", " 'can you': 'information_intent',\n", " 'can i': 'information_intent',\n", " 'when is': 'information_intent',\n", " 'how did': 'information_intent',\n", " 'what can': 'information_intent',\n", " 'what to': 'information_intent',\n", " 'the same': 'information_intent',\n", " \"cleaning \": 'yelp_intent',\n", " 'restaurant': 'yelp_intent',\n", " 'recommendation': 'yelp_intent',\n", " 'repair': 'yelp_intent',\n", " 'parking': 'yelp_intent',\n", " 'oil change': 'yelp_intent',\n", " ' rental': 'yelp_intent',\n", " 'auto ': 'yelp_intent',\n", " 'dry clean': 'yelp_intent',\n", " 'club': 'yelp_intent',\n", " 'hotel': 'yelp_intent',\n", " 'stores': 'yelp_intent',\n", " 'shopping': 'yelp_intent',\n", " ' shop ': 'yelp_intent',\n", " ' shops ': 'yelp_intent',\n", " ' mall ': 'yelp_intent',\n", " 'furniture': 'yelp_intent',\n", " 'crafts': 'yelp_intent',\n", " 'clothing': 'yelp_intent',\n", " # 'benefits of': 'yelp_intent',\n", " 'average cost': 'yelp_intent',\n", " 'cost to install': 'yelp_intent',\n", " 'contact number': 'navigation_intent',\n", " 'what airport': 'travel_intent',\n", " # 'flight': 'travel_intent',\n", " 'cabins': 'travel_intent',\n", " 'cost for': 'yelp_intent',\n", " 'do you': 'information_intent',\n", " 'when does': 'information_intent',\n", " 'why is': 'information_intent',\n", " \"what's the\": 'information_intent',\n", " 'what was': 'information_intent',\n", " 'what language': 'information_intent',\n", " 'should i': 'information_intent',\n", " 'convert': 'information_intent',\n", " 'medication': 'information_intent',\n", " 'treatment': 'yelp_intent',\n", " 'tv show': 'information_intent',\n", " 'history': 'information_intent',\n", " 'remedies': 'information_intent',\n", " 'county is': 'information_intent',\n", " 'synonym ': 'information_intent',\n", " 'credit union number': 'navigation_intent',\n", " 'credit union phone number': 'navigation_intent',\n", " 'credit union hours': 'navigation_intent',\n", " 'movie cast': 'information_intent',\n", " 'average salary': 'information_intent',\n", " 'example': 'information_intent',\n", " 'blood pressure': 'information_intent',\n", " 'credit card': 'navigation_intent',\n", " 'time zone': 'information_intent',\n", " 'time in': 'information_intent',\n", " 'foods that': 'information_intent',\n", " 'salary for': 'information_intent',\n", " \"weather\": 'weather_intent',\n", " \"weather forecast\": 'weather_intent',\n", " \"windy\": 'weather_intent',\n", " \"humidity\": 'weather_intent',\n", " \"monsoon\": 'weather_intent',\n", " \"flooding\": 'weather_intent',\n", " \"rain in\": 'weather_intent',\n", " \"storms\": 'weather_intent',\n", " \"storm in\": 'weather_intent',\n", " \"forcast\": 'weather_intent',\n", " \"wether\": 'weather_intent',\n", " \"wather\": 'weather_intent',\n", " \"weahter\": 'weather_intent',\n", " \"weater\": 'weather_intent',\n", " \"weaher\": 'weather_intent',\n", " \" vindy \": 'weather_intent',\n", " \" sunny \": 'weather_intent',\n", " \" rain \": 'weather_intent',\n", " \"windy\": 'weather_intent',\n", " \"cloudy\": 'weather_intent',\n", " \"storms\": 'weather_intent',\n", " \"air quality\": 'weather_intent',\n", " \"thunderstorm\": 'weather_intent',\n", " \"pollen\": 'weather_intent',\n", " \"snow\": 'weather_intent',\n", " \"blizzard\": 'weather_intent',\n", " \"radar\": 'weather_intent',\n", " \"tiempo\": 'weather_intent',\n", " \"clima\": 'weather_intent',\n", " \"doppler radar\": 'weather_intent',\n", " \"local radar\": 'weather_intent',\n", " \"local weather\": 'weather_intent',\n", " # \"map\": 'weather_intent',\n", " \"us weather radar\": 'weather_intent',\n", " \"weather radar near me\": 'weather_intent',\n", " \"radar near me\": 'weather_intent',\n", " 'salary': 'information_intent',\n", " 'cost to build': 'yelp_intent',\n", " 'icd ': 'information_intent',\n", " 'how often': 'information_intent',\n", " 'get rid of': 'information_intent',\n", " 'university of': 'navigation_intent',\n", " 'windows 10': 'navigation_intent',\n", " 'causes for': 'information_intent',\n", " 'calculat': 'information_intent',\n", " 'which is ': 'information_intent',\n", " 'where are ': 'information_intent',\n", " 'kelvin': 'information_intent',\n", " 'celsius': 'information_intent',\n", " 'fahrenheit': 'information_intent',\n", " 'when ': 'information_intent',\n", " 'benefit of': 'information_intent',\n", " 'most common': 'information_intent',\n", " 'which ': 'information_intent',\n", " 'refers ': 'information_intent',\n", " 'where does ': 'information_intent',\n", " 'synonym': 'information_intent', \n", " 'salaries': 'information_intent', \n", " 'function of': 'information_intent', \n", " 'cause of': 'information_intent', \n", " 'effects of': 'information_intent', \n", " 'used for': 'information_intent', \n", " 'what color is': 'information_intent', \n", " 'weight loss': 'yelp_intent', \n", " 'where do': 'information_intent', \n", " 'what foods': 'information_intent', \n", " 'used for': 'information_intent', \n", " 'why': 'information_intent', \n", " 'age of': 'information_intent', \n", " 'who wrote': 'information_intent', \n", " 'function of': 'information_intent', \n", " \"what's a\": 'information_intent', \n", " \"how fast\": 'information_intent', \n", " 'most popular': 'information_intent', \n", " 'where': 'information_intent', \n", " 'is used': 'information_intent', \n", " 'doctors': 'yelp_intent', \n", " 'who ': 'information_intent', \n", " ' hours': 'navigation_intent',\n", " 'schedule': 'information_intent', \n", " 'what age': 'information_intent',\n", " 'cheap': 'yelp_intent',\n", " 'most expensive': 'information_intent',\n", " 'size of': 'information_intent',\n", " 'what exactly': 'information_intent',\n", " 'ways to ': 'information_intent',\n", " 'disorder': 'information_intent',\n", " 'disease': 'information_intent',\n", " 'felony': 'information_intent',\n", " 'movie': 'information_intent',\n", " # 'cost of': 'yelp_intent',\n", " 'what were': 'information_intent',\n", " 'degree': 'information_intent',\n", " 'what day': 'information_intent',\n", " 'ways to': 'information_intent',\n", " 'influen': 'information_intent',\n", " 'importan': 'information_intent',\n", " 'school': 'information_intent',\n", " 'train': 'information_intent',\n", " 'dimension': 'information_intent',\n", " 'what makes': 'information_intent',\n", " 'what were': 'information_intent',\n", " 'what food': 'information_intent',\n", " 'normal range': 'information_intent',\n", " 'ways to': 'information_intent',\n", " 'requirements for': 'information_intent',\n", " 'employment': 'information_intent',\n", " 'support number': 'navigation_intent',\n", " ' support ': 'navigation_intent',\n", " 'appointment': 'navigation_intent',\n", " 'calculator': 'navigation_intent',\n", " ' application': 'navigation_intent',\n", " ' license': 'navigation_intent',\n", " 'craigslist': 'navigation_intent',\n", " 'fedex': 'navigation_intent',\n", " 'forex': 'navigation_intent',\n", " ' ups ': 'navigation_intent',\n", " ' usps ': 'navigation_intent',\n", " 'dhl': 'navigation_intent',\n", " 'fax number': 'navigation_intent',\n", " 'considered a': 'information_intent',\n", " 'distance ': 'information_intent',\n", " 'share price': 'information_intent',\n", " 'stock': 'information_intent',\n", " 'channel is': 'information_intent',\n", " 'continent': 'information_intent',\n", " 'what level': 'information_intent',\n", " 'english to': 'translation_intent',\n", " 'to english': 'translation_intent',\n", " 'translat': 'translation_intent',\n", " 'what currency': 'information_intent',\n", " 'blood test': 'information_intent',\n", " 'replacement cost': 'yelp_intent',\n", " 'how tall': 'information_intent',\n", " 'characteristics of': 'information_intent',\n", " 'tracking number': 'navigation_intent',\n", " 'tracking': 'navigation_intent',\n", " 'to replace': 'yelp_intent',\n", " 'pay for': 'information_intent',\n", " 'calories': 'information_intent',\n", " 'health': 'information_intent',\n", " 'tax': 'information_intent',\n", " 'deadline': 'information_intent',\n", " 'insurance': 'information_intent',\n", " 'cancel': 'navigation_intent',\n", " 'address': 'navigation_intent',\n", " 'healthy': 'yelp_intent',\n", " 'diet': 'information_intent',\n", " 'lyrics': 'information_intent',\n", " 'cell phone': 'purchase_intent',\n", " 'discount': 'purchase_intent',\n", " 'coupon': 'purchase_intent',\n", " 'promo code': 'purchase_intent',\n", " ' deal': 'purchase_intent',\n", " 'where to buy': 'purchase_intent',\n", " ' buy': 'purchase_intent',\n", " 'purchase': 'purchase_intent',\n", " 'blackfriday': 'purchase_intent',\n", " 'cybermonday': 'purchase_intent',\n", " 'amazon prime': 'purchase_intent',\n", " 'clearance': 'purchase_intent',\n", " 'on sale': 'purchase_intent',\n", " 'refurbished': 'purchase_intent',\n", " 'warranty': 'purchase_intent',\n", " 'compare price': 'purchase_intent',\n", " 'cashback': 'purchase_intent',\n", " 'in stock': 'purchase_intent',\n", " 'lowest price': 'purchase_intent',\n", " 'free shipping': 'purchase_intent',\n", " 'android': 'information_intent',\n", " 'protein': 'information_intent',\n", " '401k': 'information_intent',\n", " ' ira ': 'information_intent',\n", " 'population': 'information_intent',\n", " 'president': 'information_intent',\n", " 'whats': 'information_intent',\n", " \"what's\": 'information_intent',\n", " 'benefits': 'information_intent',\n", " ' pain ': 'yelp_intent',\n", " 'installation cost': 'yelp_intent',\n", " 'in spanish': 'translation_intent',\n", " 'to spanish': 'translation_intent',\n", " 'in french': 'translation_intent',\n", " 'to french': 'translation_intent',\n", " 'in japanese': 'translation_intent',\n", " 'to japanese': 'translation_intent',\n", " 'in chinese': 'translation_intent',\n", " 'to chinese': 'translation_intent',\n", " 'side effect': 'information_intent',\n", " 'cost to live': 'information_intent',\n", " 'cost of living': 'information_intent',\n", " 'cost to': 'yelp_intent',\n", " 'cost per': 'information_intent',\n", " 'disney world': 'navigation_intent',\n", " 'surgery cost': 'yelp_intent',\n", " 'album': 'information_intent',\n", " 'genre': 'information_intent',\n", " 'much water': 'information_intent',\n", " 'job': 'navigation_intent',\n", " 'netflix': 'information_intent',\n", " 'nutrient': 'information_intent',\n", " 'amazon stock': 'information_intent',\n", " 'music': 'information_intent',\n", " 'caffeine': 'information_intent',\n", " 'adoption': 'yelp_intent',\n", " 'dogs': 'yelp_intent',\n", " 'cats': 'yelp_intent',\n", " 'countries': 'information_intent',\n", " 'number of': 'information_intent',\n", " 'related to': 'information_intent',\n", " 'foods with': 'information_intent',\n", " 'restaurant': 'yelp_intent',\n", " 'cusine': 'yelp_intent',\n", " 'italian': 'yelp_intent',\n", " 'mediterranean': 'yelp_intent',\n", " 'vietnamese': 'yelp_intent',\n", " 'recipe': 'yelp_intent',\n", " 'vegan': 'yelp_intent',\n", " ' vegeta': 'yelp_intent',\n", " ' meat': 'yelp_intent',\n", " ' spice': 'yelp_intent',\n", " ' beer': 'yelp_intent',\n", " ' wine': 'yelp_intent',\n", " ' fresh ': 'yelp_intent',\n", " 'fruit': 'yelp_intent',\n", " 'restaurant': 'yelp_intent',\n", " 'resort': 'travel_intent',\n", " 'attraction': 'travel_intent',\n", " 'installation': 'yelp_intent',\n", " 'service': 'yelp_intent',\n", " 'routing number': 'navigation_intent',\n", " 'amazon': 'navigation_intent',\n", "}" ] }, { "cell_type": "code", "execution_count": null, "id": "a5a35d0d", "metadata": {}, "outputs": [], "source": [ "print(\"key\", \"#examples\")\n", "information_queries_set = set()\n", "for key,val in target_mapping.items():\n", " if val == 'information_intent':\n", " cnt = 0\n", " for query in search_queries_by_words(key, marco_text_queries_list):\n", " # if key == 'amazon':\n", " # print(query)\n", " information_queries_set.add(query)\n", " cnt += 1\n", "\n", " print(key, cnt)\n" ] }, { "cell_type": "code", "execution_count": null, "id": "5df7c5e0", "metadata": {}, "outputs": [], "source": [ "information_queries_set" ] }, { "cell_type": "code", "execution_count": null, "id": "d0a75955", "metadata": {}, "outputs": [], "source": [] }, { "cell_type": "code", "execution_count": null, "id": "abd9a063-a31e-4ab6-bdff-3b76c153a7af", "metadata": {}, "outputs": [], "source": [ "print(\"key\", \"#examples\")\n", "navigation_queries_set = set()\n", "for key,val in target_mapping.items():\n", " if val == 'navigation_intent':\n", " cnt = 0\n", " for query in search_queries_by_words(key, marco_text_queries_list):\n", " # if key == 'amazon':\n", " # print(query)\n", " navigation_queries_set.add(query)\n", " cnt += 1\n", "\n", " print(key, cnt)\n" ] }, { "cell_type": "code", "execution_count": null, "id": "60386650-2aa7-454e-ab14-ee4534dba8d0", "metadata": {}, "outputs": [], "source": [ "print(\"key\", \"#examples\")\n", "purchase_queries_set = set()\n", "for key,val in target_mapping.items():\n", " if val == 'purchase_intent':\n", " cnt = 0\n", " for query in search_queries_by_words(key, marco_text_queries_list):\n", " purchase_queries_set.add(query)\n", " cnt += 1\n", "\n", " print(key, cnt)\n" ] }, { "cell_type": "code", "execution_count": null, "id": "6bd4fc06-d7aa-4df4-9b7d-d60cc69eadd3", "metadata": { "scrolled": true }, "outputs": [], "source": [ "purchase_queries_set" ] }, { "cell_type": "code", "execution_count": null, "id": "5ff887ab-e970-46d6-8a20-b2e070751e0d", "metadata": {}, "outputs": [], "source": [ "print(\"key\", \"#examples\")\n", "yelp_queries_set = set()\n", "for key,val in target_mapping.items():\n", " if val == 'yelp_intent':\n", " cnt = 0\n", " for query in search_queries_by_words(key, marco_text_queries_list):\n", " yelp_queries_set.add(query)\n", " cnt += 1\n", "\n", " print(key, cnt)\n" ] }, { "cell_type": "code", "execution_count": null, "id": "224fff1c-f1ac-41dc-9907-9185e7f24030", "metadata": {}, "outputs": [], "source": [ "yelp_queries = list(yelp_queries_set)\n", "yelp_queries[:5]\n", "\n", "yelp_ngram_counter = count_ngrams(yelp_queries, 2)\n", "yelp_most_common_ngrams = yelp_ngram_counter.most_common(100)\n", "\n", "# Display the weather_most_common_ngrams\n", "print(yelp_most_common_ngrams)" ] }, { "cell_type": "code", "execution_count": null, "id": "127768df-75ab-4de9-a995-7a694785842a", "metadata": { "scrolled": true }, "outputs": [], "source": [ "yelp_queries_set" ] }, { "cell_type": "code", "execution_count": null, "id": "a56a3dc7-5288-4b49-8fe1-54ba224efd20", "metadata": {}, "outputs": [], "source": [ "print(\"key\", \"#examples\")\n", "weather_queries_set = set()\n", "for key,val in target_mapping.items():\n", " if val == 'weather_intent':\n", " cnt = 0\n", " for query in search_queries_by_words(key, marco_text_queries_list):\n", " weather_queries_set.add(query)\n", " cnt += 1\n", "\n", " print(key, cnt)\n" ] }, { "cell_type": "code", "execution_count": null, "id": "64c93b81-f34b-415c-bde2-0976f6331f89", "metadata": {}, "outputs": [], "source": [ "weather_queries = list(weather_queries_set)\n", "weather_queries[:5]\n", "\n", "weather_ngram_counter = count_ngrams(weather_queries, 2)\n", "weather_most_common_ngrams = weather_ngram_counter.most_common(100)\n", "\n", "# Display the weather_most_common_ngrams\n", "print(weather_most_common_ngrams)" ] }, { "cell_type": "code", "execution_count": null, "id": "2ecb5cff-106d-4fbd-981e-782d2ca69f8c", "metadata": {}, "outputs": [], "source": [ "weather_templates = [\n", " # Original Patterns\n", " (\"The weather in {}\", 0.539),\n", " (\"What is the weather in {}\", 0.499),\n", " (\"What's the weather in {}\", 0.046),\n", " (\"Weather forecast in {}\", 0.039),\n", " (\"What is the temperature in {}\", 0.033),\n", " (\"The weather forecast for {}\", 0.034),\n", " (\"Current weather in {}\", 0.023),\n", " (\"Average weather in {}\", 0.022),\n", " (\"What is the weather forecast for {}\", 0.014),\n", " (\"Weather in {} in {}\", 0.011),\n", " (\"How is the weather in {}\", 0.006),\n", " (\"What is the climate of {}\", 0.009),\n", " (\"Is the weather forecast for {}\", 0.005),\n", " (\"Rain in {}\", 0.002),\n", " (\"What is the weather like in {}\", 0.009),\n", " (\"What is the climate in {}\", 0.001),\n", " (\"The weather today in {}\", 0.001),\n", " (\"What's the weather forecast for {}\", 0.002),\n", " (\"What is the best weather in {}\", 0.001),\n", " (\"Is the weather today in {}\", 0.001),\n", " (\"Current temperature in {}\", 0.001),\n", " (\"Storms in {}\", 0.0007),\n", " (\"Humidity in {}\", 0.003),\n", " (\"Windy in {}\", 0.0005),\n", " (\"Snow in {}\", 0.009),\n", " (\"Weather radar in {}\", 0.005),\n", " (\"The temperature in {}\", 0.005),\n", " (\"Weather like in {}\", 0.006),\n", " (\"What's the temperature in {}\", 0.001),\n", " (\"Is the weather like in {}\", 0.006),\n", "\n", " # # Additional Patterns (10% of original weight)\n", " (\"weather {}\", 0.10 * 0.539),\n", " (\"{} weather\", 0.10 * 0.539),\n", " (\"temperature {}\", 0.10 * 0.033),\n", " (\"{} temperature\", 0.10 * 0.033),\n", "]\n", "\n", "# Expanding the typo variants further to include the common misspellings for \"weather\", \"temperature\", and \"forecast\"\n", "extended_typo_variants = [\n", " # Misspellings for \"weather\"\n", " (\"weathr {}\", 0.20 * 0.539),\n", " (\"{} weathr\", 0.20 * 0.539),\n", " (\"The weathr in {}\", 0.20 * 0.539),\n", " (\"What is the weathr in {}\", 0.20 * 0.499),\n", " (\"What's the weathr in {}\", 0.20 * 0.046),\n", " (\"Weathr forecast in {}\", 0.20 * 0.039),\n", " (\"What is the weathr like in {}\", 0.20 * 0.009),\n", " (\"The wether in {}\", 0.20 * 0.539),\n", " (\"What is the wether in {}\", 0.20 * 0.499),\n", " (\"What's the wether in {}\", 0.20 * 0.046),\n", " (\"Wether forecast in {}\", 0.20 * 0.039),\n", " (\"What is the wether like in {}\", 0.20 * 0.009),\n", " (\"The weater in {}\", 0.20 * 0.539),\n", " (\"What is the weater in {}\", 0.20 * 0.499),\n", " (\"What's the weater in {}\", 0.20 * 0.046),\n", " (\"Weater forecast in {}\", 0.20 * 0.039),\n", " (\"What is the weater like in {}\", 0.20 * 0.009),\n", " (\"The wather in {}\", 0.20 * 0.539),\n", " (\"What is the wather in {}\", 0.20 * 0.499),\n", " (\"What's the wather in {}\", 0.20 * 0.046),\n", " (\"Wather forecast in {}\", 0.20 * 0.039),\n", " (\"What is the wather like in {}\", 0.20 * 0.009),\n", " (\"The weahter in {}\", 0.20 * 0.539),\n", " (\"What is the weahter in {}\", 0.20 * 0.499),\n", " (\"What's the weahter in {}\", 0.20 * 0.046),\n", " (\"Weahter forecast in {}\", 0.20 * 0.039),\n", " (\"What is the weahter like in {}\", 0.20 * 0.009),\n", " (\"The weaher in {}\", 0.20 * 0.539),\n", " (\"What is the weaher in {}\", 0.20 * 0.499),\n", " (\"What's the weaher in {}\", 0.20 * 0.046),\n", " (\"Weaher forecast in {}\", 0.20 * 0.039),\n", " (\"What is the weaher like in {}\", 0.20 * 0.009),\n", " (\"The waether in {}\", 0.20 * 0.539),\n", " (\"What is the waether in {}\", 0.20 * 0.499),\n", " (\"What's the waether in {}\", 0.20 * 0.046),\n", " (\"Waether forecast in {}\", 0.20 * 0.039),\n", " (\"What is the waether like in {}\", 0.20 * 0.009),\n", "\n", " # Misspellings for \"temperature\"\n", " (\"What is the temprature in {}\", 0.20 * 0.033),\n", " (\"What is the temperture in {}\", 0.20 * 0.033),\n", " (\"What is the tempreture in {}\", 0.20 * 0.033),\n", " (\"What is the tempratuer in {}\", 0.20 * 0.033),\n", " (\"What is the tempratue in {}\", 0.20 * 0.033),\n", " (\"What is the tempertuer in {}\", 0.20 * 0.033),\n", " (\"What is the tempretuer in {}\", 0.20 * 0.033),\n", " (\"What is the temprture in {}\", 0.20 * 0.033),\n", "\n", " # Misspellings for \"forecast\"\n", " (\"Forcast in {}\", 0.20 * 0.039),\n", " (\"What is the forcast for {}\", 0.20 * 0.034),\n", " (\"Forcst in {}\", 0.20 * 0.039),\n", " (\"What is the forcst for {}\", 0.20 * 0.034),\n", " (\"Forescast in {}\", 0.20 * 0.039),\n", " (\"What is the forescast for {}\", 0.20 * 0.034),\n", " (\"Forecats in {}\", 0.20 * 0.039),\n", " (\"What is the forecats for {}\", 0.20 * 0.034),\n", " (\"Forcaste in {}\", 0.20 * 0.039),\n", " (\"What is the forcaste for {}\", 0.20 * 0.034),\n", " (\"Forecst in {}\", 0.20 * 0.039),\n", " (\"What is the forecst for {}\", 0.20 * 0.034),\n", " (\"Forecase in {}\", 0.20 * 0.039),\n", " (\"What is the forecase for {}\", 0.20 * 0.034),\n", " (\"Foercast in {}\", 0.20 * 0.039),\n", " (\"What is the foercast for {}\", 0.20 * 0.034),\n", "]\n", "\n", "# Combine original templates and the expanded typo variants\n", "weather_templates_extended = weather_templates + extended_typo_variants\n", "\n", "\n", "weather_templates_df = pd.DataFrame(weather_templates_extended, columns=['pattern', 'weight'])\n", "weather_templates_df['weight'] = weather_templates_df['weight'] / weather_templates_df['weight'].sum()\n", "weather_templates_df" ] }, { "cell_type": "code", "execution_count": null, "id": "5f7a5dac-3cf3-4dbf-afbd-47a5da68b0c3", "metadata": {}, "outputs": [], "source": [ "weather_templates_df.head(50)" ] }, { "cell_type": "code", "execution_count": null, "id": "1a67329c-76ca-4373-ac9c-ed534fdc5c7e", "metadata": {}, "outputs": [], "source": [ "import pandas as pd\n", "import requests\n", "from bs4 import BeautifulSoup\n", "import re" ] }, { "cell_type": "code", "execution_count": null, "id": "ea6893d5-b299-46a0-ad10-90aec1b549ea", "metadata": {}, "outputs": [], "source": [ "url = \"https://en.m.wikipedia.org/wiki/List_of_television_stations_in_North_America_by_media_market\"\n", "response = requests.get(url)\n", "\n", "if response.status_code == 200:\n", " soup = BeautifulSoup(response.content, 'html.parser')\n", " dma_heading = soup.find('h4', string='DMAs')\n", " dma_list = dma_heading.find_next('ul')\n", " \n", " dma_data = []\n", " if dma_list:\n", " for li in dma_list.find_all('li'):\n", " market_name = li.get_text(strip=True)\n", "\n", " # Split by dash (-) or en-dash (–) to handle cases like \"Dallas-Fort Worth\"\n", " split_names = re.split(r'–|-', market_name)\n", "\n", " # Process each split name\n", " for name in split_names:\n", " # Remove the (#NUM) part using regex\n", " name = re.sub(r'\\s*\$#\\d+\$', '', name).strip()\n", "\n", " # Check if there's a city in parentheses and split them\n", " match = re.match(r'(.+?)\\s*\$(.+?)\$', name)\n", " if match:\n", " main_city = match.group(1).strip()\n", " parenthetical_city = match.group(2).strip()\n", " dma_data.append(main_city) # Add the main city\n", " dma_data.append(parenthetical_city) # Add the city in parentheses\n", " else:\n", " dma_data.append(name) \n", "\n" ] }, { "cell_type": "code", "execution_count": null, "id": "8fbf33d4-9444-4393-aedd-8d9018f62f5e", "metadata": {}, "outputs": [], "source": [ "len(dma_data)" ] }, { "cell_type": "code", "execution_count": null, "id": "5b44b189-d1a9-43b2-999f-eca76b777f6a", "metadata": {}, "outputs": [], "source": [ "print(dma_data)" ] }, { "cell_type": "code", "execution_count": null, "id": "903a2437-a2dd-4ad7-a60c-f6572bc2387a", "metadata": {}, "outputs": [], "source": [ "from collections import Counter\n", "\n", "# months\n", "months = [\"January\", \"February\", \"March\", \"April\", \"May\", \"June\", \"July\", \"August\", \"September\", \"October\", \"November\", \"December\"]\n", "\n", "# Function to generate random queries with 30% lowercased\n", "def generate_queries_with_case(df, cities, months, num_queries=10, lower_case_prob=0.3):\n", " queries = set()\n", " cnt = 0\n", " pattern_counter = Counter()\n", " while cnt < num_queries:\n", " # Choose a pattern based on the weights\n", " pattern = random.choices(df['pattern'], weights=df['weight'], k=1)[0]\n", " \n", " # Replace placeholders in the pattern with a random city and/or month\n", " city = random.choice(cities)\n", " if \"{} in {}\" in pattern:\n", " month = random.choice(months)\n", " query = pattern.format(city, month)\n", " else:\n", " query = pattern.format(city)\n", "\n", " if pattern_counter.get(pattern, 0) > num_queries//10:\n", " continue\n", " pattern_counter.update([pattern])\n", " \n", " # Randomly convert the query to lowercase with the given probability\n", " if random.random() < lower_case_prob:\n", " query = query.lower()\n", "\n", " if query not in queries:\n", " queries.add(query)\n", " cnt += 1\n", " \n", " return list(queries), pattern_counter\n", "\n", "# Generate 10 sample queries with 30% in lowercase\n", "sample_queries_with_case, pattern_counter = generate_queries_with_case(weather_templates_df, dma_data, months, num_queries=10000, lower_case_prob=0.3)\n", "\n", "print(len(sample_queries_with_case))\n", "sample_queries_with_case[:10]\n" ] }, { "cell_type": "code", "execution_count": null, "id": "2eb0604c-7b51-44a8-b59c-e0428cc2b893", "metadata": { "scrolled": true }, "outputs": [], "source": [ "pattern_counter" ] }, { "cell_type": "code", "execution_count": null, "id": "27b3d603-8fae-4654-840a-72657a9cc2f8", "metadata": {}, "outputs": [], "source": [ "# sample_queries_with_case[1000:2000]" ] }, { "cell_type": "code", "execution_count": null, "id": "4bf13d65-0af9-4cf9-b7e1-92a018a5715b", "metadata": {}, "outputs": [], "source": [ "# sample_queries_with_case[:100]\n", "weather_examples = pd.DataFrame(sample_queries_with_case, columns=['sequence'])\n", "weather_examples['target'] = 'weather_intent'\n", "weather_examples" ] }, { "cell_type": "markdown", "id": "9d6bf011-ff0c-4586-99a0-8ab5ddcc5090", "metadata": {}, "source": [ "#### Yelp examples" ] }, { "cell_type": "code", "execution_count": null, "id": "8990d49c-5d1d-4157-be4d-301294984b11", "metadata": {}, "outputs": [], "source": [ "# Original Yelp Intent Templates\n", "yelp_intent_templates = [\n", " (\"What are the best restaurants in {}\", 0.12),\n", " (\"Top-rated restaurants in {}\", 0.10),\n", " (\"Popular coffee shops in {}\", 0.09),\n", " (\"Best pizza places in {}\", 0.08),\n", " (\"Best sushi places in {}\", 0.07),\n", " (\"Cheap restaurants in {}\", 0.06),\n", " (\"Best places to eat in {}\", 0.06),\n", " (\"Restaurants near me in {}\", 0.05),\n", " # (\"What is the average cost of a meal in {}\", 0.04),\n", " (\"Best Italian restaurants in {}\", 0.04),\n", " (\"Best fast food restaurants in {}\", 0.04),\n", " (\"Mexican restaurants in {}\", 0.03),\n", " (\"Chinese food near me in {}\", 0.03),\n", " (\"Best hotels in {}\", 0.03),\n", " (\"Affordable hotels in {}\", 0.03),\n", " (\"Best parks to visit in {}\", 0.02),\n", " (\"Best attractions in {}\", 0.02),\n", " (\"Popular things to do in {}\", 0.02),\n", " (\"Best shopping centers in {}\", 0.02),\n", " (\"Best gyms in {}\", 0.02),\n", " (\"Top hair salons in {}\", 0.02),\n", " (\"What are the best-rated dentists in {}\", 0.02),\n", " (\"Local plumbers in {}\", 0.02),\n", " (\"Popular electricians in {}\", 0.02),\n", " # (\"What is the phone number for a restaurant in {}\", 0.02),\n", " # (\"Phone number for hotels in {}\", 0.02),\n", " (\"Top-rated cafes in {}\", 0.02),\n", " (\"Best massage spas in {}\", 0.02),\n", " (\"Grocery stores near me in {}\", 0.02),\n", " (\"Where can I buy clothes in {}\", 0.01),\n", " (\"Pharmacies near me in {}\", 0.01),\n", " (\"Best bars in {}\", 0.01),\n", " (\"Cocktail bars in {}\", 0.01),\n", " (\"Family-friendly restaurants in {}\", 0.01),\n", " (\"Kid-friendly restaurants in {}\", 0.01),\n", " (\"Pet-friendly restaurants in {}\", 0.01),\n", " (\"Vegan restaurants in {}\", 0.01),\n", " (\"Best rooftop bars in {}\", 0.01),\n", " (\"Top pizza delivery places in {}\", 0.01),\n", " (\"Where can I get sushi in {}\", 0.01),\n", " (\"Best food delivery services in {}\", 0.01),\n", " (\"Catering services in {}\", 0.01),\n", " (\"Top-rated bakeries in {}\", 0.01),\n", " (\"Where can I find a gym in {}\", 0.01),\n", " (\"Yoga studios near me in {}\", 0.01),\n", " # (\"What’s the cost of living in {}\", 0.01),\n", " # (\"How much does it cost to live in {}\", 0.01),\n", " (\"Best places for nightlife in {}\", 0.01),\n", " (\"Local car repair shops in {}\", 0.01),\n", " (\"Best car rental services in {}\", 0.01),\n", " (\"{} restaurants\", 0.02),\n", " (\"{} hotels\", 0.02),\n", " (\"{} food\", 0.02),\n", "]\n", "\n", "# Function to add typos to templates\n", "def add_typos_to_template(template, typo_prob=0.1):\n", " typos = {\n", " \"restaurants\": [\"restarants\", \"resturants\", \"restrants\"],\n", " \"best\": [\"bst\", \"besst\", \"bet\"],\n", " \"popular\": [\"populer\", \"ppular\", \"poplar\"],\n", " \"coffee\": [\"cofee\", \"cofffe\", \"cofee\"],\n", " \"pizza\": [\"piza\", \"pzza\", \"piza\"],\n", " \"hotels\": [\"hoetls\", \"hotls\", \"hoetls\"],\n", " \"places\": [\"plces\", \"place\", \"palces\"],\n", " \"attractions\": [\"attractons\", \"atrctions\", \"attractins\"],\n", " \"cheap\": [\"chep\", \"cheep\", \"cheap\"],\n", " \"meal\": [\"mel\", \"meel\", \"male\"],\n", " \"cost\": [\"cst\", \"cots\", \"cot\"],\n", " \"living\": [\"lving\", \"livng\", \"livin\"],\n", " \"yoga\": [\"yga\", \"yoaga\", \"ygoa\"],\n", " \"food\": [\"fod\", \"fud\", \"fodd\"],\n", " \"parks\": [\"praks\", \"parcs\", \"paks\"],\n", " \"near\": [\"ner\", \"neer\", \"naer\"],\n", " \"bar\": [\"bar\", \"ber\", \"baer\"],\n", " \"family\": [\"famly\", \"famliy\", \"faimly\"],\n", " \"friendly\": [\"frindly\", \"frendly\", \"friendley\"]\n", " }\n", "\n", " words = template.split()\n", " for i, word in enumerate(words):\n", " if word.lower().strip(\"{}\") in typos and random.random() < typo_prob:\n", " words[i] = random.choice(typos[word.lower().strip(\"{}\")])\n", " return \" \".join(words)\n", "\n", "# Extending the list with typos\n", "extended_yelp_intent_templates = []\n", "extended_yelp_intent_templates_set = set()\n", "\n", "for template, weight in yelp_intent_templates:\n", " if template in extended_yelp_intent_templates_set:\n", " continue\n", " extended_yelp_intent_templates.append((template, weight))\n", " extended_yelp_intent_templates_set.add(template)\n", " \n", " # Adding a typo variant 10-20% of the time\n", " if random.random() < 0.2:\n", " typo_template = add_typos_to_template(template)\n", " typo_weight = weight * 0.2 # Typos occur less frequently, so reduce weight\n", " if typo_template in extended_yelp_intent_templates_set:\n", " continue\n", " extended_yelp_intent_templates.append((typo_template, typo_weight))\n", " extended_yelp_intent_templates_set.add(typo_template)\n", "\n", "# Convert to DataFrame for better readability\n", "df_extended_yelp_intent_templates = pd.DataFrame(extended_yelp_intent_templates, columns=[\"pattern\", \"weight\"])\n", "df_extended_yelp_intent_templates['weight'] = df_extended_yelp_intent_templates['weight'] / df_extended_yelp_intent_templates['weight'].sum()\n", "df_extended_yelp_intent_templates" ] }, { "cell_type": "code", "execution_count": null, "id": "d544569b-dace-4aff-a3c3-924124dbc596", "metadata": {}, "outputs": [], "source": [ "list(weather_templates_df['pattern'].values) + list(df_extended_yelp_intent_templates['pattern'].values)" ] }, { "cell_type": "code", "execution_count": null, "id": "d126b403-f7bc-49ee-aff6-b89b10bc7e63", "metadata": {}, "outputs": [], "source": [ "# Function to generate random queries with 30% lowercased\n", "def generate_yelp_queries_with_case(df, cities, num_queries=10, lower_case_prob=0.3):\n", " queries = set()\n", " cnt = 0\n", " pattern_counter = Counter()\n", " while cnt < num_queries:\n", " # Choose a pattern based on the weights\n", " pattern = random.choices(df['pattern'], weights=df['weight'], k=1)[0]\n", " \n", " # Replace placeholders in the pattern with a random city and/or month\n", " city = random.choice(cities)\n", " query = pattern.format(city)\n", "\n", " if pattern_counter.get(pattern, 0) > num_queries//10:\n", " continue\n", " pattern_counter.update([pattern])\n", " \n", " # Randomly convert the query to lowercase with the given probability\n", " if random.random() < lower_case_prob:\n", " query = query.lower()\n", "\n", " if query not in queries:\n", " queries.add(query)\n", " cnt += 1\n", " \n", " return list(queries), pattern_counter" ] }, { "cell_type": "code", "execution_count": null, "id": "2ef143ad-f441-4ade-9b11-47b5fad2c2a0", "metadata": {}, "outputs": [], "source": [ "# Generate 10 sample queries with 30% in lowercase\n", "sample_yelp_queries_with_case, pattern_counter = generate_yelp_queries_with_case(df_extended_yelp_intent_templates, dma_data, num_queries=3000, lower_case_prob=0.4) #10000\n", "\n", "print(len(sample_yelp_queries_with_case))\n", "sample_yelp_queries_with_case[:10]" ] }, { "cell_type": "code", "execution_count": null, "id": "0c5ed901-17fa-4d02-8e38-cee2339b9ab1", "metadata": { "scrolled": true }, "outputs": [], "source": [ "# sample_yelp_queries_with_case" ] }, { "cell_type": "code", "execution_count": null, "id": "77c83fc5-78f7-4788-bf82-46ad48e29c6d", "metadata": {}, "outputs": [], "source": [ "pattern_counter" ] }, { "cell_type": "code", "execution_count": null, "id": "01d72484-d62a-44ef-a43c-0323e1e0ba36", "metadata": {}, "outputs": [], "source": [ "yelp_examples = pd.DataFrame(sample_yelp_queries_with_case, columns=['sequence'])\n", "yelp_examples['target'] = 'yelp_intent'\n", "yelp_examples" ] }, { "cell_type": "markdown", "id": "a9b40aad-b0a9-448e-b5bc-7587ab7284db", "metadata": {}, "source": [ "#### Purchase intent data augmentation" ] }, { "cell_type": "code", "execution_count": null, "id": "ff82c9f7-14ab-4d58-957c-1621b030fa78", "metadata": {}, "outputs": [], "source": [ "electronics = [\n", " 'iPhone', 'Samsung Galaxy', 'MacBook', 'PlayStation 5', 'AirPods', 'Xbox Series X', 'Canon DSLR', \n", " 'GoPro', 'Fitbit', 'Google Pixel', 'Bose headphones', 'Sony TV', 'Apple Watch', 'Nintendo Switch', \n", " 'Kindle', 'Sony WH-1000XM4', 'Microsoft Surface', 'DJI Drone', 'Logitech Webcam', 'HP Spectre x360', \n", " 'Dell XPS 13', 'Roku streaming stick', 'Apple iPad', 'Samsung QLED TV', 'LG OLED TV', \n", " 'JBL Bluetooth speaker', 'Amazon Echo', 'Nest Thermostat', 'Oculus Quest 2', 'Tile Tracker', \n", " 'Sony PlayStation VR', 'Huawei MateBook', 'Garmin watch', 'Bose Soundbar', 'Canon mirrorless camera',\n", " 'Nikon Coolpix', 'WD external hard drive', 'Seagate backup drive', 'Razer gaming mouse', 'Corsair keyboard'\n", "]\n", "\n", "home_appliances = [\n", " 'Dyson vacuum', 'Roomba', 'KitchenAid mixer', 'Ninja air fryer', 'Instant Pot', 'LG refrigerator', \n", " 'Samsung washing machine', 'Whirlpool dryer', 'Panasonic microwave', 'Breville toaster oven', \n", " 'Miele dishwasher', 'Cuisinart coffee maker', 'GE oven', 'Philips air purifier', 'Hoover carpet cleaner', \n", " 'Honeywell thermostat', 'LG air conditioner', 'Bosch induction cooktop', 'Crock-Pot', 'Frigidaire freezer',\n", " 'Black+Decker blender', 'Sunbeam iron', 'KitchenAid food processor', 'Keurig coffee maker', 'NutriBullet blender',\n", " 'Magic Bullet', 'Hamilton Beach rice cooker', 'DeLonghi espresso machine', 'Dyson fan', 'Electrolux washer',\n", " 'Whirlpool stove', 'Bissell vacuum', 'Toshiba microwave', 'Vitamix blender', 'Smart humidifier'\n", "]\n", "\n", "furnitures = [\n", " 'Ikea sofa', 'West Elm dining table', 'La-Z-Boy recliner', 'Ashley bed frame', 'Herman Miller chair', \n", " 'CB2 bookshelf', 'Pottery Barn desk', 'Crate & Barrel coffee table', 'Sealy mattress', 'Serta sectional sofa',\n", " 'Wayfair sideboard', 'RH leather chair', 'Flexsteel armchair', 'Sauder TV stand', 'Modway bar stool',\n", " 'Tempur-Pedic mattress', 'Ikea wardrobe', 'Zinus platform bed', 'Ashley loveseat', 'AllModern bench',\n", " 'Bed Bath & Beyond dresser', 'Tuft & Needle mattress', 'Article couch', 'Living Spaces end table',\n", " 'West Elm armchair', 'Burrow sectional', 'Bloomingdale’s accent chair', 'Castlery coffee table', 'Raymour & Flanigan bookcase',\n", " 'Casper mattress', 'Simmons futon', 'Sleep Number adjustable bed', 'Havertys recliner', 'Anthropologie console'\n", "]\n", "\n", "\n", "fashion_and_clothing = [\n", " 'Nike shoes', 'Adidas sneakers', 'Levi’s jeans', 'Gucci handbag', 'Rolex watch', 'Ray-Ban sunglasses', \n", " 'Patagonia jacket', 'H&M dress', 'Michael Kors purse', 'North Face parka', 'Calvin Klein suit', 'Under Armour hoodie', \n", " 'Puma sneakers', 'Tommy Hilfiger t-shirt', 'Lululemon leggings', 'Vans skate shoes', 'Coach wallet', 'Fossil watch', \n", " 'Zara coat', 'Birkenstock sandals', 'Uniqlo turtleneck', 'Balenciaga sneakers', 'Supreme hoodie', 'Carhartt work pants', \n", " 'Burberry trench coat', 'Lacoste polo', 'Forever 21 dress', 'Mango blouse', 'Gap denim jacket',\n", " 'Old Navy shorts', 'Lands’ End swimwear', 'Diesel jeans', 'Victoria’s Secret lingerie', 'Ralph Lauren blazer'\n", "]\n", "\n", "beauty_and_personal_care = [\n", " 'Dior perfume', 'Chanel foundation', 'Neutrogena moisturizer', 'MAC lipstick', 'Olay anti-aging cream', \n", " 'Pantene shampoo', 'Gillette razor', 'Oral-B electric toothbrush', 'Clarisonic face brush', 'Nivea body lotion',\n", " 'L’Oreal conditioner', 'Revlon hair dryer', 'Estee Lauder serum', 'Clinique cleanser', 'Philips hair trimmer',\n", " 'Remington hair straightener', 'Aveeno sunscreen', 'Aveda hair oil', 'La Roche-Posay sunscreen', 'Anastasia eyebrow pencil',\n", " 'Biore face wash', 'Urban Decay eye shadow', 'Maybelline mascara', 'Cetaphil cleanser', 'TRESemme conditioner',\n", " 'Garnier micellar water', 'Rimmel lip gloss', 'Kiehl’s toner', 'Moroccan Oil treatment', 'Huda Beauty contour palette',\n", " 'Tom Ford lipstick', 'Charlotte Tilbury foundation', 'Tatcha face mask', 'Fenty Beauty highlighter', 'Paula’s Choice exfoliant'\n", "]\n", "\n", "\n", "automotives = [\n", " 'Tesla Model S', 'Ford Mustang', 'Chevrolet Camaro', 'Toyota Corolla', 'Honda Civic', 'BMW X5', \n", " 'Mercedes-Benz GLC', 'Jeep Wrangler', 'Ford F-150', 'Hyundai Tucson', 'Mazda CX-5', 'Volkswagen Jetta', \n", " 'Nissan Altima', 'Dodge Ram', 'Chevrolet Tahoe', 'Lexus RX', 'Kia Sorento', 'Subaru Outback', 'Volvo XC90', \n", " 'Cadillac Escalade', 'Audi Q5', 'Porsche Cayenne', 'Land Rover Defender', 'Toyota Highlander', 'Jaguar F-Pace',\n", " 'Acura MDX', 'Chrysler Pacifica', 'Honda CR-V', 'Ram 1500', 'GMC Sierra', 'Alfa Romeo Stelvio', 'Lincoln Navigator'\n", "]\n", "\n", "household_items = [\n", " 'Tide laundry detergent', 'Scotch-Brite sponges', 'Bounty paper towels', 'Clorox bleach', 'Ziploc bags', \n", " 'Swiffer mop', 'Mr. Clean Magic Eraser', 'Glad trash bags', 'Febreze air freshener', 'Lysol disinfectant spray',\n", " 'Dawn dish soap', 'Windex glass cleaner', 'Arm & Hammer baking soda', 'Tupperware', 'Brita water filter',\n", " 'O-Cedar mop', 'Scrub Daddy', 'Bounce dryer sheets', 'Hefty storage containers', 'Method all-purpose cleaner',\n", " 'Cascade dishwasher pods', 'Pledge furniture polish', 'Comet bathroom cleaner', 'Woolite laundry detergent',\n", " 'Soft Scrub cleaner', 'Reynolds Wrap foil', 'Cling film wrap', 'Magic Zipper bags', 'Pine-Sol floor cleaner',\n", " 'OxiClean stain remover', 'Scotch tape', 'Command hooks', 'Tide Pods', 'Microfiber cloths'\n", "]\n", "\n", "toys_and_games = [\n", " 'LEGO sets', 'Barbie dolls', 'Hot Wheels cars', 'Nerf blasters', 'Fisher-Price playsets', 'Monopoly board game', \n", " 'Jenga', 'Uno card game', 'Crayola coloring kits', 'Play-Doh sets', 'Marvel action figures', 'RC cars', \n", " 'Beyblade', 'Transformers toys', 'Super Soaker water guns', 'Paw Patrol toys', 'My Little Pony dolls', \n", " 'Magic: The Gathering cards', 'Lego Mindstorms', 'Nintendo Switch games', 'Fortnite Nerf blasters', 'Scrabble', \n", " 'Guess Who?', 'Minecraft LEGOs', 'Funko Pop figures', 'Mega Bloks', 'Hasbro puzzles', 'FurReal Pets', 'LOL Surprise dolls',\n", " 'Disney Princess dolls', 'Harry Potter LEGO', 'X-shot blasters', 'Playmobil sets', 'Star Wars LEGO sets'\n", "]\n", "\n", "books_and_media = [\n", " 'Harry Potter books', 'The Lord of the Rings', 'The Great Gatsby', 'To Kill a Mockingbird', '1984 by George Orwell', \n", " 'The Catcher in the Rye', 'The Hunger Games', 'Game of Thrones', 'Twilight series', 'Sherlock Holmes novels',\n", " 'The Da Vinci Code', 'The Alchemist', 'The Chronicles of Narnia', 'Percy Jackson series', 'The Maze Runner',\n", " 'The Girl with the Dragon Tattoo', 'Moby Dick', 'Pride and Prejudice', 'The Handmaid’s Tale', 'The Witcher series',\n", " 'Outlander series', 'Dracula', 'Little Women', 'Gone with the Wind', 'Dune', 'The Hobbit', 'Fifty Shades of Grey', \n", " 'The Shining', 'The Road', 'Jurassic Park', 'Catch-22', 'The Time Traveler’s Wife', 'The Giver', 'The Color Purple', 'Beloved'\n", "]\n", "\n", "sport_equipments = [\n", " 'Nike soccer ball', 'Wilson tennis racket', 'Adidas football cleats', 'Spalding basketball', 'Under Armour workout gloves', \n", " 'Yonex badminton racket', 'Callaway golf clubs', 'Fitbit fitness tracker', 'Everlast boxing gloves', 'Wilson baseball glove',\n", " 'Babolat tennis shoes', 'Reebok CrossFit gear', 'Nike running shoes', 'Speedo swim goggles', 'Bauer hockey skates',\n", " 'Garmin GPS watch', 'Rawlings baseball bat', 'Easton batting gloves', 'Columbia hiking boots', 'Asics running shoes',\n", " 'NordicTrack treadmill', 'ProForm elliptical', 'Bowflex dumbbells', 'Schwinn stationary bike', 'Theragun massager',\n", " 'Rogue kettlebells', 'Concept2 rower', 'Under Armour mouthguard', 'Lululemon yoga mat', 'Sklz agility ladder'\n", "]\n", "\n", "gifts = [\n", " 'custom gifts', 'gift cards', 'personalized mugs', 'engraved jewelry', 'photo frames', 'custom t-shirts', \n", " 'personalized blankets', 'engraved watches', 'photo books', 'custom calendars', 'digital photo frames', \n", " 'chocolate gift boxes', 'flower bouquets', 'monogrammed bags', 'engraved rings', 'handmade candles',\n", " 'subscription boxes', 'custom puzzles', 'personalized stationery', 'custom keychains'\n", "]\n", "\n", "hunting_equipment = [\n", " 'crossbow', 'compound bow', 'hunting knives', 'camouflage clothing',\n", " 'deer stand', 'trail camera', 'hunting boots', 'binoculars', \n", " 'rangefinder', 'backpack for hunting'\n", "]\n", "\n", "eyewear = [\n", " 'prescription glasses', 'sunglasses', 'blue light blocking glasses',\n", " 'bifocals', 'transition lenses', 'polarized sunglasses',\n", " 'contact lenses', 'eyeglass frames', 'sports glasses', 'reading glasses'\n", "]\n", "\n", "supplements = [\n", " 'magnesium taurate', 'vitamin D', 'fish oil', 'multivitamins',\n", " 'probiotics', 'protein powder', 'collagen', 'iron supplements',\n", " 'zinc supplements', 'calcium supplements'\n", "]\n", "\n", "pet_supplies = [\n", " 'dog food', 'cat food', 'pet beds', 'dog treats', 'pet grooming kits',\n", " 'cat litter', 'dog toys', 'cat scratchers', 'pet carriers', 'pet feeders'\n", "]\n", "\n", "bedding = [\n", " 'queen size bedspreads', 'king size comforter sets', 'sheets',\n", " 'duvet covers', 'pillows', 'mattress protectors', 'weighted blankets',\n", " 'electric blankets', 'bamboo sheets', 'silk pillowcases'\n", "]\n", "##\n", "kitchen_appliance = [\n", " 'blender', 'air fryer', 'pressure cooker', 'food processor',\n", " 'stand mixer', 'toaster oven', 'microwave', 'coffee maker',\n", " 'deep fryer', 'slow cooker'\n", "]\n", "\n", "automotive_parts = [\n", " 'tires', 'car batteries', 'carburetors', 'brake pads', \n", " 'windshield wipers', 'car mats', 'air filters', 'engine oil',\n", " 'spark plugs', 'headlights'\n", "]\n", "\n", "tech_accessories = [\n", " 'phone case', 'charging cable', 'laptop sleeve', 'wireless charger',\n", " 'screen protector', 'portable battery', 'USB hub', 'headphone adapter',\n", " 'keyboard cover', 'stylus pen'\n", "]\n", "\n", "fitness_equipment = [\n", " 'treadmill', 'dumbbells', 'resistance bands', 'exercise bike',\n", " 'yoga mat', 'pull-up bar', 'rowing machine', 'kettlebell',\n", " 'weight bench', 'jump rope'\n", "]\n", "\n", "seasonal_products = [\n", " 'Christmas tree', 'holiday lights', 'Halloween costumes',\n", " 'summer outdoor furniture', 'Thanksgiving decorations',\n", " 'winter jackets', 'snow blowers', 'Easter baskets', 'grills', 'pool accessories'\n", "]\n", "\n", "platform = [\n", " 'Amazon', 'eBay', 'Walmart', 'Best Buy', 'Target',\n", " 'Apple Store', 'Google Store', 'Newegg', 'B&H', 'Costco',\n", "] \n", "\n", "\n", "event = [\n", " 'Coachella', 'Lollapalooza', 'Burning Man', 'Comic-Con', 'The Oscars',\n", " 'Super Bowl', 'World Series', 'NBA Finals', 'Wimbledon', 'Grammy Awards',\n", "]\n", "\n", "festival = [\n", " 'Coachella', 'Lollapalooza', 'Burning Man', 'Tomorrowland', 'SXSW',\n", " 'Glastonbury', 'Oktoberfest', 'Mardi Gras', 'Cannes Film Festival', 'Sundance Film Festival',\n", " 'Ultra Music Festival', 'New Orleans Jazz & Heritage Festival', 'Austin City Limits', 'Bonnaroo', 'Electric Daisy Carnival',\n", " 'Stagecoach', 'Summerfest', 'Essence Festival', 'Rock in Rio', 'Woodstock',\n", "]\n", "\n", "artist = [\n", " 'Taylor Swift', 'Beyoncé', 'Ed Sheeran', 'Drake', 'Ariana Grande',\n", " 'Billie Eilish', 'The Weeknd', 'Justin Bieber', 'Kanye West', 'Rihanna',\n", " 'Bruno Mars', 'Shawn Mendes', 'Dua Lipa', 'Travis Scott', 'Lady Gaga',\n", " 'Post Malone', 'Harry Styles', 'Adele', 'Coldplay', 'Imagine Dragons',\n", "]\n" ] }, { "cell_type": "code", "execution_count": null, "id": "68e4ba9f-9c35-492f-bed1-6f0198ac9983", "metadata": {}, "outputs": [], "source": [ "purchase_intent_templates = [\n", " # Electronics Purchase Intent\n", " \"{electronics} price\",\n", " \"Where to buy {electronics} online?\",\n", " \"Best deals on {electronics} this year\",\n", " \"Is {electronics} worth buying in 2024?\",\n", " \"Discounts available for {electronics}?\",\n", " # \"How to repair {electronics} at home?\",\n", " \"Which is better: {electronics} or {electronics}?\",\n", " \"Where to buy used {electronics}?\",\n", " \"Is {electronics} in stock near me?\",\n", " \"What {electronics} make the best gifts?\",\n", " \"Top-rated {electronics} to buy as a gift\",\n", " \"Is {electronics} available with free shipping?\",\n", " \"What stores sell {electronics} with warranties?\",\n", " \"Where to find refurbished {electronics}?\",\n", " \"How long does {electronics} last?\",\n", " \"Can I get extended warranty for {electronics}?\",\n", " \n", " # Home Appliances Purchase Intent\n", " \"{home_appliance} price\",\n", " \"Where to buy {home_appliance} at the best price?\",\n", " \"How to repair a {home_appliance}?\",\n", " \"Best deals on {home_appliance} right now\",\n", " \"What are the reviews for {home_appliance}?\",\n", " \"Should I upgrade my {home_appliance} this year?\",\n", " \"Compare {home_appliance} with {home_appliance} for best value\",\n", " \"Are refurbished {home_appliance} worth buying?\",\n", " \"Where can I find {home_appliance} available now?\",\n", " \"Most energy-efficient {home_appliance} in 2024\",\n", " \"Best {home_appliance} for small spaces\",\n", " \"How to maintain a {home_appliance}?\",\n", " \"Top stores to buy {home_appliance} with discounts\",\n", " \n", " # Furniture Purchase Intent\n", " \"{furniture} price\",\n", " \"What is the best {furniture} for a small space?\",\n", " \"Where to buy affordable {furniture} online?\",\n", " \"Best places to buy {furniture} for my home\",\n", " \"Top-rated {furniture} on sale this weekend\",\n", " \"How to assemble {furniture} yourself\",\n", " \"Best {furniture} to buy as gifts for new homeowners\",\n", " \"Are {furniture} available for same-day delivery?\",\n", " \"What {furniture} brands have the best quality?\",\n", " \"Where to buy modern {furniture} for a living room?\",\n", " \"What’s trending in {furniture} for 2024?\",\n", " \"Top-rated stores for {furniture} deals\",\n", " \"How to clean and maintain {furniture}?\",\n", " \n", " # Fashion and Clothing Purchase Intent\n", " \"{fashion_and_clothing} price\",\n", " \"What are the latest deals on {fashion_and_clothing}?\",\n", " \"Where to buy {fashion_and_clothing} online?\",\n", " \"Top-rated {fashion_and_clothing} for this season\",\n", " \"Best styles of {fashion_and_clothing} in 2024\",\n", " \"Is {fashion_and_clothing} worth the price?\",\n", " \"What {fashion_and_clothing} brands are best for longevity?\",\n", " \"Where can I buy sustainable {fashion_and_clothing}?\",\n", " \"Is {fashion_and_clothing} available in plus sizes?\",\n", " \"Can I return {fashion_and_clothing} if it doesn’t fit?\",\n", " \"Where to find discounts on designer {fashion_and_clothing}?\",\n", " \n", " # Beauty and Personal Care Purchase Intent\n", " \"{beauty_and_personal_care} price\",\n", " \"Best {beauty_and_personal_care} products to buy this year\",\n", " \"Where to buy {beauty_and_personal_care} online?\",\n", " \"Top reviews for {beauty_and_personal_care} products\",\n", " \"Are {beauty_and_personal_care} products worth it?\",\n", " \"What are the best deals for {beauty_and_personal_care}?\",\n", " \"How to get a subscription for {beauty_and_personal_care} products?\",\n", " \"What stores sell natural {beauty_and_personal_care} products?\",\n", " \"Are {beauty_and_personal_care} available for sensitive skin?\",\n", " \"Top-rated {beauty_and_personal_care} for aging skin\",\n", " \"What are the best organic {beauty_and_personal_care} products?\",\n", " \n", " # Automotive Purchase Intent\n", " \"{automotive} price\",\n", " \"Is {automotive} a good car to buy?\",\n", " \"Best deals on {automotive} this year\",\n", " \"Where to buy {automotive} accessories?\",\n", " \"How to finance a new {automotive}?\",\n", " \"Top-rated {automotive} models in 2024\",\n", " \"What’s the lifespan of {automotive}?\",\n", " \"Where to find certified pre-owned {automotive}?\",\n", " \"Is {automotive} reliable for long drives?\",\n", " \"Can I test drive {automotive} near me?\",\n", " \"What’s the fuel efficiency of {automotive}?\",\n", " \n", " # Household Items Purchase Intent\n", " \"{household_item} price\",\n", " \"What are the top-rated {household_item} this year?\",\n", " \"Where to buy {household_item} online?\",\n", " \"How to get discounts on {household_item}?\",\n", " \"Are {household_item} worth buying?\",\n", " \"Top stores for {household_item} deals\",\n", " \"Eco-friendly {household_item} options available\",\n", " \"How to clean {household_item} properly?\",\n", " \"Top-rated {household_item} for allergies\",\n", " \"Where to find bulk deals on {household_item}?\",\n", " \n", " # Toys and Games Purchase Intent\n", " \"{toys_and_games} price\",\n", " \"Where to buy {toys_and_games} for kids?\",\n", " \"Best reviews for {toys_and_games}\",\n", " \"What are the best prices for {toys_and_games}?\",\n", " \"What are the top {toys_and_games} for Christmas?\",\n", " \"Top-rated {toys_and_games} on sale\",\n", " \"Best {toys_and_games} for educational purposes\",\n", " \"Where to find interactive {toys_and_games} for learning?\",\n", " \"Are {toys_and_games} safe for children under 5?\",\n", " \"What {toys_and_games} are best for birthdays?\",\n", " \n", " # Books and Media Purchase Intent\n", " \"{books_and_media} price\",\n", " \"Best places to buy {books_and_media} online\",\n", " \"What are the reviews for {books_and_media}?\",\n", " \"Is {books_and_media} worth buying?\",\n", " \"Top-rated {books_and_media} for this year\",\n", " \"What are the best deals on {books_and_media}?\",\n", " \"Where to buy a subscription for {books_and_media}?\",\n", " \"Are {books_and_media} available in eBook format?\",\n", " \"Is there an audiobook version of {books_and_media}?\",\n", " \"Can I find {books_and_media} in my local library?\",\n", " \n", " # Sports Equipment Purchase Intent\n", " \"{sport_equipments} price\",\n", " \"What are the best {sport_equipments} to buy?\",\n", " \"Where can I find discounts on {sport_equipments}?\",\n", " \"Top-rated {sport_equipments} for 2024\",\n", " \"Where to buy {sport_equipments} online?\",\n", " \"Are {sport_equipments} worth the price?\",\n", " \"What are the best deals on {sport_equipments}?\",\n", " \"Reviews of {sport_equipments} from users\",\n", " \"Where to buy {sport_equipments} for beginners?\",\n", " \"What are the must-have {sport_equipments} for athletes?\",\n", " \"Top stores offering deals on {sport_equipments}\",\n", " \"Can I rent {sport_equipments} instead of buying?\",\n", " \"What are the best {sport_equipments} for home training?\",\n", "\n", " # Gift-Related Queries\n", " \"{gifts} price\",\n", " \"Where to buy {gifts} online?\",\n", " \"Best deals on {gifts} this holiday season\",\n", " \"What {gifts} make the best presents?\",\n", " \"How to personalize {gifts} for special occasions?\",\n", " \"Are {gifts} available for same-day delivery?\",\n", " \"Top personalized {gifts} for anniversaries\",\n", " \"Unique {gifts} ideas for birthdays\",\n", " \"Affordable {gifts} for holidays\",\n", " \"Can I gift-wrap {gifts} at checkout?\",\n", " \"How to create custom {gifts} online?\",\n", " \n", " # Hunting Equipment Queries\n", " \"{hunting_equipment} price\",\n", " \"Best {hunting_equipment} for deer hunting\",\n", " \"Where to buy {hunting_equipment} online?\",\n", " \"What are the top {hunting_equipment} brands?\",\n", " \"How to maintain {hunting_equipment}?\",\n", " \"Where can I rent {hunting_equipment}?\",\n", " \"Top safety tips for using {hunting_equipment}\",\n", " \"What’s the best {hunting_equipment} for beginners?\",\n", " \n", " # Eyewear Queries\n", " \"{eyewear} price\",\n", " \"Where to order {eyewear} online?\",\n", " \"Best prices for {eyewear}\",\n", " \"Are {eyewear} available with insurance coverage?\",\n", " \"Top-rated {eyewear} for outdoor sports\",\n", " \"Where to get prescription {eyewear}?\",\n", " \"Which brands make the most durable {eyewear}?\",\n", " \"What are the best {eyewear} for UV protection?\",\n", " \n", " # Supplements Queries\n", " \"{supplements} price\",\n", " \"Where to buy {supplements} for health?\",\n", " \"Top reviews for {supplements}\",\n", " # \"What are the benefits of {supplements}?\",\n", " \"How to find discounts on {supplements}?\",\n", " \"Can I get a subscription for {supplements}?\",\n", " \"What are the best {supplements} for immunity?\",\n", " \"Are {supplements} safe for daily use?\",\n", " \"Top stores offering deals on {supplements}\",\n", " \n", " # Pet Supplies Queries\n", " \"{pet_supplies} price\",\n", " \"Where to buy {pet_supplies} online?\",\n", " \"What are the best {pet_supplies} for dogs?\",\n", " \"Top-rated {pet_supplies} for cats\",\n", " \"How to get discounts on {pet_supplies}?\",\n", " \"Are {pet_supplies} available for same-day delivery?\",\n", " \"What are the best eco-friendly {pet_supplies}?\",\n", " \"Can I subscribe to auto-delivery for {pet_supplies}?\",\n", " \n", " # Bedding Queries\n", " \"{bedding} price\",\n", " \"Where to buy {bedding} on sale?\",\n", " \"Best {bedding} for a comfortable night's sleep\",\n", " \"How to choose {bedding} for different seasons?\",\n", " \"Are {bedding} available for delivery today?\",\n", " \"What are the most luxurious {bedding} brands?\",\n", " \"Best {bedding} for people with allergies\",\n", " \"What’s the best material for {bedding}?\",\n", " \"How to wash {bedding} properly?\",\n", "##\n", " # Kitchen Appliance Queries\n", " \"{kitchen_appliance} price\",\n", " \"Best deals on {kitchen_appliance} this year\",\n", " \"Where to buy {kitchen_appliance} online?\",\n", " \"How to repair {kitchen_appliance} at home?\",\n", " \"Are {kitchen_appliance} worth buying refurbished?\",\n", " \"Most energy-efficient {kitchen_appliance}\",\n", " \"How to clean and maintain {kitchen_appliance}?\",\n", " \"Is {kitchen_appliance} available for same-day delivery?\",\n", " \n", " # Automotive Parts Queries\n", " \"{automotive_parts} price\",\n", " \"Where to buy {automotive_parts} for my car?\",\n", " \"Best deals on {automotive_parts} this year\",\n", " \"How to install {automotive_parts}?\",\n", " \"Is {automotive_parts} in stock near me?\",\n", " \"What {automotive_parts} are compatible with my car?\",\n", " \"How to maintain {automotive_parts} for longevity?\",\n", " \"Top-rated {automotive_parts} for safety\",\n", " \n", " # Tech Accessories Queries\n", " \"{tech_accessories} price\",\n", " \"Where to buy {tech_accessories} online?\",\n", " \"Best {tech_accessories} for my {electronics}\",\n", " \"What are the reviews for {tech_accessories}?\",\n", " \"Are {tech_accessories} compatible with {device}?\",\n", " \"How to find durable {tech_accessories}?\",\n", " \"What are the best {tech_accessories} for travel?\",\n", " \"Are {tech_accessories} available in stores near me?\",\n", " \n", " # Fitness Equipment Queries\n", " \"{fitness_equipment} price\",\n", " \"Best {fitness_equipment} to buy for home gym\",\n", " \"Where to find {fitness_equipment} deals?\",\n", " \"Top-rated {fitness_equipment} for 2024\",\n", " \"What are the must-have {fitness_equipment}?\",\n", " \"What {fitness_equipment} are best for beginners?\",\n", " \"How to maintain {fitness_equipment} at home?\",\n", " \n", " # Seasonal Products Queries\n", " \"{seasonal_products} price\",\n", " \"Where to buy {seasonal_products} during the holiday season?\",\n", " \"Best {seasonal_products} for {season}\",\n", " \"Are {seasonal_products} available for same-day delivery?\",\n", " \"Top-rated {seasonal_products} for this year\",\n", " \"Where to find discounts on {seasonal_products}?\",\n", " \"How to store {seasonal_products} for next season?\",\n", " \"Are there any eco-friendly {seasonal_products}?\",\n", "\n", " # Events & Ticketing\n", " \"{artist} price\",\n", " \"find concert tickets for {artist} on {platform}\",\n", " \"how to book tickets for {event}?\",\n", " # \"find the best seats for concert\",\n", " \"how to get discounts for {festival} tickets?\",\n", " \"ticket refund policy for {platform}\",\n", "]\n" ] }, { "cell_type": "code", "execution_count": null, "id": "733fd8fc-2648-414a-910a-8e85fc636337", "metadata": {}, "outputs": [], "source": [ "len(purchase_intent_templates)" ] }, { "cell_type": "code", "execution_count": null, "id": "01c9f289-47a1-4f7f-95e7-fc6d94d98cc3", "metadata": {}, "outputs": [], "source": [ "ELECTRONICS_PURCHASE = \"{electronics}\"\n", "HOME_APPLIANCES_PURCHASE = \"{home_appliance}\"\n", "FURNITURES_PURCHASE = \"{furniture}\"\n", "FASHION_CLOTHING_PURCHASE = \"{fashion_and_clothing}\"\n", "BEAUTY_AND_PERSONAL_CARE_PURCHASE = \"{beauty_and_personal_care}\"\n", "AUTOMOTIVE_PURCHASE = \"{automotive}\"\n", "HOUSEHOLD_ITEMS_PURCHASE = \"{household_item}\"\n", "TOYS_AND_GAMES_PURCHASE = \"{toys_and_games}\"\n", "BOOKS_AND_MEDIA_PURCHASE = \"{books_and_media}\"\n", "SPORTS_EQUIPMENT_PURCHASE = \"{sport_equipments}\"\n", "GIFTS_PURCHASE = \"{gifts}\"\n", "HUNTING_EQUIPMENT_PURCHASE = \"{hunting_equipment}\"\n", "EYEWEAR_PURCHASE = \"{eyewear}\"\n", "SUPPLEMENTS_PURCHASE = \"{supplements}\"\n", "PET_SUPPLIES_PURCHASE = \"{pet_supplies}\"\n", "BEDDING_PURCHASE = \"{bedding}\"\n", "KITCHEN_APPLIANCE_PURCHASE = \"{kitchen_appliance}\"\n", "AUTOMOTIVE_PARTS_PURCHASE = \"{automotive_parts}\"\n", "TECH_ACCESSORIES_PURCHASE = \"{tech_accessories}\"\n", "FITNESS_EQUIPMENT_PURCHASE = \"{fitness_equipment}\"\n", "SEASONAL_PRODUCTS_PURCHASE = \"{seasonal_products}\"\n", "PLATFORM_PURCHASE = \"{platform}\"\n", "EVENT_PURCHASE = \"{event}\"\n", "FESTIVAL_PURCHASE = \"{festival}\"\n", "ARTIST_PURCHASE = \"{artist}\"\n", "\n", "product_categories = {\n", " ELECTRONICS_PURCHASE: electronics,\n", " HOME_APPLIANCES_PURCHASE: home_appliances,\n", " FURNITURES_PURCHASE: furnitures,\n", " FASHION_CLOTHING_PURCHASE: fashion_and_clothing,\n", " BEAUTY_AND_PERSONAL_CARE_PURCHASE: beauty_and_personal_care,\n", " AUTOMOTIVE_PURCHASE: automotives,\n", " HOUSEHOLD_ITEMS_PURCHASE: household_items,\n", " TOYS_AND_GAMES_PURCHASE: toys_and_games,\n", " BOOKS_AND_MEDIA_PURCHASE: books_and_media,\n", " SPORTS_EQUIPMENT_PURCHASE: sport_equipments,\n", " GIFTS_PURCHASE: gifts,\n", " HUNTING_EQUIPMENT_PURCHASE: hunting_equipment,\n", " EYEWEAR_PURCHASE: eyewear,\n", " SUPPLEMENTS_PURCHASE: supplements,\n", " PET_SUPPLIES_PURCHASE: pet_supplies,\n", " BEDDING_PURCHASE: bedding,\n", " KITCHEN_APPLIANCE_PURCHASE: kitchen_appliance,\n", " AUTOMOTIVE_PARTS_PURCHASE: automotive_parts,\n", " TECH_ACCESSORIES_PURCHASE: tech_accessories,\n", " FITNESS_EQUIPMENT_PURCHASE: fitness_equipment,\n", " SEASONAL_PRODUCTS_PURCHASE: seasonal_products,\n", " PLATFORM_PURCHASE: platform,\n", " EVENT_PURCHASE: event,\n", " FESTIVAL_PURCHASE: festival,\n", " ARTIST_PURCHASE: artist,\n", "}\n", "\n", "def detect_product(product_categories, template):\n", " for category in product_categories.keys():\n", " if category in template:\n", " return category\n", "\n", "def generate_queries(templates, n_queries=1000):\n", " cnt = 0\n", " queries = []\n", " query_set = set()\n", " while cnt < n_queries:\n", " if cnt %500 == 0:\n", " print(f\"{cnt+1} examples added\")\n", " template = random.choice(templates)\n", " # print(f\"template = {template}\")\n", " category = detect_product(product_categories, template)\n", " # print(f\"category = {category}\")\n", " product = random.choice(product_categories[category])\n", " # print(f\"product = {product}\")\n", " category = category.replace(\"{\",\"\").replace(\"}\", \"\")\n", " query = template.replace(f\"{{{category}}}\",product)\n", " # print(f\"query = {query}\")\n", " # print()\n", " if query not in query_set:\n", " queries.append(query)\n", " query_set.add(query)\n", " cnt += 1\n", " return queries" ] }, { "cell_type": "code", "execution_count": null, "id": "763dbb6b-e187-4fba-be27-4f0a4806ab66", "metadata": {}, "outputs": [], "source": [ "purchase_intent_queries = generate_queries(purchase_intent_templates, n_queries=5100)" ] }, { "cell_type": "code", "execution_count": null, "id": "6c1e75ba-5489-401c-8a8f-5a2fdc4aaac6", "metadata": {}, "outputs": [], "source": [ "len(purchase_intent_queries)" ] }, { "cell_type": "code", "execution_count": null, "id": "66d3debc-a3a4-44e2-b946-b4985f48516c", "metadata": {}, "outputs": [], "source": [ "purchase_intent_examples = pd.DataFrame(purchase_intent_queries, columns=['sequence'])\n", "purchase_intent_examples['target'] = 'purchase_intent'\n", "purchase_intent_examples" ] }, { "cell_type": "code", "execution_count": null, "id": "4ce7e3f7-ee15-47e1-978d-6da2b1ff483c", "metadata": {}, "outputs": [], "source": [ "import json \n", "\n", "def get_geonames_city_state_data():\n", " geonames_file = \"../data/geonames-cities-states.json\"\n", " with open(geonames_file, 'r') as f:\n", " geonames_dict = json.load(f)\n", " \n", " \n", " cities_data = pd.DataFrame(geonames_dict['cities'])\\\n", " .rename(columns={'admin1_code': 'state_code', 'name': 'city_name', 'population': 'city_popln'})\n", " cities_data = cities_data[['id', 'state_code', 'city_name', 'city_popln', 'alternate_names']]\n", " states_data = pd.DataFrame(geonames_dict['states_by_abbr'].values())\\\n", " .rename(columns={'admin1_code': 'state_code', 'name': 'state_name'})\n", " states_data = states_data[['state_code', 'state_name']]\n", " city_states_data = cities_data.merge(states_data, how='left', on='state_code')\n", " city_states_data['city_weight'] = city_states_data['city_popln'] / city_states_data['city_popln'].sum()\n", " return city_states_data" ] }, { "cell_type": "code", "execution_count": null, "id": "2eaf0b25-1a28-442e-aea7-6716350b15cc", "metadata": {}, "outputs": [], "source": [ "city_states_data = get_geonames_city_state_data()\n", "city_weights = city_states_data[['city_name', 'city_weight']].set_index('city_name').to_dict()['city_weight']\n", "city_state_code_info = city_states_data[['city_name', 'state_code', 'city_weight']].copy()\n", "city_state_name_info = city_states_data[['city_name', 'state_name', 'city_weight']].copy()" ] }, { "cell_type": "code", "execution_count": null, "id": "01b2d67a-289b-4186-a655-c8a00083aaed", "metadata": {}, "outputs": [], "source": [ "def get_sample_from_cities_and_states(city_state_code_info, city_state_name_info, state_code_threshold=0.8):\n", " rand_val = random.random()\n", " if rand_val <= state_code_threshold:\n", " return ', '.join(city_state_code_info.sample(1, weights='city_weight', replace=True)[['city_name', 'state_code']].values.tolist()[0])\n", " return ', '.join(city_state_name_info.sample(1, weights='city_weight', replace=True)[['city_name', 'state_name']].values.tolist()[0])\n", "\n", "city_state=get_sample_from_cities_and_states(city_state_code_info, city_state_name_info, state_code_threshold=0.8)" ] }, { "cell_type": "code", "execution_count": null, "id": "19130ef4-ac7b-483e-82fd-a61685c1cc40", "metadata": {}, "outputs": [], "source": [ "city_state" ] }, { "cell_type": "code", "execution_count": null, "id": "25a90a81-1106-4e7f-b41a-c2bef604763c", "metadata": {}, "outputs": [], "source": [ "from collections import Counter\n", "\n", "city_states_counter = Counter()\n", "for _ in range(10000):\n", " city_states_counter.update([get_sample_from_cities_and_states(city_state_code_info, city_state_name_info, state_code_threshold=0.8)])\n", "\n", "city_state = [cit_sta for cit_sta, cnt in city_states_counter.most_common(200)]" ] }, { "cell_type": "code", "execution_count": null, "id": "d30db244-5297-4682-ac7d-2e08bffba680", "metadata": { "scrolled": true }, "outputs": [], "source": [ "city_state\n" ] }, { "cell_type": "markdown", "id": "3dd01cca-4033-42e5-a435-35ab246d1277", "metadata": {}, "source": [ "#### some additional augmented yelp intent queries" ] }, { "cell_type": "code", "execution_count": null, "id": "1b5f34b2-ae2d-4588-8de5-7325c0b40a97", "metadata": {}, "outputs": [], "source": [ "home_maintenance_repair = [\n", " 'roofing', 'flooring', 'plumbing', 'house painting', 'carpet installation',\n", " 'hardwood floor refinishing', 'drywall repair', 'electrical services', 'window installation',\n", " 'HVAC services', 'fencing', 'roof replacement', 'gutter repair', 'kitchen renovation',\n", " 'bathroom remodeling', 'exterior painting', 'interior painting', 'concrete repair',\n", " 'driveway paving', 'deck repair', 'plumber', 'electrician',\n", "]\n", "\n", "moving_storage = [\n", " 'local movers', 'long-distance movers', 'packing services', 'furniture movers',\n", " 'storage solutions', 'cross-country movers', 'apartment moving', 'pool table moving',\n", " 'interstate movers', 'moving truck rental', 'moving labor', 'junk removal',\n", " 'relocation services', 'packing supplies', 'office movers', 'vehicle shipping',\n", " 'moving container rental', 'small move services', 'senior moving services', 'pet relocation'\n", "]\n", "\n", "restaurants_food = [\n", " 'sushi', 'tacos', 'pizza', 'burgers', 'ramen', 'pasta', 'salads', 'barbecue', 'ice cream',\n", " 'acai bowls', 'vegan food', 'steakhouses', 'buffet restaurants', 'seafood restaurants',\n", " 'brunch spots', 'food trucks', 'fast food', 'diner', 'Mexican restaurants', 'Italian restaurants',\n", " 'fried chicken', 'hot dogs', 'donuts', 'bagels', 'barbecue chicken',\n", " 'buffalo wings', 'grilled cheese', 'cheesesteak', 'poutine', 'meatloaf',\n", " 'fried fish', 'soul food', 'dim sum', 'dumplings', 'tapas',\n", " 'Indian restaurants', 'Mediterranean food', 'Korean BBQ', 'Vietnamese pho', 'crepes',\n", " 'cupcakes'\n", "\n", "]\n", "\n", "health_wellness = [\n", " 'dermatologists', 'dentists', 'optometrists', 'pediatricians', 'pharmacies',\n", " 'acupuncture', 'chiropractors', 'physical therapy', 'massage therapy', 'eyebrow threading',\n", " 'laser hair removal', 'facials', 'hair salons', 'nail salons', 'spas', 'mental health counseling',\n", " 'cosmetic surgery', 'nutritionists', 'fitness trainers', 'wellness centers', 'yoga', 'pilates',\n", "]\n", "\n", "car_repair_automotive_services = [\n", " 'oil change', 'tire replacement', 'brake repair', 'car inspection', 'car detailing',\n", " 'transmission repair', 'engine diagnostics', 'battery replacement', 'alignment services',\n", " 'auto body repair', 'windshield replacement', 'car wash', 'wheel alignment', 'car painting',\n", " 'exhaust system repair', 'auto glass repair', 'AC repair', 'tune-up services', 'car rental', 'car towing'\n", "]\n", "\n", "cleaning_services = [\n", " 'house cleaning', 'deep cleaning', 'maid services', 'disinfection and sanitization', 'carpet cleaning',\n", " 'window cleaning', 'move-out cleaning', 'office cleaning', 'apartment cleaning', 'laundry services',\n", " 'floor cleaning', 'pressure washing', 'garage cleaning', 'post-construction cleaning',\n", " 'air duct cleaning', 'roof cleaning', 'tile and grout cleaning', 'upholstery cleaning',\n", " 'yard cleaning', 'organizing services'\n", "]\n", "\n", "entertainment_activities = [\n", " 'bowling', 'karaoke', 'movie theaters', 'mini-golf', 'amusement parks', 'live music venues', 'escape rooms',\n", " 'arcade', 'arcades', 'zoos', 'aquariums', 'water parks', 'comedy clubs', 'museums', 'laser tag', 'go-karts', \n", " 'roller skating', 'trampoline parks', 'horseback riding', 'batting cages', 'rock climbing gyms', 'sports bar',\n", " 'sports bars','karaoke bar',\n", "]\n", "\n", "beauty_personal_care = [\n", " 'hair salons', 'barbershops', 'nail salons', 'spas', 'eyebrow threading', 'facials', 'microblading',\n", " 'laser hair removal', 'brow lamination', 'spray tanning', 'makeup artists', 'cosmetic surgery',\n", " 'waxing services', 'beauty salons', 'eyelash extensions', 'massage therapy', 'piercing', 'acne treatments',\n", " 'dermatology', 'body sculpting'\n", "]\n", "\n", "specialty_shops_services = [\n", " 'embroidery services', 'custom painting', 'interior design', 'furniture restoration', 'florists', \n", " 'tailors', 'wedding planners', 'personal chefs', 'home organizers', 'antique shops', 'handyman services',\n", " 'custom cabinet makers', 'fence installation', 'deck building', 'security system installation', 'pest control',\n", " 'landscaping services', 'pet grooming', 'art restoration', 'personal trainers'\n", "]\n", "\n", "city_short = [\"sf\", \"sfo\", \"san francisco\",\n", " \"nyc\", \"new york\",\n", " \"la\", \"lax\",\n", " \"chi\", \"chicago\",\n", " \"hou\", \"houston\",\n", " \"mia\", \"miami\",\n", " \"vegas\", \"lv\",\n", " \"bos\", \"boston\", \n", " \"sea\", \"seattle\", \n", " \"atl\", \"atlanta\",\n", " \"dfw\", \"dallas\",\n", " \"dc\", \"washington\",\n", " \"philly\", \"philadelphia\",\n", " \"phx\", \"phoenix\",\n", " \"sd\", \"sandiego\",\n", " \"den\", \"denver\",\n", " \"orl\", \"orlando\",\n", " \"atx\", \"austin\",\n", " \"nash\", \"nashville\",\n", " \"pdx\", \"portland\",\n", " \"nola\", \"new orleans\",\n", " \"sat\", \"san antonio\",\n", " \"clt\", \"charlotte\",\n", " \"det\", \"detroit\",\n", " \"tpa\", \"tampa\",\n", " \"balt\", \"baltimore\",\n", " \"cle\", \"cleveland\",\n", " \"mpls\", \"minneapolis\",\n", " \"slc\", \"salt lake city\",\n", " \"indy\", \"indianapolis\",\n", " \"kc\", \"kansas city\",\n", "]\n" ] }, { "cell_type": "code", "execution_count": null, "id": "aef971af-2763-4aed-b0e9-f9ac10e87a0c", "metadata": {}, "outputs": [], "source": [ "yelp_keywords_data = pd.read_json(\"https://firefox-settings-attachments.cdn.mozilla.net/main-workspace/quicksuggest/33987d71-9e87-4b7e-86d3-6f292b89e8bf.json\")['subjects'].values[0]" ] }, { "cell_type": "code", "execution_count": null, "id": "611be1f5-b898-4571-ac0f-58e4ef54163e", "metadata": {}, "outputs": [], "source": [ "general_yelp_keyword = yelp_keywords_data[::]" ] }, { "cell_type": "code", "execution_count": null, "id": "4a1530f5-2159-4f29-b2d1-8e8d80d674fc", "metadata": {}, "outputs": [], "source": [ "len(general_yelp_keyword)" ] }, { "cell_type": "code", "execution_count": null, "id": "d219e2c2-fec3-4a7a-9962-d190cad4b974", "metadata": {}, "outputs": [], "source": [ "yelp_intent_additional_templates = [\n", " # Home Maintenance & Repair\n", " \"Find {home_maintenance_repair} near me\",\n", " \"Best {home_maintenance_repair} providers in {city_state}\",\n", " \"Affordable {home_maintenance_repair} in {city_state}\",\n", " \"Top-rated {home_maintenance_repair} companies\",\n", " \"How much does {home_maintenance_repair} cost?\",\n", " \"Compare reviews of {home_maintenance_repair} providers\",\n", " # \"{city_short} {home_maintenance_repair}\",\n", " # \"{home_maintenance_repair} {city_short}\",\n", " # \"{city_state} {home_maintenance_repair}\",\n", " # \"{home_maintenance_repair} {city_state}\",\n", " \"{home_maintenance_repair}\",\n", " \"{home_maintenance_repair} in {city_state}\",\n", " \n", "\n", " # Moving & Storage\n", " \"Best {moving_storage} for long distance moving\",\n", " \"Find a local {moving_storage} company\",\n", " \"Compare prices for {moving_storage} in {city_state}\",\n", " \"Reviews of {moving_storage} companies near me\",\n", " \"How to hire {moving_storage} for a small move\",\n", " \"Best-rated {moving_storage} companies\",\n", " # \"{city_short} {moving_storage}\",\n", " # \"{moving_storage} {city_short}\",\n", " # \"{city_state} {moving_storage}\",\n", " # \"{moving_storage} {city_state}\",\n", " \"{moving_storage}\",\n", "\n", " # Restaurants & Food\n", " \"Best {restaurants_food} near me\",\n", " \"Top {restaurants_food} reviews in {city_state}\",\n", " \"Affordable {restaurants_food} options near me\",\n", " \"Where to find the best {restaurants_food} in {city_state}?\",\n", " \"Compare {restaurants_food} reviews in {city_state}\",\n", " \"5-star {restaurants_food} recommendations\",\n", " # \"{city_short} {restaurants_food}\",\n", " # \"{restaurants_food} {city_short}\",\n", " # \"{city_state} {restaurants_food}\",\n", " # \"{restaurants_food} {city_state}\",\n", " \"{restaurants_food}\",\n", "\n", " # Health & Wellness\n", " \"Find {health_wellness} near me\",\n", " \"Best-rated {health_wellness} in {city_state}\",\n", " \"Affordable {health_wellness} options near me\",\n", " \"Compare reviews for {health_wellness} providers\",\n", " \"Top doctors and clinics for {health_wellness}\",\n", " \"How much does {health_wellness} cost?\",\n", " # \"{city_short} {health_wellness}\",\n", " # \"{health_wellness} {city_short}\",\n", " # \"{city_state} {health_wellness}\",\n", " # \"{health_wellness} {city_state}\",\n", " \"{health_wellness}\",\n", "\n", " # Car Repair & Automotive Services\n", " \"Find {car_repair_automotive_services} near me\",\n", " \"Best {car_repair_automotive_services} providers in {city_state}\",\n", " \"Top car repair shops for {car_repair_automotive_services}\",\n", " \"Compare prices for {car_repair_automotive_services}\",\n", " \"Affordable {car_repair_automotive_services} options near me\",\n", " \"Top-rated {car_repair_automotive_services} providers\",\n", " # \"{city_short} {car_repair_automotive_services}\",\n", " # \"{car_repair_automotive_services} {city_short}\",\n", " # \"{city_state} {car_repair_automotive_services}\",\n", " # \"{car_repair_automotive_services} {city_state}\",\n", " \"{car_repair_automotive_services}\",\n", "\n", " # Cleaning Services\n", " \"Find a {cleaning_services} in {city_state}\",\n", " \"Affordable {cleaning_services} options near me\",\n", " \"Compare reviews for {cleaning_services} providers\",\n", " \"Get a {cleaning_services} quote near me\",\n", " \"Best {cleaning_services} providers in {city_state}\",\n", " \"How much does {cleaning_services} cost?\",\n", " # \"{city_short} {cleaning_services}\",\n", " # \"{cleaning_services} {city_short}\",\n", " # \"{city_state} {cleaning_services}\",\n", " # \"{cleaning_services} {city_state}\",\n", " \"{cleaning_services}\",\n", "\n", " # Entertainment & Activities\n", " \"Best {entertainment_activities} near me\",\n", " \"Top-rated {entertainment_activities} in {city_state}\",\n", " \"Where to find {entertainment_activities} options in {city_state}?\",\n", " \"Affordable {entertainment_activities} activities near me\",\n", " \"Compare reviews for {entertainment_activities} venues\",\n", " \"Top places for {entertainment_activities} this weekend\",\n", " # \"{city_short} {entertainment_activities}\",\n", " # \"{entertainment_activities} {city_short}\",\n", " # \"{city_state} {entertainment_activities}\",\n", " # \"{entertainment_activities} {city_state}\",\n", " \"{entertainment_activities}\",\n", " \"{entertainment_activities} place\",\n", " \"{entertainment_activities} for beginners\",\n", "\n", " # Beauty & Personal Care\n", " \"Find {beauty_personal_care} near me\",\n", " \"Top-rated {beauty_personal_care} salons in {city_state}\",\n", " \"Compare reviews for {beauty_personal_care} providers\",\n", " \"Affordable {beauty_personal_care} services near me\",\n", " \"Best {beauty_personal_care} options in {city_state}\",\n", " \"How much does {beauty_personal_care} cost?\",\n", " # \"{city_short} {beauty_personal_care}\",\n", " # \"{beauty_personal_care} {city_short}\",\n", " # \"{city_state} {beauty_personal_care}\",\n", " # \"{beauty_personal_care} {city_state}\",\n", " \"{beauty_personal_care}\",\n", "\n", " # Specialty Shops & Services\n", " \"Where to find {specialty_shops_services} in {city_state}?\",\n", " \"Best reviews for {specialty_shops_services} near me\",\n", " \"Affordable {specialty_shops_services} options near me\",\n", " \"Compare {specialty_shops_services} providers in {city_state}\",\n", " \"How to hire {specialty_shops_services} professionals\",\n", " \"Top-rated {specialty_shops_services} in {city_state}\",\n", " # \"{city_short} {specialty_shops_services}\",\n", " # \"{specialty_shops_services} {city_short}\",\n", " # \"{city_state} {specialty_shops_services}\",\n", " # \"{specialty_shops_services} {city_state}\",\n", " \"{specialty_shops_services}\",\n", "\n", " \"{general_yelp_keyword}\",\n", " \"{general_yelp_keyword} near me\",\n", " \"{general_yelp_keyword} in {city_state}\"\n", "]\n" ] }, { "cell_type": "code", "execution_count": null, "id": "bb7e81ea-d753-40a3-a5ef-0c6b6ddb15c5", "metadata": {}, "outputs": [], "source": [ "len(yelp_intent_additional_templates)" ] }, { "cell_type": "code", "execution_count": null, "id": "255e8183-a037-4cce-8b80-f914b6da6ffe", "metadata": {}, "outputs": [], "source": [ "def detect_service(service_categories, template):\n", " categories = []\n", " for category in service_categories.keys():\n", " if category in template:\n", " categories.append(category)\n", " return categories\n", "\n", "\n", "def generate_service_queries(service_categories, templates, n_queries=1000):\n", " cnt = 0\n", " queries = []\n", " query_set = set()\n", " while cnt < n_queries:\n", " if cnt % 1000 == 0:\n", " print(f\"{cnt+1} examples added\")\n", " template = random.choice(templates)\n", " # print(f\"template = {template}\")\n", " categories = detect_service(service_categories, template)\n", " # print(f\"categories = {categories}\")\n", " query = template\n", " for category in categories:\n", " if category:\n", " service = random.choice(service_categories[category])\n", " category = category.replace(\"{\",\"\").replace(\"}\", \"\")\n", " query = query.replace(f\"{{{category}}}\",service)\n", " # print(f\"query = {query}\")\n", " # print(f\"category = {category}\")\n", " if query not in query_set and \"{\" not in query:\n", " queries.append(query)\n", " query_set.add(query)\n", " cnt += 1\n", " return queries" ] }, { "cell_type": "code", "execution_count": null, "id": "90139f02-0c5c-458e-9b37-e650a9397f82", "metadata": {}, "outputs": [], "source": [ "HOME_MAINTENANCE_REPAIR = \"{home_maintenance_repair}\"\n", "MOVING_STORAGE = \"{moving_storage}\"\n", "RESTAURANT_FOOD = \"{restaurants_food}\"\n", "HEALTH_WELLNESS = \"{health_wellness}\"\n", "CAR_REPAIR_AUTOMOTIVE_SERVICES = \"{car_repair_automotive_services}\"\n", "CLEANING_SERVICES = \"{cleaning_services}\"\n", "ENTERTAINMENT_ACTIVITIES = \"{entertainment_activities}\"\n", "BEAUTY_PERSONAL_CARE = \"{beauty_personal_care}\"\n", "SPECIALITY_SHOPS_SERVICES = \"{specialty_shops_services}\"\n", "CITY_STATES = \"{city_state}\"\n", "CITY_SHORT = \"{city_short}\"\n", "GENERAL_YELP_KEYWORD = \"{general_yelp_keyword}\"\n", "\n", "\n", "service_categories = {\n", " HOME_MAINTENANCE_REPAIR: home_maintenance_repair,\n", " MOVING_STORAGE: moving_storage,\n", " RESTAURANT_FOOD: restaurants_food,\n", " HEALTH_WELLNESS: health_wellness,\n", " CAR_REPAIR_AUTOMOTIVE_SERVICES: car_repair_automotive_services,\n", " CLEANING_SERVICES: cleaning_services,\n", " ENTERTAINMENT_ACTIVITIES: entertainment_activities,\n", " BEAUTY_PERSONAL_CARE: beauty_personal_care,\n", " SPECIALITY_SHOPS_SERVICES: specialty_shops_services,\n", " CITY_STATES: city_state,\n", " CITY_SHORT: city_short,\n", " GENERAL_YELP_KEYWORD: general_yelp_keyword,\n", "}\n" ] }, { "cell_type": "code", "execution_count": null, "id": "c0f748be-7c89-4fe3-b7b0-ae50098f1308", "metadata": {}, "outputs": [], "source": [ "yelp_intent_additional_queries = generate_service_queries(service_categories, yelp_intent_additional_templates, n_queries=5000) #15000\n", "print(len(yelp_intent_additional_queries))" ] }, { "cell_type": "code", "execution_count": null, "id": "ff492e78-6a81-4d1a-b89d-e378b1ffef7d", "metadata": {}, "outputs": [], "source": [ "yelp_intent_additional_queries_df = pd.DataFrame(yelp_intent_additional_queries, columns=['sequence'])\n", "yelp_intent_additional_queries_df['target'] = 'yelp_intent'\n", "yelp_intent_additional_queries_df" ] }, { "cell_type": "markdown", "id": "6e47e75b-cc93-40ff-8c66-bf088bd0a6e5", "metadata": {}, "source": [ "#### Navigation intent additional queries" ] }, { "cell_type": "code", "execution_count": null, "id": "aa11efb0-d111-43f9-9091-48a07e378e6c", "metadata": {}, "outputs": [], "source": [ "navigation_intent_templates = [\n", " # Routing Numbers & Bank Information\n", " \"routing number for {bank}\",\n", " \"address of {bank}\",\n", " \"what is the routing number for {bank}\",\n", " \"verify routing number for {bank}\",\n", " \"contact number for {bank} customer service\",\n", " \"find routing number of {bank} in {location}\",\n", " \"routing number for {credit_union}\",\n", "\n", " # Company & Service Support\n", " \"support number for {service}\",\n", " \"how to contact {service} support\",\n", " \"customer support number for {service}\",\n", " \"cancel {service} account\",\n", " \"what is the {service} customer care number\",\n", " \"fax number for {service}\",\n", " \"call {service} customer service\",\n", "\n", " # Login or Account Information\n", " \"login to {service} account\",\n", " \"how to login to {service} on my computer\",\n", " \"account management for {service}\",\n", " \"reset password for {service}\",\n", " \"forgot login details for {service}\",\n", " \"how to access {service} account\",\n", "\n", " # Addresses & Locations\n", " \"address for {location}\",\n", " \"find address of {business} in {location}\",\n", " \"location of {business}\",\n", " \"where is {place} located\",\n", " \"directions to {place}\",\n", " \"address of {store} in {location}\",\n", "\n", " # Cancellation or Service Changes\n", " \"cancel {service} subscription\",\n", " \"change address for {service}\",\n", " \"cancellation fee for {service}\",\n", " \"cancellation policy for {service}\",\n", " \"how to cancel {service} account\",\n", " \"cancel {service} membership\",\n", "\n", " \"features of {product}\",\n", "\n", " # TV Shows, Movies, and Streaming Services\n", " \"is {show} on {streaming_service}?\",\n", " \"is {movie} available on {platform}?\",\n", " \"does {device} support {service}?\",\n", " \"can I watch {show} on {device}?\",\n", " \"how to stream {show} on {platform}\",\n", " \"is {show} canceled?\",\n", "\n", " # Educational Resources & Information\n", " \"tuition fee for {university} in 2024\",\n", " \"how to apply for {course} on {learning_platform}\",\n", " \"contact {university} admissions office\",\n", " \"academic calendar for {university}\",\n", " \"what is the login for {learning_platform}?\",\n", "\n", " # Shipping & Tracking\n", " \"track my package on {shipping_service}\",\n", " \"shipping cost for {product} on {platform}\",\n", " \"what is the tracking number for {courier}?\",\n", " \"how to track {courier} delivery?\",\n", " \"where is my {shipping_service} package?\",\n", "\n", " # Government Services & Documents\n", " \"how to renew my driver’s license with {state_dmv}\",\n", " \"where is the closest post office?\",\n", " \"how to apply for a passport in the US\",\n", " \"IRS contact number for tax queries\",\n", " \"how to change address with {state_dmv}\",\n", "\n", " # Finance & Banking\n", " \"how to increase my credit limit with {bank}\",\n", " \"where to find {bank} ATM near me\",\n", " \"credit score needed for {credit_card}\",\n", " # \"what are the benefits of {credit_card}?\",\n", " \"how to apply for a mortgage with {bank}\",\n", "\n", " # Tech Support & Troubleshooting\n", " \"how to fix {device} screen issue\",\n", " \"support number for {tech_company}\",\n", " \"how to update {software} on {device}\",\n", " \"what to do if {device} won’t start?\",\n", " \"reset password for {account} on {device}\",\n", "\n", " # Employment & Career\n", " \"find job openings at {company}\",\n", " \"what are the job duties for {position}?\",\n", " \"how to apply for {job_role} at {company}\",\n", " \"contact HR at {company}\",\n", " \"career advice for {industry}\",\n", "\n", " # Public Services & Utilities\n", " \"pay my electricity bill with {utility_company}\",\n", " \"find waste management services near me\",\n", " \"report a power outage with {utility_company}\",\n", " \"how to sign up for {utility_service}?\",\n", " \"how to contact {utility_company} support?\",\n", "\n", " # # Events & Ticketing\n", " # \"find concert tickets for {artist} on {platform}\",\n", " # \"how to book tickets for {event}?\",\n", " # \"find the best seats for {concert}\",\n", " # \"how to get discounts for {festival} tickets?\",\n", " # \"ticket refund policy for {platform}\",\n", "\n", " # Email & Account Access\n", " \"login to {email_provider}\",\n", " \"access {email_provider} on my computer\",\n", " \"forgot password for {login_service}\",\n", " \"how to reset password for {login_service} account\",\n", " \"access my {email_provider} inbox\",\n", " \n", " # Government Services\n", " \"how to track my refund on {government_service} website\",\n", " \"get support from {government_service} for {topic}\",\n", " \"how to check my status with {government_service}\",\n", " \"apply for services through {government_service}\",\n", " \n", " # Financial Services & Bank Support\n", " \"login to {financial_service} account\",\n", " \"how to check balance on {financial_service}\",\n", " \"support number for {financial_service} customer service\",\n", " \"pay my bill with {financial_service}\",\n", " \n", " # Software & Device Support\n", " \"fix {device} issues with {support_service} support\",\n", " \"how to troubleshoot {software} problems\",\n", " \"download {software} for {device}\",\n", " \"check updates for {software}\",\n", " \n", " # Other Services & General Queries\n", " \"how to download {software} for {task}\",\n", " \"install {software} on {device}\",\n", " \"find customer support number for {support_service}\",\n", " \"how to change account details for {login_service}\",\n", "\n", " # General Navigation Queries\n", " \"how do I sign in to {domain}\",\n", " \"login to {domain} account\",\n", " \"where is the sign-in page on {domain}\",\n", " \"reset my password on {domain}\",\n", " \"authenticate my account on {domain}\",\n", " \"how to sign up for {domain} account\",\n", "\n", " # Registration & Account Creation\n", " \"create an account on {domain}\",\n", " \"how to register on {domain}\",\n", " \"where can I sign up for {domain}\",\n", " \"register for a new account on {domain}\",\n", " \"sign up for {domain} services\",\n", " \n", " # Login, Sign-in, Authentication\n", " \"how do I log into {domain}\",\n", " \"sign into {domain} with email\",\n", " \"can I sign in to {domain} with my phone number\",\n", " \"how do I recover my password on {domain}\",\n", " \"log out of {domain} account\",\n", " \n", " # Forms & Document Submission\n", " \"where to submit forms on {domain}\",\n", " \"download forms from {domain}\",\n", " \"upload documents to {domain}\",\n", " \"how do I submit a form on {domain}\",\n", " \"find registration forms on {domain}\",\n", " \n", " # Contact & Customer Support\n", " \"how do I contact support on {domain}\",\n", " \"where is the customer service number on {domain}\",\n", " \"how do I get help on {domain}\",\n", " \"contact support on {domain} for issues\",\n", " \"find contact info on {domain}\",\n", " \n", " # Tracking & Status Updates\n", " \"track my package on {domain}\",\n", " \"check my order status on {domain}\",\n", " \"how do I track a shipment on {domain}\",\n", " \"where is the tracking page on {domain}\",\n", " \"track delivery updates on {domain}\",\n", "\n", " \"{domain}/jobs\",\n", " \"{domain}/careers\",\n", " \"{domain}/login\",\n", " \"{domain}/signin\",\n", " \"{domain}/sign in\",\n", " \"{domain} jobs\",\n", " \"{domain} careers\",\n", " \"{domain} login\",\n", " \"{domain} signin\",\n", " \"{domain} sign in\",\n", "]\n" ] }, { "cell_type": "code", "execution_count": null, "id": "00e5a0ae-5ef2-406c-97e3-cdd336e64260", "metadata": {}, "outputs": [], "source": [ "len(navigation_intent_templates)" ] }, { "cell_type": "code", "execution_count": null, "id": "04b58167-e761-4676-9859-a0a8119801c0", "metadata": {}, "outputs": [], "source": [ "bank = [\n", " 'Wells Fargo', 'Bank of America', 'Chase', 'TD Bank', 'PNC',\n", " 'Citibank', 'US Bank', 'Capital One', 'HSBC', 'Fifth Third Bank',\n", " 'Regions Bank', 'Ally Bank', 'SunTrust', 'KeyBank', 'M&T Bank',\n", "]\n", "\n", "credit_card = [\n", " 'Chase Sapphire Preferred', 'Capital One Venture Rewards', 'American Express Platinum', \n", " 'Citi Double Cash', 'Discover It Cash Back', \n", " 'Wells Fargo Active Cash', 'Bank of America Travel Rewards', \n", " 'Chase Freedom Unlimited', 'Capital One Quicksilver', 'U.S. Bank Visa Platinum',\n", " 'American Express Gold', 'Citi Premier Card', 'Discover It Miles',\n", " 'Barclays AAdvantage Aviator Red', 'Amazon Prime Rewards Visa Signature',\n", " 'Delta SkyMiles Platinum American Express', 'Hilton Honors American Express Surpass',\n", " 'Southwest Rapid Rewards Plus', 'Marriott Bonvoy Boundless', 'United Explorer Card',\n", "]\n", "\n", "location = [\n", " 'New York', 'Los Angeles', 'Chicago', 'Houston', 'Miami',\n", " 'Dallas', 'San Francisco', 'Atlanta', 'Seattle', 'Boston',\n", " 'Phoenix', 'Orlando', 'Philadelphia', 'Denver', 'Las Vegas',\n", "]\n", "\n", "credit_union = [\n", " 'Navy Federal Credit Union', 'Alliant Credit Union', 'Golden 1 Credit Union',\n", " 'First Tech Federal Credit Union', 'America First Credit Union', 'Pentagon Federal Credit Union',\n", " 'San Diego County Credit Union', 'Suncoast Credit Union', 'BECU', 'Teachers Federal Credit Union',\n", " 'Keesler Federal Credit Union', 'Valley First Credit Union', 'River Region Credit Union',\n", " 'Champion Credit Union', 'Mountain America Credit Union',\n", "]\n", "\n", "service = [\n", " 'Netflix', 'Spotify', 'Amazon Prime', 'Google Drive', 'Uber',\n", " 'Disney+', 'YouTube Premium', 'Dropbox', 'Zoom', 'Venmo',\n", " 'Lyft', 'Twitch', 'Slack', 'LinkedIn', 'DoorDash',\n", "]\n", "\n", "product = [\n", " 'iPhone', 'Samsung Galaxy', 'MacBook', 'PlayStation 5', 'AirPods',\n", " 'Sony TV', 'Apple Watch', 'Bose headphones', 'Canon DSLR', 'GoPro',\n", " 'Microsoft Surface', 'Google Pixel', 'Fitbit', 'Nintendo Switch', 'Xbox Series X',\n", "]\n", "\n", "platform = [\n", " 'Amazon', 'eBay', 'Walmart', 'Best Buy', 'Target',\n", " 'Apple Store', 'Google Store', 'Newegg', 'B&H', 'Costco',\n", "]\n", "\n", "streaming_service = [\n", " 'Netflix', 'Hulu', 'Amazon Prime', 'Disney+', 'HBO Max',\n", " 'Apple TV+', 'Peacock', 'Paramount+', 'YouTube TV', 'Sling TV',\n", "]\n", "\n", "show = [\n", " 'Breaking Bad', 'Stranger Things', 'Game of Thrones', 'Friends', 'The Office',\n", " 'The Mandalorian', 'The Crown', 'WandaVision', 'Loki', 'The Boys',\n", "]\n", "\n", "learning_platform = [\n", " 'Coursera', 'Udemy', 'edX', 'Khan Academy', 'LinkedIn Learning',\n", " 'Pluralsight', 'Skillshare', 'Codecademy', 'Udacity', 'FutureLearn',\n", "]\n", "\n", "shipping_service = [\n", " 'FedEx', 'UPS', 'USPS', 'DHL', 'Amazon Logistics',\n", " 'Yanwen', 'Aramex', 'Canada Post', 'Royal Mail', 'Hermes',\n", "]\n", "\n", "courier = [\n", " 'FedEx', 'UPS', 'DHL', 'USPS', 'Aramex',\n", " 'Yanwen', 'Canada Post', 'Royal Mail', 'Hermes', 'TNT',\n", "]\n", "\n", "university = [\n", " 'Harvard University', 'Stanford University', 'Massachusetts Institute of Technology', \n", " 'University of California, Berkeley', 'Princeton University',\n", " 'Yale University', 'Columbia University', 'University of Chicago', 'New York University', 'University of Michigan',\n", "]\n", "\n", "state_dmv = [\n", " 'California DMV', 'New York DMV', 'Texas DMV', 'Florida DMV', 'Illinois DMV',\n", " 'Pennsylvania DMV', 'Ohio BMV', 'Georgia DDS', 'Virginia DMV', 'New Jersey MVC',\n", "]\n", "\n", "utility_company = [\n", " 'Pacific Gas & Electric', 'Duke Energy', 'Con Edison', 'Southern California Edison', 'National Grid',\n", " 'Xcel Energy', 'Florida Power & Light', 'PSEG', 'Dominion Energy', 'Consumers Energy',\n", "]\n", "\n", "utility_service = [\n", " 'electricity', 'water supply', 'natural gas', 'internet', 'cable TV',\n", " 'trash collection', 'sewage service', 'recycling pickup', 'phone service',\n", " 'solar power', 'wind energy', 'fiber internet', 'home security system', \n", " 'smart meter installation', 'smart thermostat installation',\n", " 'geothermal heating', 'propane service', 'stormwater management',\n", " 'emergency power backup', 'district heating',\n", "]\n", "\n", "event = [\n", " 'Coachella', 'Lollapalooza', 'Burning Man', 'Comic-Con', 'The Oscars',\n", " 'Super Bowl', 'World Series', 'NBA Finals', 'Wimbledon', 'Grammy Awards',\n", "]\n", "\n", "company = [\n", " 'Google', 'Apple', 'Microsoft', 'Facebook', 'Amazon',\n", " 'Tesla', 'Twitter', 'Netflix', 'Airbnb', 'Spotify',\n", "]\n", "\n", "device = [\n", " 'iPhone', 'MacBook', 'Samsung Galaxy', 'iPad', 'PlayStation 5',\n", " 'Xbox Series X', 'Apple Watch', 'Fitbit', 'Surface Pro', 'Nintendo Switch',\n", "]\n", "\n", "festival = [\n", " 'Coachella', 'Lollapalooza', 'Burning Man', 'Tomorrowland', 'SXSW',\n", " 'Glastonbury', 'Oktoberfest', 'Mardi Gras', 'Cannes Film Festival', 'Sundance Film Festival',\n", " 'Ultra Music Festival', 'New Orleans Jazz & Heritage Festival', 'Austin City Limits', 'Bonnaroo', 'Electric Daisy Carnival',\n", " 'Stagecoach', 'Summerfest', 'Essence Festival', 'Rock in Rio', 'Woodstock',\n", "]\n", "\n", "artist = [\n", " 'Taylor Swift', 'Beyoncé', 'Ed Sheeran', 'Drake', 'Ariana Grande',\n", " 'Billie Eilish', 'The Weeknd', 'Justin Bieber', 'Kanye West', 'Rihanna',\n", " 'Bruno Mars', 'Shawn Mendes', 'Dua Lipa', 'Travis Scott', 'Lady Gaga',\n", " 'Post Malone', 'Harry Styles', 'Adele', 'Coldplay', 'Imagine Dragons',\n", "]\n", "\n", "job_role = [\n", " 'Software Engineer', 'Data Scientist', 'Marketing Manager', 'Graphic Designer', 'Project Manager',\n", " 'Sales Representative', 'Accountant', 'Nurse', 'Mechanical Engineer', 'Product Manager',\n", " 'Business Analyst', 'Consultant', 'UX/UI Designer', 'Customer Support Specialist', 'Operations Manager',\n", " 'Human Resources Manager', 'Financial Analyst', 'Social Media Manager', 'Content Writer', 'DevOps Engineer',\n", "]\n", "\n", "position = [\n", " 'Software Developer', 'Senior Manager', 'Account Executive', 'Nurse Practitioner', 'Mechanical Technician',\n", " 'Business Consultant', 'Marketing Director', 'Sales Engineer', 'Systems Analyst', 'Financial Consultant',\n", " 'HR Specialist', 'Executive Assistant', 'Data Engineer', 'Legal Advisor', 'Product Owner',\n", " 'Operations Director', 'IT Administrator', 'Brand Manager', 'Customer Service Representative', 'Medical Assistant',\n", "]\n", "\n", "industry = [\n", " 'technology', 'finance', 'healthcare', 'manufacturing', 'education',\n", " 'real estate', 'marketing', 'media', 'retail', 'automotive',\n", " 'hospitality', 'construction', 'pharmaceutical', 'telecommunications', 'energy',\n", " 'transportation', 'insurance', 'consulting', 'legal', 'entertainment',\n", "]\n", "\n", "account = [\n", " 'Google account', 'Facebook account', 'Apple account', 'Amazon account', 'Netflix account',\n", " 'Spotify account', 'Microsoft account', 'Instagram account', 'Twitter account', 'Uber account',\n", " 'Dropbox account', 'LinkedIn account', 'Slack account', 'Zoom account', 'Venmo account',\n", " 'PayPal account', 'eBay account', 'Airbnb account', 'Twitch account', 'Pinterest account',\n", "]\n", "\n", "software = [\n", " 'Windows 10', 'macOS', 'Microsoft Office', 'Adobe Photoshop', 'Slack',\n", " 'Zoom', 'Google Chrome', 'Firefox', 'Visual Studio Code', 'Python',\n", " 'Java', 'Salesforce', 'WordPress', 'AutoCAD', 'Tableau',\n", " 'SQL Server', 'GitHub', 'IntelliJ IDEA', 'Figma', 'Trello',\n", "]\n", "\n", "place = [\n", " 'Disneyland', 'Eiffel Tower', 'Statue of Liberty', 'The Grand Canyon', 'The Colosseum',\n", " 'Empire State Building', 'Golden Gate Bridge', 'Mount Rushmore', 'Niagara Falls', 'The Louvre',\n", " 'Big Ben', 'The Vatican', 'Great Wall of China', 'Times Square', 'Central Park',\n", " 'Sydney Opera House', 'Stonehenge', 'Machu Picchu', 'Christ the Redeemer', 'The Pyramids of Giza',\n", "]\n", "\n", "email_provider = ['Gmail', 'Yahoo Mail', 'Outlook', 'iCloud', 'ProtonMail',]\n", "login_service = [\n", " 'Netflix', 'Amazon', 'Spotify', 'Facebook', 'Instagram', 'PayPal', 'Gmail',\n", " 'LinkedIn', 'Twitter', 'Zoom', 'Dropbox', 'Uber', 'Venmo',\n", "]\n", "government_service = ['IRS', 'DMV', 'SSA', 'FBI', 'DHS', 'CDC']\n", "financial_service = [\n", " 'Bank of America', 'Wells Fargo', 'Chase', 'Citibank', 'Capital One',\n", " 'Discover', 'American Express', 'PayPal', 'Venmo',\n", "]\n", "support_service = ['Dell', 'Apple', 'Samsung', 'HP', 'Lenovo', 'Microsoft',]\n", "\n", "domain = [\n", " 'google.com',\n", " 'facebook.com',\n", " 'amazon.com',\n", " 'youtube.com',\n", " 'wikipedia.org',\n", " 'twitter.com',\n", " 'reddit.com',\n", " 'netflix.com',\n", " 'ebay.com',\n", " 'linkedin.com',\n", " 'pinterest.com',\n", " 'instagram.com',\n", " 'craigslist.org',\n", " 'yahoo.com',\n", " 'hulu.com',\n", "\n", " # News & Media\n", " 'espn.com',\n", " 'foxnews.com',\n", " 'cnn.com',\n", " 'nytimes.com',\n", " 'washingtonpost.com',\n", " 'bbc.com',\n", " 'msnbc.com',\n", " 'theguardian.com',\n", " 'buzzfeednews.com',\n", " 'nbcnews.com',\n", "\n", " # Shopping & E-commerce\n", " 'walmart.com',\n", " 'apple.com',\n", " 'target.com',\n", " 'costco.com',\n", " 'bestbuy.com',\n", " 'homedepot.com',\n", " 'lowes.com',\n", " 'etsy.com',\n", " 'kohls.com',\n", " 'macys.com',\n", "\n", " # Government Services\n", " 'irs.gov',\n", " 'dmv.org',\n", " 'ssa.gov',\n", " 'healthcare.gov',\n", " 'fbi.gov',\n", " 'usps.com',\n", " 'medicaid.gov',\n", " 'va.gov',\n", " 'uscis.gov',\n", " 'cdc.gov',\n", "\n", " # Entertainment & Streaming\n", " 'spotify.com',\n", " 'disneyplus.com',\n", " 'peacocktv.com',\n", " 'hbomax.com',\n", " 'paramountplus.com',\n", " 'twitch.tv',\n", " 'sling.com',\n", " 'primevideo.com',\n", " 'tv.apple.com',\n", "\n", " # Travel & Booking\n", " 'expedia.com',\n", " 'tripadvisor.com',\n", " 'booking.com',\n", " 'airbnb.com',\n", " 'priceline.com',\n", " 'southwest.com',\n", " 'aa.com',\n", " 'delta.com',\n", "\n", " # Financial Services & Payments\n", " 'paypal.com',\n", " 'venmo.com',\n", " 'chase.com',\n", " 'bankofamerica.com',\n", " 'wellsfargo.com',\n", " 'capitalone.com',\n", " 'americanexpress.com',\n", " 'discover.com',\n", " 'stripe.com',\n", "\n", " # Utility Services\n", " 'comcast.com',\n", " 'xfinity.com',\n", " 'att.com',\n", " 'verizon.com',\n", " 'spectrum.com',\n", " 'duke-energy.com',\n", " 'coned.com',\n", " 'pseg.com',\n", " 'nationalgridus.com',\n", " 'fpl.com',\n", "\n", " # Health & Fitness\n", " 'webmd.com',\n", " 'myfitnesspal.com',\n", " 'mayoclinic.org',\n", " 'healthline.com',\n", " 'bcbs.com',\n", " 'uhc.com',\n", " 'walgreens.com',\n", " 'cvs.com',\n", "\n", " ## Additional domains\n", " 'tiktok.com',\n", " 'whatsapp.com',\n", " 'messenger.com',\n", " 'snapchat.com',\n", " 'slack.com',\n", " 'forbes.com',\n", " 'bloomberg.com',\n", " 'reuters.com',\n", " 'usatoday.com',\n", " 'aljazeera.com',\n", " 'newegg.com',\n", " 'wayfair.com',\n", " 'zillow.com',\n", " 'chewy.com',\n", " 'sephora.com',\n", " 'coursera.org',\n", " 'udemy.com',\n", " 'khanacademy.org',\n", " 'edx.org',\n", " 'duolingo.com',\n", " 'nih.gov',\n", " 'clevelandclinic.org',\n", " 'robinhood.com',\n", " 'sofi.com',\n", " 'dropbox.com',\n", " 'weebly.com',\n", " 'shopify.com',\n", " 'wordpress.com',\n", " 'turbotax.com',\n", " 'creditkarma.com',\n", " 'intuit.com',\n", " 'geico.com',\n", " 'progressive.com',\n", " 'statefarm.com',\n", " 'allstate.com',\n", " 'esurance.com',\n", " 'pnc.com',\n", " 'td.com',\n", " 'citibank.com',\n", " 'suntrust.com',\n", " 'huntington.com',\n", " 'ally.com',\n", " 'navyfed.org',\n", " 'fidelity.com',\n", " 'vanguard.com',\n", " 'etrade.com',\n", " 'schwab.com',\n", " 'ameritrade.com',\n", " 'coinmarketcap.com',\n", " 'yelp.com',\n", " 'opentable.com',\n", " 'groupon.com',\n", " 'livingSocial.com',\n", " 'kayak.com',\n", " 'hotels.com',\n", " 'orbitz.com',\n", " 'cheapoair.com',\n", " 'travelocity.com',\n", " 'skyscanner.com',\n", " 'jetblue.com',\n", " 'alaskaair.com',\n", " 'spirit.com',\n", " 'nordstrom.com',\n", " 'gap.com',\n", " 'oldnavy.com',\n", " 'bananaRepublic.com',\n", " 'hottopic.com',\n", " 'uniqlo.com',\n", " 'jcpenney.com',\n", " 'sears.com',\n", " 'footlocker.com',\n", " 'victoriassecret.com',\n", " 'adidas.com',\n", " 'nike.com',\n", " 'underarmour.com',\n", "]\n" ] }, { "cell_type": "code", "execution_count": null, "id": "a7340c1e-a088-4581-8b93-3821f68e2193", "metadata": {}, "outputs": [], "source": [ "len(navigation_intent_templates)" ] }, { "cell_type": "code", "execution_count": null, "id": "1a6cf82c-78a4-4b9a-ad50-27787ac8dfef", "metadata": {}, "outputs": [], "source": [ "BANK_NAVIGATION = \"{bank}\"\n", "CREDIT_CARD_NAVIGATION = \"{credit_card}\"\n", "LOCATION_NAVIGATION = \"{location}\"\n", "CREDIT_UNION_NAVIGATION = \"{credit_union}\"\n", "SERVICE_NAVIGATION = \"{service}\"\n", "PRODUCT_NAVIGATION = \"{product}\"\n", "PLATFORM_NAVIGATION = \"{platform}\"\n", "STREAMING_SERVICE_NAVIGATION = \"{streaming_service}\"\n", "SHOW_NAVIGATION = \"{show}\"\n", "LEARNING_PLATFORM_NAVIGATION = \"{learning_platform}\"\n", "SHIPPING_SERVICE_NAVIGATION = \"{shipping_service}\"\n", "COURIER_NAVIGATION = \"{courier}\"\n", "UNIVERSITY_NAVIGATION = \"{university}\"\n", "STATE_DMV_NAVIGATION = \"{state_dmv}\"\n", "UTILITY_COMPANY_NAVIGATION = \"{utility_company}\"\n", "UTILITY_SERVICE_NAVIGATION = \"{utility_service}\"\n", "EVENT_NAVIGATION = \"{event}\"\n", "COMPANY_NAVIGATION = \"{company}\"\n", "DEVICE_NAVIGATION = \"{device}\"\n", "FESTIVAL_NAVIGATION = \"{festival}\"\n", "ARTIST_NAVIGATION = \"{artist}\"\n", "JOBROLE_NAVIGATION = \"{job_role}\"\n", "POSITION_NAVIGATION = \"{position}\"\n", "INDUSTRY_NAVIGATION = \"{industry}\"\n", "ACCOUNT_NAVIGATION = \"{account}\"\n", "SOFTWARE_NAVIGATION = \"{software}\"\n", "PLACE_NAVIGATION = \"{place}\"\n", "EMAIL_PROVIDER_NAVIGATION = \"{email_provider}\"\n", "LOGIN_SERVICE_NAVIGATION = \"{login_service}\"\n", "GOVERNMENT_SRVICE_NAVIGATION = \"{government_service}\"\n", "FINANCIAL_SERVICE_NAVIGATION = \"{financial_service}\"\n", "SUPPORT_SREVICE_NAVIGATION = \"{support_service}\"\n", "DOMAIN_NAVIGATION = \"{domain}\"\n", "\n", "navigation_categories = {\n", " BANK_NAVIGATION: bank,\n", " CREDIT_CARD_NAVIGATION: credit_card,\n", " LOCATION_NAVIGATION: location,\n", " CREDIT_UNION_NAVIGATION: credit_union,\n", " SERVICE_NAVIGATION: service,\n", " PRODUCT_NAVIGATION: product,\n", " PLATFORM_NAVIGATION: platform,\n", " STREAMING_SERVICE_NAVIGATION: streaming_service,\n", " SHOW_NAVIGATION: show,\n", " LEARNING_PLATFORM_NAVIGATION: learning_platform,\n", " SHIPPING_SERVICE_NAVIGATION: shipping_service,\n", " COURIER_NAVIGATION: courier,\n", " UNIVERSITY_NAVIGATION: university,\n", " STATE_DMV_NAVIGATION: state_dmv,\n", " UTILITY_COMPANY_NAVIGATION: utility_company,\n", " UTILITY_SERVICE_NAVIGATION: utility_service,\n", " EVENT_NAVIGATION: event,\n", " COMPANY_NAVIGATION: company,\n", " DEVICE_NAVIGATION: device,\n", " FESTIVAL_NAVIGATION: festival,\n", " ARTIST_NAVIGATION: artist,\n", " JOBROLE_NAVIGATION: job_role,\n", " POSITION_NAVIGATION: position,\n", " INDUSTRY_NAVIGATION: industry,\n", " ACCOUNT_NAVIGATION: account,\n", " SOFTWARE_NAVIGATION: software,\n", " PLACE_NAVIGATION: place,\n", " EMAIL_PROVIDER_NAVIGATION: email_provider,\n", " LOGIN_SERVICE_NAVIGATION: login_service,\n", " GOVERNMENT_SRVICE_NAVIGATION: government_service,\n", " FINANCIAL_SERVICE_NAVIGATION: financial_service,\n", " SUPPORT_SREVICE_NAVIGATION: support_service,\n", " DOMAIN_NAVIGATION: domain,\n", "}\n", "\n" ] }, { "cell_type": "code", "execution_count": null, "id": "3278fde3-5a3e-4fad-b258-2c77c1d514a2", "metadata": {}, "outputs": [], "source": [ "navigation_intent_additional_queries = generate_service_queries(navigation_categories, navigation_intent_templates, n_queries=9000)\n", "print(len(navigation_intent_additional_queries))" ] }, { "cell_type": "code", "execution_count": null, "id": "743e42f0-e4e1-422f-8548-3adf4092d1f7", "metadata": {}, "outputs": [], "source": [ "navigation_intent_additional_queries_df = pd.DataFrame(navigation_intent_additional_queries, columns=['sequence'])\n", "navigation_intent_additional_queries_df['target'] = 'navigation_intent'\n", "navigation_intent_additional_queries_df" ] }, { "cell_type": "markdown", "id": "266fa089-6335-4b18-981a-afc2546a829a", "metadata": {}, "source": [ "#### Travel intent additional queries generation" ] }, { "cell_type": "code", "execution_count": null, "id": "1ac55113-6c8e-4f94-93f3-82783347d3da", "metadata": {}, "outputs": [], "source": [ "travel_intent_templates = [\n", " # Visa Information & Requirements\n", " \"What is the US cost for {country} visitor visa?\",\n", " \"Do I need a visa to visit {country}?\",\n", " \"How long can I stay in {country} with a visa?\",\n", " \"Requirements for {country} tourist visa\",\n", " \"What is the visa fee for {country} visitors?\",\n", " \"Can I extend my visa stay in {country}?\",\n", " \"What documents are needed for a {country} work visa?\",\n", " \"How to apply for a visa for {country}?\",\n", " \"What is the processing time for a {country} visa?\",\n", " \"Is a transit visa required for {country}?\",\n", "\n", " # Cruise Information & Pricing\n", " \"What are the prices for cruises to {destination}?\",\n", " \"Does {cruise_line} offer {service}?\",\n", " \"Which cruise lines sail from {location}?\",\n", " \"Best time to book cruises to {destination}\",\n", " \"What is the cost of a {cruise_line} cruise to {destination}?\",\n", " \"Do cruises from {location} go to {destination}?\",\n", " \"What are the cancellation policies for {cruise_line}?\",\n", " \"Is there an all-inclusive option for {cruise_line}?\",\n", " \"What’s included in a {cruise_line} package?\",\n", " \"What are the best-rated {cruise_line} destinations?\",\n", " \n", " # Airport & Flight Information\n", " \"What airport is closest to {location}?\",\n", " \"What airport code is {airport_code}?\",\n", " \"Which airlines travel to {destination}?\",\n", " \"What airport is near {tourist_attraction}?\",\n", " \"What is the best airport for {city_state}?\",\n", " \"Direct flights from {location} to {destination}\",\n", " \"What are the best budget airlines to {destination}?\",\n", " \"Is there an airport lounge at {airport_code}?\",\n", " \"How early should I arrive at {airport_code}?\",\n", " \"What are the baggage policies for flights to {destination}?\",\n", "\n", " # Best Time to Visit\n", " \"When is the best time to visit {destination}?\",\n", " \"What is the best season to visit {destination}?\",\n", " \"What month should I visit {tourist_attraction}?\",\n", " \"When should I travel to {country} for good weather?\",\n", " \"Best time to visit {tourist_destination} in {country}\",\n", " \"What are the off-peak months for {destination}?\",\n", " \"Is it worth visiting {destination} during winter?\",\n", " \"What is the rainy season in {country}?\",\n", " \"When can I avoid crowds in {tourist_attraction}?\",\n", " \"What is the tourist season for {destination}?\",\n", "\n", " # Tourist Attractions & Tours\n", " \"Top tourist attractions in {destination}\",\n", " \"Best tours of {destination}\",\n", " \"Guided tours to {country}\",\n", " \"What are the must-visit attractions in {location}?\",\n", " \"What are the most popular tours in {destination}?\",\n", " \"What tours are available in {region}?\",\n", " \"Are there family-friendly tours in {destination}?\",\n", " \"How to book a tour of {tourist_attraction}?\",\n", " \"Is {tourist_attraction} open year-round?\",\n", " \"What is the admission fee for {tourist_attraction}?\",\n", "\n", " # Resorts & Hotels\n", " \"What are the best resorts in {destination}?\",\n", " \"Is {resort} all-inclusive?\",\n", " \"Does {resort} charge a resort fee?\",\n", " \"Where is the nearest resort to {location}?\",\n", " \"What resorts in {destination} offer all-inclusive packages?\",\n", " \"Are there kid-friendly resorts in {destination}?\",\n", " \"Is {resort} pet-friendly?\",\n", " \"What are the spa services available at {resort}?\",\n", " \"Can I book a suite at {resort}?\",\n", " \"Does {resort} offer transportation from {airport_code}?\",\n", "\n", " # Weather Information\n", " \"Best weather for visiting {destination}\",\n", " \"What is the weather like in {country} during {month}?\",\n", " \"What is the average temperature in {destination} in {season}?\",\n", " \"How does the weather in {destination} change by season?\",\n", " \"What is the weather forecast for {destination} next week?\",\n", " \"What is the humidity level in {destination} during {month}?\",\n", " \"Is it rainy in {destination} in {season}?\",\n", " \"What are the sunniest months in {destination}?\",\n", " \"Is it cold in {destination} in {month}?\",\n", " \"What’s the UV index in {destination} this time of year?\",\n", "\n", " # Travel Costs & Pricing\n", " \"What is the cost of a vacation to {destination}?\",\n", " \"How much does it cost to visit {tourist_attraction}?\",\n", " \"What is the average cost of a flight to {destination}?\",\n", " \"How much do guided tours in {destination} cost?\",\n", " \"How much money should I bring for a trip to {country}?\",\n", " \"What’s the average hotel rate in {destination}?\",\n", " \"How expensive is dining in {destination}?\",\n", " \"Are there budget travel options for {destination}?\",\n", " \"What’s the cheapest month to travel to {destination}?\",\n", " \"Can I travel to {destination} on a low budget?\",\n", "\n", " # Passports & Travel Documentation\n", " \"Do I need a passport to travel to {destination}?\",\n", " \"What documents are required to visit {country}?\",\n", " \"How to apply for a visa to visit {destination}?\",\n", " \"Can US citizens travel to {country} without a passport?\",\n", " \"Where to apply for a passport to travel to {destination}?\",\n", " \"How long is my passport valid for traveling to {country}?\",\n", " \"Can I use a digital visa for {country}?\",\n", " \"How to renew my passport before traveling?\",\n", " \"Are vaccinations required for {country} travel?\",\n", " \"Do I need travel insurance to visit {destination}?\",\n", "\n", " # Travel Destinations\n", " \"Most visited places in {country}\",\n", " \"Top travel destinations in {destination}\",\n", " \"What are the top places to visit in {country}?\",\n", " \"What are the most popular tourist attractions in {city}?\",\n", " \"What are the best destinations in {region} for vacations?\",\n", " \"Best adventure travel spots in {region}\",\n", " \"Underrated places to visit in {country}\",\n", " \"Top beach destinations in {country}\",\n", " \"What are the top historical sites in {destination}?\",\n", " \"Best romantic getaways in {destination}\",\n", "\n", " ## short queries\n", " # Country or City Searches\n", " \"{country} travel\",\n", " \"{destination} flights\",\n", " \"{country} visa\",\n", " \"{destination} hotels\",\n", " \"{country} tourism\",\n", " \"{city_state} guide\",\n", " \"{region} cruises\",\n", "\n", " # Tourist Attractions\n", " \"{tourist_attraction}\",\n", " \"visit {tourist_attraction}\",\n", " \"explore {tourist_attraction}\",\n", "\n", " # Flights and Airports\n", " \"{airport_code} flights\",\n", " \"{city_state} flights\",\n", " \"{destination} airport\",\n", " \"{airport_code} airport\",\n", " \"{destination} fares\",\n", "\n", " # Travel Essentials\n", " \"{country} passport\",\n", " \"{country} documents\",\n", " \"{country} travel\",\n", " \"{destination} costs\",\n", " \"{country} insurance\",\n", "\n", " # Tours and Cruises\n", " \"{destination} tours\",\n", " \"{cruise_line} cruise\",\n", " \"tours {destination}\",\n", " \"cruise {destination}\",\n", "\n", " # Resorts and Hotels\n", " \"{resort} stay\",\n", " \"{destination} hotels\",\n", " \"{resort} booking\",\n", " \"{destination} resort\",\n", " \"stay {destination}\",\n", "\n", " # Travel Costs and Budgets\n", " \"{destination} prices\",\n", " \"{destination} budget\",\n", " \"{country} costs\",\n", " \"{destination} expense\",\n", " \"{country} currency\",\n", "]\n", "\n", "print(len(travel_intent_templates))" ] }, { "cell_type": "code", "execution_count": null, "id": "5bc1b36e-0fee-40cf-aba8-d57242c1f407", "metadata": {}, "outputs": [], "source": [ "country = [\n", " 'Australia', 'Israel', 'Dominican Republic', 'Mexico', 'Canada',\n", " 'United Kingdom', 'France', 'Spain', 'Italy', 'Japan',\n", " 'Germany', 'Brazil', 'Argentina', 'China', 'South Korea',\n", " 'Thailand', 'India', 'Greece', 'Egypt', 'New Zealand',\n", " 'Sweden', 'Norway', 'Portugal', 'Switzerland', 'South Africa',\n", " 'Iceland', 'Russia', 'Peru', 'Morocco', 'Vietnam',\n", "]\n", "\n", "destination = [\n", " 'Hawaii', 'Las Vegas', 'Disney World', 'Grand Canyon', 'New Zealand',\n", " 'Singapore', 'Bahamas', 'Switzerland', 'Ireland', 'Rome',\n", " 'Maui', 'Bora Bora', 'Dubai', 'Bali', 'Maldives',\n", " 'Machu Picchu', 'Reykjavik', 'Iceland', 'Paris', 'London',\n", " 'Bangkok', 'Vienna', 'Amsterdam', 'Bruges', 'Santorini',\n", " 'Phuket', 'Cairo', 'Cape Town', 'Prague', 'Sydney',\n", "]\n", "\n", "cruise_line = [\n", " 'Carnival Cruise', 'Royal Caribbean', 'Disney Cruise Line', 'Norwegian Cruise Line', 'Celebrity Cruises',\n", " 'Princess Cruises', 'Holland America Line', 'MSC Cruises', 'Viking Cruises', 'Azamara Club Cruises',\n", " 'Costa Cruises', 'Silversea Cruises', 'Seabourn Cruise Line', 'Oceania Cruises', 'Regent Seven Seas Cruises',\n", "]\n", "\n", "location = [\n", " 'Miami', 'Los Angeles', 'Orlando', 'Seattle', 'Galveston',\n", " 'New York City', 'San Francisco', 'Tucson', 'Las Vegas', 'Phoenix',\n", " 'Austin', 'Boston', 'Chicago', 'Houston', 'Denver',\n", " 'Portland', 'Salt Lake City', 'Atlanta', 'Dallas', 'Nashville',\n", " 'Philadelphia', 'Baltimore', 'Detroit', 'Indianapolis', 'Charlotte',\n", "]\n", "\n", "tourist_attraction = [\n", " 'White House', 'Niagara Falls', 'Yosemite National Park', 'Tower of London', 'Vatican Museum',\n", " 'Eiffel Tower', 'Mount Rushmore', 'Disneyland', 'Air Force Academy', 'The Colosseum',\n", " 'Statue of Liberty', 'Golden Gate Bridge', 'Stonehenge', 'Machu Picchu', 'The Great Wall of China',\n", " 'Taj Mahal', 'Petra', 'Christ the Redeemer', 'Angkor Wat', 'Sagrada Familia',\n", " 'Mount Everest', 'Victoria Falls', 'Banff National Park', 'Kremlin', 'Acropolis',\n", " 'Sydney Opera House', 'Buckingham Palace', 'Temple of the Emerald Buddha', 'Grand Bazaar', 'Meiji Shrine',\n", "]\n", "\n", "airport_code = [\n", " 'JFK', 'LAX', 'IAD', 'ORD', 'ATL', 'MCO', 'PHL', 'SFO', 'SEA', 'PHX',\n", " 'DFW', 'MIA', 'DEN', 'BOS', 'DTW', 'LGA', 'CLT', 'MSP', 'FLL', 'LAS',\n", " 'IAH', 'HNL', 'SAN', 'BWI', 'TPA', 'YVR', 'YYZ', 'DCA', 'CDG', 'FRA',\n", "]\n", "\n", "resort = [\n", " 'Port Orleans Resort', 'Westgate Resort', 'Kona Coast Resort', 'Bahia Luxury Resort', 'Elara by Hilton',\n", " 'Nizuc Resort', 'Grand Lakes Resort', 'Ashford Castle', 'Vienna Resort', 'Koh Samui Resort',\n", " 'Four Seasons Resort Maui', 'Ritz-Carlton Kapalua', 'Waldorf Astoria Los Cabos', 'Atlantis Paradise Island', 'Le Blanc Spa Resort',\n", " 'Bora Bora Lagoon Resort', 'Amangiri', 'Jade Mountain Resort', 'Shangri-La Resort', 'Amanpuri',\n", "]\n", "\n", "region = [\n", " 'South East Asia', 'Caribbean', 'Mediterranean', 'Pacific Islands', 'Western Europe',\n", " 'East Africa', 'Middle East', 'South America', 'Southern Africa', 'Western US',\n", " 'Northern Europe', 'Central America', 'Eastern Europe', 'Indian Ocean', 'Arctic Circle',\n", " 'Scandinavia', 'Baltic States', 'North Africa', 'Andes Mountains', 'French Polynesia',\n", "]\n", "\n", "city_state = [\n", " 'Washington, DC', 'Orlando, FL', 'Las Vegas, NV', 'San Diego, CA', 'New York, NY',\n", " 'Los Angeles, CA', 'Miami, FL', 'Jacksonville, NC', 'Galveston, TX', 'Williamsburg, VA',\n", " 'Austin, TX', 'Boston, MA', 'Phoenix, AZ', 'Dallas, TX', 'Nashville, TN',\n", " 'San Antonio, TX', 'San Jose, CA', 'Sacramento, CA', 'Portland, OR', 'St. Louis, MO',\n", "]\n", "\n" ] }, { "cell_type": "code", "execution_count": null, "id": "fc70dc32-1208-4555-951b-c224f08d32d8", "metadata": {}, "outputs": [], "source": [ "COUNTRY_TRAVEL = \"{country}\"\n", "DESTINATION_TRAVEL = \"{destination}\"\n", "CRUISE_LINE_TRAVEL = \"{cruise_line}\"\n", "LOCATION_TRAVEL = \"{location}\"\n", "TOURIST_ATTRACTION_TRAVEL = \"{tourist_attraction}\"\n", "AIRPORT_CODE_TRAVEL = \"{airport_code}\"\n", "RESORT_TRAVEL = \"{resort}\"\n", "REGION_TRAVEL = \"{region}\"\n", "CITY_STATE_TRAVEL = \"{city_state}\"\n", "\n", "\n", "travel_categories = {\n", " COUNTRY_TRAVEL: country,\n", " DESTINATION_TRAVEL: destination,\n", " CRUISE_LINE_TRAVEL: cruise_line,\n", " LOCATION_TRAVEL: location,\n", " TOURIST_ATTRACTION_TRAVEL: tourist_attraction,\n", " AIRPORT_CODE_TRAVEL: airport_code,\n", " RESORT_TRAVEL: resort,\n", " REGION_TRAVEL: region,\n", " CITY_STATE_TRAVEL: city_state,\n", "}\n", "\n" ] }, { "cell_type": "code", "execution_count": null, "id": "7affa29c-b13d-46e7-88a4-58ab752aded9", "metadata": {}, "outputs": [], "source": [ "travel_intent_additional_queries = generate_service_queries(travel_categories, travel_intent_templates, n_queries=5000)\n", "print(len(travel_intent_additional_queries))" ] }, { "cell_type": "code", "execution_count": null, "id": "468e4e5c-bd94-4c87-94f2-21de93d022cf", "metadata": {}, "outputs": [], "source": [ "# travel_intent_additional_queries\n", "travel_intent_additional_queries_df = pd.DataFrame(travel_intent_additional_queries, columns=['sequence'])\n", "travel_intent_additional_queries_df['target'] = 'travel_intent'\n", "travel_intent_additional_queries_df" ] }, { "cell_type": "markdown", "id": "dfb9bc97-5c81-472d-818b-4fa8a0341023", "metadata": {}, "source": [ "#### Additional examples for Translation intent" ] }, { "cell_type": "code", "execution_count": null, "id": "7f2b974c-4a27-4443-a9aa-cac40a40f5c6", "metadata": {}, "outputs": [], "source": [ "translation_intent_templates = [\n", " # Basic Translations (Word or Phrase)\n", " \"What is the translation for {word} in {language}?\",\n", " \"How do you say {phrase} in {language}?\",\n", " \"What does {word} mean in {language}?\",\n", " \"Translate {word} to {language}\",\n", " \"What is {phrase} in {language}?\",\n", " \"Translate {phrase} to {language}\",\n", "\n", " # Meaning of Words in a Language\n", " \"What does {word} mean in {language}?\",\n", " \"What is the meaning of {word} in {language}?\",\n", " \"Explain the meaning of {phrase} in {language}\",\n", " \"What is the translation of {phrase} in {language}?\",\n", " \"How do you express {word} in {language}?\",\n", "\n", " # Pronunciations & Spellings\n", " \"How do you pronounce {word} in {language}?\",\n", " \"What is the correct spelling of {word} in {language}?\",\n", " \"What is the phonetic spelling for {word} in {language}?\",\n", " \"How to spell {word} in {language}?\",\n", " \"How do you pronounce {phrase} in {language}?\",\n", " \n", "]\n" ] }, { "cell_type": "code", "execution_count": null, "id": "5135fe0a-51fd-4275-8b86-f3bfdd517e7d", "metadata": {}, "outputs": [], "source": [ "word = [\n", " 'beautiful', 'friend', 'hello', 'thank you', 'family',\n", " 'happy', 'love', 'music', 'freedom', 'peace',\n", " 'home', 'work', 'future', 'goodbye', 'success',\n", " 'health', 'school', 'truth', 'happiness', 'strength'\n", "]\n", "\n", "phrase = [\n", " 'how are you', 'good morning', 'I love you', 'what’s your name', 'where is the bathroom',\n", " 'see you later', 'happy birthday', 'congratulations', 'good night', 'I miss you',\n", " 'nice to meet you', 'have a great day', 'thank you very much', 'how old are you', 'take care',\n", " 'good afternoon', 'can you help me', 'I don’t understand', 'excuse me', 'I am sorry'\n", "]\n", "\n", "language = [\n", " 'Spanish', 'French', 'German', 'Japanese', 'Chinese',\n", " 'Russian', 'Italian', 'Portuguese', 'Korean', 'Hindi',\n", " 'Arabic', 'Dutch', 'Greek', 'Hebrew', 'Swedish',\n", " 'Turkish', 'Vietnamese', 'Polish', 'Thai', 'Bengali'\n", "]\n", "\n" ] }, { "cell_type": "code", "execution_count": null, "id": "f74a5b98-5417-4fe4-b87f-f268893644a1", "metadata": {}, "outputs": [], "source": [ "WORD_TRANSLATE = \"{word}\"\n", "PHRASE_TRANSLATE = \"{phrase}\"\n", "LANGUAGE_TRANSLATE = \"{language}\"\n", "\n", "\n", "translate_categories = {\n", " WORD_TRANSLATE: word,\n", " PHRASE_TRANSLATE: phrase,\n", " LANGUAGE_TRANSLATE: language,\n", "}\n", "\n" ] }, { "cell_type": "code", "execution_count": null, "id": "1a783b9b-a74a-4b6e-83f0-146d4bbb55ba", "metadata": {}, "outputs": [], "source": [ "translate_intent_additional_queries = generate_service_queries(translate_categories, translation_intent_templates, n_queries=2000)\n", "print(len(translate_intent_additional_queries))" ] }, { "cell_type": "code", "execution_count": null, "id": "b4eb1e4d-f2b1-47f8-b042-543bf85308bd", "metadata": {}, "outputs": [], "source": [ "translate_intent_additional_queries_df = pd.DataFrame(translate_intent_additional_queries, columns=['sequence'])\n", "translate_intent_additional_queries_df['target'] = 'translation_intent'\n", "translate_intent_additional_queries_df" ] }, { "cell_type": "code", "execution_count": null, "id": "fbdc6120-1559-4cef-b790-3ba7508ec61e", "metadata": {}, "outputs": [], "source": [ "unknown_intent_templates = [\n", " \"{unknown1}\",\n", " \"{unknown1} {unknown2}\",\n", " \"{rand_city}\",\n", "]\n" ] }, { "cell_type": "code", "execution_count": null, "id": "b24cacaa-ffcf-4879-81f3-ecba02c33219", "metadata": {}, "outputs": [], "source": [ "unknown1 = [\n", " \"next\", \"there\", \"proposal\",\n", " \"proposa\", \"banana\", \"mango\", \"pineapple\", \"apple\", \"grapes\", \"orange\",\n", "]\n", "\n", "unknown2 = unknown1[::]\n", "\n", "rand_city = [\n", " \"Big City\", \"Silver City\", \"Golden City\", \"Mystic City\",\n", "]" ] }, { "cell_type": "code", "execution_count": null, "id": "e543b5fb-2829-42a1-967c-93daa7fda688", "metadata": {}, "outputs": [], "source": [ "UNKNOWN1_CATEGORY = \"{unknown1}\"\n", "UNKNOWN2_CATEGORY = \"{unknown2}\"\n", "RAND_CITY_CATEGORY = \"{rand_city}\"\n", "\n", "\n", "unknown_categories = {\n", " UNKNOWN1_CATEGORY: unknown1,\n", " UNKNOWN2_CATEGORY: unknown2,\n", " RAND_CITY_CATEGORY: rand_city\n", "}" ] }, { "cell_type": "code", "execution_count": null, "id": "97005408-98d8-4302-8070-c3b45089b808", "metadata": {}, "outputs": [], "source": [ "unknown_intent_additional_queries = generate_service_queries(unknown_categories, unknown_intent_templates, n_queries=100)\n", "print(len(unknown_intent_additional_queries))" ] }, { "cell_type": "code", "execution_count": null, "id": "936d6d26-db9f-4d6b-9179-f0e5daab4b5c", "metadata": {}, "outputs": [], "source": [ "unknown_intent_additional_queries" ] }, { "cell_type": "code", "execution_count": null, "id": "ad1cdb70-6e31-434f-9cbd-4e66e9ca9c47", "metadata": {}, "outputs": [], "source": [ "unknown_intent_additional_queries_df = pd.DataFrame(unknown_intent_additional_queries, columns=['sequence'])\n", "unknown_intent_additional_queries_df['target'] = 'unknown'\n", "unknown_intent_additional_queries_df" ] }, { "cell_type": "markdown", "id": "dde952a8-9dfa-4c9c-aca0-656d7675d5ce", "metadata": {}, "source": [ "#### Adding some Information intent examples" ] }, { "cell_type": "code", "execution_count": null, "id": "8d17ce85-3c05-46cd-b017-4ac96eb4f59e", "metadata": {}, "outputs": [], "source": [ "movie = [\n", " # 2019 Movies\n", " \"Avengers: Endgame\", \"The Lion King (2019)\", \"Frozen II\", \"Toy Story 4\", \n", " \"Star Wars: The Rise of Skywalker\", \"Joker\", \"Spider-Man: Far From Home\", \n", " \"Captain Marvel\", \"Aladdin (2019)\", \"Knives Out\", \"Us\", \"Once Upon a Time in Hollywood\", \n", " \"1917\", \"Ford v Ferrari\", \"It Chapter Two\", \"Parasite\", \"Shazam!\", \n", " \"How to Train Your Dragon: The Hidden World\", \"Jumanji: The Next Level\", \"Little Women\", \n", " \"Marriage Story\", \"Jojo Rabbit\", \"The Irishman\", \"Rocketman\", \n", " \"John Wick: Chapter 3 – Parabellum\", \"Glass\", \"Hustlers\", \"The Lego Movie 2: The Second Part\", \n", " \"Dumbo\", \"Alita: Battle Angel\", \"Doctor Sleep\", \"Ad Astra\", \"The Lighthouse\", \n", " \"Frozen II\", \"Zombieland: Double Tap\", \"Midsommar\", \"Good Boys\", \"A Beautiful Day in the Neighborhood\",\n", "\n", " # 2020 Movies\n", " \"Tenet\", \"Sonic the Hedgehog\", \"Wonder Woman 1984\", \"Birds of Prey\", \n", " \"The Invisible Man\", \"Soul\", \"Onward\", \"The Croods: A New Age\", \"Mulan (2020)\", \n", " \"Bad Boys for Life\", \"The Trial of the Chicago 7\", \"Palm Springs\", \n", " \"Hamilton\", \"Ma Rainey's Black Bottom\", \"Borat Subsequent Moviefilm\", \n", " \"The Old Guard\", \"Enola Holmes\", \"The Midnight Sky\", \"Extraction\", \n", " \"The Call of the Wild\", \"Greyhound\", \"The Way Back\", \"Da 5 Bloods\", \n", " \"One Night in Miami...\", \"Sound of Metal\", \"Promising Young Woman\", \n", " \"The Devil All the Time\", \"News of the World\", \"Over the Moon\", \n", " \"A Shaun the Sheep Movie: Farmageddon\", \"My Spy\", \"The Personal History of David Copperfield\", \n", " \"The Half of It\", \"Pieces of a Woman\", \"The King of Staten Island\", \n", " \"The Lovebirds\", \"The Secret Garden\", \"Let Him Go\", \"Kajillionaire\", \"The Witches (2020)\",\n", "\n", " # 2021 Movies\n", " \"Spider-Man: No Way Home\", \"Shang-Chi and the Legend of the Ten Rings\", \n", " \"Black Widow\", \"Eternals\", \"Dune (2021)\", \"The Suicide Squad\", \n", " \"Free Guy\", \"Encanto\", \"Cruella\", \"No Time to Die\", \"The Mitchells vs. the Machines\", \n", " \"Luca\", \"Raya and the Last Dragon\", \"The Green Knight\", \"In the Heights\", \n", " \"A Quiet Place Part II\", \"Don't Look Up\", \"House of Gucci\", \n", " \"West Side Story (2021)\", \"The French Dispatch\", \"Jungle Cruise\", \n", " \"King Richard\", \"Belfast\", \"The Last Duel\", \"CODA\", \"Tick, Tick... Boom!\", \n", " \"Nightmare Alley\", \"The Power of the Dog\", \"Venom: Let There Be Carnage\", \n", " \"Ghostbusters: Afterlife\", \"The Forever Purge\", \"The Eyes of Tammy Faye\", \n", " \"Malcolm & Marie\", \"Spencer\", \"Antlers\", \"The Many Saints of Newark\", \n", " \"Fear Street Part One: 1994\", \"The Tomorrow War\", \"Bo Burnham: Inside\",\n", "\n", " # 2022 Movies\n", " \"Top Gun Maverick\", \"The Batman\", \"Black Panther: Wakanda Forever\", \n", " \"Doctor Strange in the Multiverse of Madness\", \"Avatar: The Way of Water\", \n", " \"Minions: The Rise of Gru\", \"Jurassic World Dominion\", \"Thor: Love and Thunder\", \n", " \"Everything Everywhere All at Once\", \"Nope\", \"The Woman King\", \"Smile\", \n", " \"The Menu\", \"Turning Red\", \"Glass Onion: A Knives Out Mystery\", \"Prey\", \n", " \"The Fabelmans\", \"Puss in Boots: The Last Wish\", \"Lightyear\", \"Pinocchio (2022)\", \n", " \"The Whale\", \"All Quiet on the Western Front\", \"Bullet Train\", \"Elvis\", \n", " \"The Banshees of Inisherin\", \"Barbarian\", \"Babylon\", \"Don't Worry Darling\", \n", " \"Amsterdam\", \"Marcel the Shell with Shoes On\", \"Hocus Pocus 2\", \"Bodies Bodies Bodies\", \n", " \"Bones and All\", \"The Northman\", \"RRR\", \"Emancipation\", \"Thirteen Lives\", \n", " \"The Adam Project\", \"Apollo 10½\", \"The Lost City\", \"Deep Water\", \n", " \"Where the Crawdads Sing\", \"No Exit\", \"Scream (2022)\", \"Women Talking\",\n", "\n", " # 2023 Movies\n", " \"Barbie\", \"Oppenheimer\", \"Spider-Man: Across the Spider-Verse\", \n", " \"Guardians of the Galaxy Vol. 3\", \"The Super Mario Bros. Movie\", \"The Little Mermaid (2023)\", \n", " \"Mission: Impossible – Dead Reckoning Part One\", \"Fast X\", \"John Wick: Chapter 4\", \n", " \"The Flash\", \"Elemental\", \"Indiana Jones and the Dial of Destiny\", \n", " \"Dungeons & Dragons: Honor Among Thieves\", \"Creed III\", \"The Marvels\", \n", " \"Ant-Man and the Wasp: Quantumania\", \"Evil Dead Rise\", \"The Hunger Games: The Ballad of Songbirds and Snakes\", \n", " \"Killers of the Flower Moon\", \"The Equalizer 3\", \"A Haunting in Venice\", \n", " \"Napoleon\", \"Wish\", \"The Nun II\", \"The Boogeyman\", \"Talk to Me\", \n", " \"Blue Beetle\", \"Teenage Mutant Ninja Turtles: Mutant Mayhem\", \n", " \"The Creator\", \"Transformers: Rise of the Beasts\", \"Asteroid City\", \n", " \"Saw X\", \"The Exorcist: Believer\", \"Five Nights at Freddy's\", \n", " \"Shazam! Fury of the Gods\", \"The Whale (Wide Release)\", \n", " \"Air\", \"Joy Ride\", \"The Pale Blue Eye\", \"Polite Society\", \n", " \"Are You There God? It’s Me, Margaret.\", \"Beau Is Afraid\", \"Gran Turismo\", \n", " \"Past Lives\", \"Next Goal Wins\", \"Maestro\", \"The Holdovers\", \"Poor Things\", \n", " \"The Killer\", \"TÁR (Wide Release)\", \"Foe\", \"Saltburn\", \"Knox Goes Away\", \n", " \"Wonka\", \"Flamin' Hot\", \"One Piece Film: Red\",\n", "\n", " # 2010 Movies\n", " \"Inception\", \"Toy Story 3\", \"The Social Network\", \"Harry Potter and the Deathly Hallows: Part 1\",\n", " \"Shutter Island\", \"Black Swan\", \"Iron Man 2\", \"The King's Speech\", \"Tangled\", \"Despicable Me\",\n", " \"How to Train Your Dragon\", \"The Twilight Saga: Eclipse\", \"Alice in Wonderland (2010)\", \n", " \"True Grit\", \"The Fighter\", \"Kick-Ass\", \"127 Hours\", \"Scott Pilgrim vs. The World\", \"Easy A\", \n", " \"The Town\", \"The Other Guys\", \"Buried\", \"The Expendables\", \"The Book of Eli\", \"Salt\", \n", " \"Clash of the Titans\", \"Robin Hood (2010)\", \"Percy Jackson & the Olympians: The Lightning Thief\", \n", " \"Tron: Legacy\", \"The Karate Kid (2010)\", \"Grown Ups\", \"Date Night\", \"Due Date\",\n", "\n", " # 2011 Movies\n", " \"Harry Potter and the Deathly Hallows: Part 2\", \"The Help\", \"Thor\", \"Captain America: The First Avenger\", \n", " \"The Twilight Saga: Breaking Dawn – Part 1\", \"The Girl with the Dragon Tattoo (2011)\", \"Rise of the Planet of the Apes\",\n", " \"Bridesmaids\", \"X-Men: First Class\", \"The Hunger Games\", \"Drive\", \"Moneyball\", \"War Horse\",\n", " \"The Artist\", \"Midnight in Paris\", \"Horrible Bosses\", \"Crazy, Stupid, Love\", \"The Descendants\", \n", " \"Super 8\", \"Tinker Tailor Soldier Spy\", \"Rango\", \"Hugo\", \"Kung Fu Panda 2\", \"Cars 2\", \n", " \"Fast Five\", \"The Adjustment Bureau\", \"Contagion\", \"Sherlock Holmes: A Game of Shadows\", \"Real Steel\", \n", " \"Paranormal Activity 3\", \"Puss in Boots\", \"The Smurfs\", \"Sucker Punch\", \"The Tree of Life\",\n", "\n", " # 2012 Movies\n", " \"The Avengers\", \"The Dark Knight Rises\", \"The Hunger Games\", \"Skyfall\", \"The Amazing Spider-Man\",\n", " \"The Twilight Saga: Breaking Dawn – Part 2\", \"Django Unchained\", \"Life of Pi\", \"The Hobbit: An Unexpected Journey\",\n", " \"Les Misérables\", \"Brave\", \"Wreck-It Ralph\", \"Silver Linings Playbook\", \"Argo\", \"Zero Dark Thirty\", \n", " \"Prometheus\", \"21 Jump Street\", \"Looper\", \"Magic Mike\", \"Ted\", \"Hotel Transylvania\", \"The Bourne Legacy\", \n", " \"Lincoln\", \"The Master\", \"Pitch Perfect\", \"The Perks of Being a Wallflower\", \"Beasts of the Southern Wild\", \n", " \"Flight\", \"Rise of the Guardians\", \"Cloud Atlas\", \"The Cabin in the Woods\", \"Chronicle\",\n", "\n", " # 2013 Movies\n", " \"Frozen\", \"Iron Man 3\", \"Despicable Me 2\", \"The Hunger Games: Catching Fire\", \"Man of Steel\", \n", " \"Gravity\", \"The Wolf of Wall Street\", \"American Hustle\", \"Thor: The Dark World\", \"The Great Gatsby (2013)\", \n", " \"The Hobbit: The Desolation of Smaug\", \"Monsters University\", \"12 Years a Slave\", \"The Conjuring\", \n", " \"Frozen\", \"World War Z\", \"Pacific Rim\", \"Captain Phillips\", \"Now You See Me\", \"The Heat\", \n", " \"Blue Jasmine\", \"Dallas Buyers Club\", \"Prisoners\", \"Saving Mr. Banks\", \"Her\", \"Rush\", \"This Is the End\", \n", " \"The Croods\", \"Elysium\", \"The Secret Life of Walter Mitty\", \"Inside Llewyn Davis\", \"The Wolverine\",\n", "\n", " # 2014 Movies\n", " \"Guardians of the Galaxy\", \"The LEGO Movie\", \"Captain America: The Winter Soldier\", \"Interstellar\", \n", " \"The Hunger Games: Mockingjay – Part 1\", \"Gone Girl\", \"The Hobbit: The Battle of the Five Armies\", \n", " \"Big Hero 6\", \"The Fault in Our Stars\", \"X-Men: Days of Future Past\", \"Maleficent\", \"Divergent\", \n", " \"The Grand Budapest Hotel\", \"How to Train Your Dragon 2\", \"The Imitation Game\", \"Birdman\", \n", " \"Whiplash\", \"American Sniper\", \"The Maze Runner\", \"Edge of Tomorrow\", \"Nightcrawler\", \n", " \"Unbroken\", \"The Theory of Everything\", \"The Equalizer\", \"Fury\", \"Godzilla (2014)\", \n", " \"22 Jump Street\", \"The Babadook\", \"A Most Violent Year\", \"Selma\", \"Boyhood\",\n", "\n", " # 2015 Movies\n", " \"Star Wars: The Force Awakens\", \"Avengers: Age of Ultron\", \"Jurassic World\", \"Inside Out\", \n", " \"The Martian\", \"Mad Max: Fury Road\", \"The Revenant\", \"Furious 7\", \"The Hunger Games: Mockingjay – Part 2\", \n", " \"Cinderella (2015)\", \"The Peanuts Movie\", \"Ant-Man\", \"Minions\", \"Spectre\", \"Pitch Perfect 2\", \n", " \"Creed\", \"The Big Short\", \"Ex Machina\", \"Room\", \"Spotlight\", \"Bridge of Spies\", \"Sicario\", \n", " \"Straight Outta Compton\", \"The Danish Girl\", \"Trainwreck\", \"The Good Dinosaur\", \n", " \"Shaun the Sheep Movie\", \"Spy\", \"The Man from U.N.C.L.E.\", \"Paper Towns\", \"Paddington\",\n", "\n", " # 2016 Movies\n", " \"Captain America: Civil War\", \"Rogue One: A Star Wars Story\", \"Finding Dory\", \"Zootopia\", \n", " \"The Jungle Book (2016)\", \"Moana\", \"Doctor Strange\", \"Fantastic Beasts and Where to Find Them\", \n", " \"Deadpool\", \"Batman v Superman: Dawn of Justice\", \"Suicide Squad\", \"La La Land\", \"Hacksaw Ridge\", \n", " \"Hidden Figures\", \"Arrival\", \"Manchester by the Sea\", \"Lion\", \"Moonlight\", \"Hell or High Water\", \n", " \"The Nice Guys\", \"Passengers\", \"The Secret Life of Pets\", \"Sing\", \"Trolls\", \n", " \"Kubo and the Two Strings\", \"10 Cloverfield Lane\", \"The Legend of Tarzan\", \n", " \"The Magnificent Seven (2016)\", \"The Shallows\", \"War Dogs\", \"Deepwater Horizon\",\n", "\n", " # 2017 Movies\n", " \"Wonder Woman\", \"Star Wars: The Last Jedi\", \"Beauty and the Beast (2017)\", \"Thor: Ragnarok\", \n", " \"Guardians of the Galaxy Vol. 2\", \"Spider-Man: Homecoming\", \"Justice League\", \"It (2017)\", \n", " \"Logan\", \"Coco\", \"Get Out\", \"Dunkirk\", \"The Shape of Water\", \"Blade Runner 2049\", \"Lady Bird\", \n", " \"Three Billboards Outside Ebbing, Missouri\", \"Call Me by Your Name\", \"Baby Driver\", \"The Disaster Artist\", \n", " \"The Post\", \"Darkest Hour\", \"I, Tonya\", \"Phantom Thread\", \"Paddington 2\", \"The Greatest Showman\", \n", " \"Jumanji: Welcome to the Jungle\", \"The Lego Batman Movie\", \"War for the Planet of the Apes\", \n", " \"The Boss Baby\", \"Ferdinand\", \"Split\", \"John Wick: Chapter 2\", \"Atomic Blonde\",\n", "]\n", "\n", "celebrity = [\n", " \"Leonardo DiCaprio\", \"Tom Cruise\", \"Dwayne Johnson\", \"Zendaya\", \n", " \"Timothée Chalamet\", \"Florence Pugh\", \"Margot Robbie\", \"Chris Hemsworth\", \n", " \"Robert Downey Jr.\", \"Scarlett Johansson\", \"Tom Holland\", \"Ryan Reynolds\", \n", " \"Gal Gadot\", \"Pedro Pascal\", \"Elizabeth Olsen\", \"Jenna Ortega\", \n", " \"Millie Bobby Brown\", \"Finn Wolfhard\", \"Anya Taylor-Joy\", \"Jason Momoa\", \n", " \"Chris Evans\", \"Natalie Portman\", \"Henry Cavill\", \"Daniel Radcliffe\", \n", " \"Emma Watson\", \"Rupert Grint\", \"Michael B. Jordan\", \"Anne Hathaway\", \n", " \"Brad Pitt\", \"Angelina Jolie\", \"Keanu Reeves\", \"Sandra Bullock\", \n", " \"Jake Gyllenhaal\", \"Christian Bale\", \"Cate Blanchett\", \"Hugh Jackman\", \n", " \"Jennifer Lawrence\", \"Will Smith\", \"Jada Pinkett Smith\", \"Viola Davis\", \n", " \"Austin Butler\", \"Jamie Lee Curtis\", \"Paul Mescal\", \"Tobey Maguire\", \n", " \"Andrew Garfield\", \"Harrison Ford\", \"Helen Mirren\", \"Brendan Fraser\", \n", "\n", " # Classic Hollywood Legends\n", " \"Marlon Brando\", \"James Dean\", \"Audrey Hepburn\", \"Marilyn Monroe\", \n", " \"Humphrey Bogart\", \"Clark Gable\", \"Bette Davis\", \"Elizabeth Taylor\",\n", " \"Fred Astaire\", \"Ginger Rogers\", \"Ingrid Bergman\", \"Greta Garbo\", \n", " \"Katharine Hepburn\", \"Cary Grant\", \"Spencer Tracy\", \"Rita Hayworth\",\n", " \"Grace Kelly\", \"Vivien Leigh\", \"Judy Garland\", \"Henry Fonda\",\n", " \"Lauren Bacall\", \"Paul Newman\", \"Charlton Heston\", \"Joan Crawford\",\n", "\n", " # Modern Hollywood Icons\n", " \"Meryl Streep\", \"Tom Hanks\", \"Denzel Washington\", \"Robert De Niro\", \n", " \"Al Pacino\", \"Jack Nicholson\", \"Julia Roberts\", \"Leonardo DiCaprio\",\n", " \"Brad Pitt\", \"Angelina Jolie\", \"George Clooney\", \"Cate Blanchett\",\n", " \"Johnny Depp\", \"Tom Cruise\", \"Sandra Bullock\", \"Nicole Kidman\", \n", " \"Halle Berry\", \"Harrison Ford\", \"Sigourney Weaver\", \"Morgan Freeman\", \n", " \"Michelle Pfeiffer\", \"Dustin Hoffman\", \"Robin Williams\", \"Will Smith\",\n", "\n", " # Franchise and Action-Adventure Stars\n", " \"Orlando Bloom\", \"Viggo Mortensen\", \"Ian McKellen\", \"Elijah Wood\",\n", " \"Sean Astin\", \"Dominic Monaghan\", \"Billy Boyd\", \"Liv Tyler\", \n", " \"Hugo Weaving\", \"Andy Serkis\", \"Keira Knightley\", \"Geoffrey Rush\",\n", " \"Johnny Depp\", \"Daniel Radcliffe\", \"Emma Watson\", \"Rupert Grint\",\n", " \"Helena Bonham Carter\", \"Ralph Fiennes\", \"Alan Rickman\", \"Michael Gambon\",\n", " \"Ewan McGregor\", \"Liam Neeson\", \"Natalie Portman\", \"Hayden Christensen\",\n", " \"Mark Hamill\", \"Carrie Fisher\", \"Harrison Ford\", \"Daisy Ridley\",\n", " \"Adam Driver\", \"John Boyega\", \"Oscar Isaac\", \"Diego Luna\", \n", " \"Felicity Jones\", \"Pedro Pascal\", \"Chris Hemsworth\", \"Chris Evans\", \n", " \"Scarlett Johansson\", \"Robert Downey Jr.\", \"Mark Ruffalo\", \"Chris Pratt\",\n", " \"Tom Holland\", \"Zendaya\", \"Benedict Cumberbatch\", \"Tobey Maguire\", \n", " \"Andrew Garfield\", \"Hugh Jackman\", \"Patrick Stewart\", \"Ian McKellen\", \n", " \"Ryan Reynolds\", \"Gal Gadot\", \"Henry Cavill\", \"Jason Momoa\", \n", " \"Ben Affleck\", \"Zoe Saldaña\", \"Dave Bautista\", \"Karen Gillan\",\n", "\n", " # Versatile and Popular Contemporary Actors\n", " \"Christian Bale\", \"Amy Adams\", \"Ryan Gosling\", \"Emma Stone\",\n", " \"Anne Hathaway\", \"Jennifer Lawrence\", \"Joaquin Phoenix\", \"Margot Robbie\",\n", " \"Adam Driver\", \"Michael B. Jordan\", \"Florence Pugh\", \"Timothée Chalamet\",\n", " \"Austin Butler\", \"Jessica Chastain\", \"Mahershala Ali\", \"Viola Davis\", \n", " \"Octavia Spencer\", \"Toni Collette\", \"Rami Malek\", \"Lakeith Stanfield\",\n", " \"Cillian Murphy\", \"Matt Damon\", \"Ben Affleck\", \"Jeremy Renner\", \n", "\n", " # Young Rising Stars\n", " \"Millie Bobby Brown\", \"Finn Wolfhard\", \"Sadie Sink\", \"Noah Schnapp\", \n", " \"Anya Taylor-Joy\", \"Jenna Ortega\", \"Hunter Schafer\", \"Hailee Steinfeld\", \n", " \"Lucas Hedges\", \"Elle Fanning\", \"Dakota Fanning\", \"Jacob Elordi\", \n", " \"Sydney Sweeney\", \"Joey King\", \"Sophie Turner\", \"Maisie Williams\",\n", "\n", " # Comedy and Character Actors\n", " \"Steve Carell\", \"Tina Fey\", \"Amy Poehler\", \"Melissa McCarthy\", \n", " \"Kristen Wiig\", \"Seth Rogen\", \"Will Ferrell\", \"Paul Rudd\", \n", " \"Bill Hader\", \"Jason Bateman\", \"Jonah Hill\", \"Michael Cera\",\n", " \"Ken Jeong\", \"Kevin Hart\", \"Maya Rudolph\", \"Chris Rock\", \n", "\n", " # Iconic Action and Adventure Stars\n", " \"Dwayne Johnson\", \"Arnold Schwarzenegger\", \"Sylvester Stallone\", \n", " \"Bruce Willis\", \"Jason Statham\", \"Keanu Reeves\", \"Vin Diesel\", \n", " \"Charlize Theron\", \"Emily Blunt\", \"John Cena\", \"Liam Neeson\", \n", " \"Daniel Craig\", \"Idris Elba\", \"Pierce Brosnan\", \"Angelina Jolie\", \n", " \"Kate Beckinsale\", \"Milla Jovovich\",\n", "\n", " # Supporting Actors and Other Notables\n", " \"John Goodman\", \"Jeff Goldblum\", \"J.K. Simmons\", \"Stanley Tucci\",\n", " \"Frances McDormand\", \"Allison Janney\", \"Angela Bassett\", \"Regina King\",\n", " \"Jessica Lange\", \"Bryan Cranston\", \"Aaron Paul\", \"Bob Odenkirk\", \n", " \"Giancarlo Esposito\", \"David Harbour\", \"Winona Ryder\", \n", "\n", " # Diverse and Internationally Acclaimed Actors\n", " \"Salma Hayek\", \"Antonio Banderas\", \"Diego Luna\", \"Oscar Isaac\", \n", " \"Gael García Bernal\", \"Eva Longoria\", \"Jessica Alba\", \n", " \"Awkwafina\", \"Sandra Oh\", \"Steven Yeun\", \"Simu Liu\", \n", " \"Lucy Liu\", \"Gemma Chan\", \"Mindy Kaling\", \"Ali Wong\", \n", " \"Lupita Nyong'o\", \"Chadwick Boseman\", \"Daniel Kaluuya\", \"Letitia Wright\",\n", " \"Dev Patel\", \"Riz Ahmed\", \"Zazie Beetz\", \"Mahershala Ali\",\n", "\n", " # Sports\n", " \"Lionel Messi\", \"Cristiano Ronaldo\", \"Neymar Jr.\", \"Kylian Mbappé\", \n", " \"LeBron James\", \"Serena Williams\", \"Roger Federer\", \"Novak Djokovic\", \n", " \"Rafael Nadal\", \"Simone Biles\", \"Naomi Osaka\", \"Stephen Curry\", \n", " \"Kevin Durant\", \"Tom Brady\", \"Patrick Mahomes\", \"Virat Kohli\", \n", " \"Rohit Sharma\", \"Shaquille O'Neal\", \"Tiger Woods\", \"Lewis Hamilton\", \n", " \"Max Verstappen\", \"Charles Leclerc\", \"Usain Bolt\", \"Megan Rapinoe\", \n", " \"Alex Morgan\", \"Katie Ledecky\", \"Michael Phelps\", \"Giannis Antetokounmpo\", \n", " \"Damian Lillard\", \"Anthony Davis\", \"Zlatan Ibrahimović\", \"Harry Kane\", \n", " \"Sadio Mané\", \"Karim Benzema\", \"Gareth Bale\", \"Robert Lewandowski\", \n", " \"Erling Haaland\", \"Venus Williams\", \"Iga Świątek\", \"Aryna Sabalenka\", \n", "\n", " # Politics and Leaders\n", " \"Joe Biden\", \"Kamala Harris\", \"Barack Obama\", \"Michelle Obama\", \n", " \"Donald Trump\", \"Melania Trump\", \"Emmanuel Macron\", \"Olaf Scholz\", \n", " \"Volodymyr Zelenskyy\", \"Rishi Sunak\", \"Narendra Modi\", \"Jacinda Ardern\", \n", " \"Justin Trudeau\", \"Xi Jinping\", \"Vladimir Putin\", \"Angela Merkel\", \n", " \"Elizabeth II\", \"King Charles III\", \"Prince William\", \"Prince Harry\", \n", " \"Meghan Markle\", \"Queen Letizia\", \"Pope Francis\", \"Dalai Lama\", \n", " \"Greta Thunberg\", \"Alexandria Ocasio-Cortez\", \"Bernie Sanders\", \n", " \"Nicolas Maduro\", \"Jair Bolsonaro\", \"Fumio Kishida\", \"Yoon Suk-yeol\",\n", "\n", " # Business and Technology\n", " \"Elon Musk\", \"Jeff Bezos\", \"Mark Zuckerberg\", \"Bill Gates\", \"Tim Cook\", \n", " \"Sundar Pichai\", \"Satya Nadella\", \"Warren Buffett\", \"Bernard Arnault\", \n", " \"Larry Page\", \"Sergey Brin\", \"Steve Wozniak\", \"Reed Hastings\", \"Susan Wojcicki\", \n", " \"Jack Ma\", \"Daniel Ek\", \"Evan Spiegel\", \"Andrew Ng\", \"Sam Altman\", \n", " \"Sheryl Sandberg\", \"Peter Thiel\", \"Marc Benioff\", \"Richard Branson\", \n", " \"Oprah Winfrey\", \"Howard Schultz\", \"Larry Ellison\", \"David Baszucki\", \n", " \"Parag Agrawal\", \"Adam Neumann\", \"Kylie Jenner\", \"Kim Kardashian\", \n", " \"Khloé Kardashian\", \"Kris Jenner\", \"Robert Kiyosaki\", \"Barbara Corcoran\", \n", "\n", " # Science and Innovation\n", " \"Jane Goodall\", \"Neil deGrasse Tyson\", \"Brian Cox\", \"Michio Kaku\", \n", " \"Katherine Johnson\", \"Jennifer Doudna\", \"Emmanuelle Charpentier\", \"Tim Berners-Lee\", \n", " \"Mae Jemison\", \"Katie Bouman\", \"Brian Greene\", \"James Lovelock\", \n", " \"Roger Penrose\", \"Dmitry Muratov\", \"Frances Arnold\", \"Venki Ramakrishnan\", \n", " \"Paul Nurse\", \"Elizabeth Blackburn\", \"Carol Greider\", \"David Julius\", \n", " \"Abhijit Banerjee\", \"Esther Duflo\", \"Michael Kremer\", \"Andrea Ghez\", \n", " \"Reinhard Genzel\", \"Jennifer Hudson\", \"Ashoke Sen\", \"Subrahmanyan Chandrasekhar\", \n", "\n", " # Others\n", " \"Ellen DeGeneres\", \"Oprah Winfrey\", \"Trevor Noah\", \"Jimmy Fallon\", \n", " \"Stephen Colbert\", \"John Oliver\", \"James Corden\", \"Conan O'Brien\", \n", " \"Dolly Parton\", \"Gordon Ramsay\", \"David Beckham\", \"Victoria Beckham\", \n", " \"RuPaul\", \"Chris Rock\", \"Dave Chappelle\", \"Trevor Noah\", \"Hasan Minhaj\", \n", " \"Ali Wong\", \"Bo Burnham\", \"Jo Koy\", \"Kevin Hart\", \"Sarah Silverman\", \n", " \"Tiffany Haddish\", \"Joe Rogan\", \"Logan Paul\", \"MrBeast\", \"PewDiePie\", \n", " \"Emma Chamberlain\", \"Charli D'Amelio\", \"Addison Rae\", \"Bella Poarch\",\n", "]\n", "\n", "show = [\n", " 'Breaking Bad', 'Stranger Things', 'Game of Thrones', 'Friends', 'The Office',\n", " 'The Mandalorian', 'The Crown', 'WandaVision', 'Loki', 'The Boys',\n", " 'Better Call Saul', 'The Witcher', 'House of the Dragon', 'Severance', 'The Last of Us',\n", " 'The White Lotus', 'Succession', 'Ted Lasso', 'Squid Game', 'The Marvelous Mrs. Maisel',\n", " 'Euphoria', 'Ozark', 'The Handmaid’s Tale', 'Westworld', 'Only Murders in the Building',\n", " 'The Umbrella Academy', 'Black Mirror', 'Peaky Blinders', 'Sherlock', 'Brooklyn Nine-Nine',\n", " 'Parks and Recreation', 'Fargo', 'Mindhunter', 'Dark', 'Arcane',\n", " 'The Sandman', 'Yellowstone', 'The Walking Dead', 'American Horror Story', 'The Sopranos',\n", " 'Mad Men', 'Arrested Development', 'Rick and Morty', 'BoJack Horseman', 'Fleabag',\n", "]" ] }, { "cell_type": "code", "execution_count": null, "id": "525f6c90-eb31-4786-9922-a775987e74b5", "metadata": {}, "outputs": [], "source": [ "print(f\"len(movie) = {len(movie)}\")\n", "print(f\"len(celebrity) = {len(celebrity)}\")\n", "print(f\"len(show) = {len(show)}\")" ] }, { "cell_type": "code", "execution_count": null, "id": "b758e419-2e4f-4501-8c61-bfef4627a064", "metadata": {}, "outputs": [], "source": [ "information_intent_templates = [\n", " \"{movie}\",\n", " \"{movie} cast\",\n", " \"{movie} budget\",\n", " \"{movie} director\",\n", " \"{movie} collection\",\n", " \"{celebrity}\",\n", " \"{celebrity} age\",\n", " \"is {celebrity} married\",\n", " \"{celebrity} net worth\",\n", " \"{show}\",\n", " \"{show} cast\",\n", " \"is {show} available on Netflix/Disney+/Amazon Prime?\",\n", " \"what is {show} about?\",\n", " \"how many seasons of {show}?\",\n", " \"who are the main characters in {show}?\"\n", " \"{show} reviews\",\n", "]\n", "\n", "\n", "MOVIE_CATEGORY = \"{movie}\"\n", "CELEBRITY_CATEGORY = \"{celebrity}\"\n", "SHOW_CATEGORY = \"{show}\"\n", "\n", "INFORMATION_CATEGORIES = {\n", " MOVIE_CATEGORY: movie,\n", " CELEBRITY_CATEGORY: celebrity,\n", " SHOW_CATEGORY: show,\n", "}\n" ] }, { "cell_type": "code", "execution_count": null, "id": "153b9be0-d07f-477d-812e-f7f8f8cb119c", "metadata": {}, "outputs": [], "source": [ "information_intent_additional_queries = generate_service_queries(INFORMATION_CATEGORIES, information_intent_templates, n_queries=1200)\n", "print(len(information_intent_additional_queries))" ] }, { "cell_type": "code", "execution_count": null, "id": "8ae44a4f-2099-4387-a87b-cc834301fe43", "metadata": {}, "outputs": [], "source": [ "information_intent_additional_queries_df = pd.DataFrame(information_intent_additional_queries, columns=['sequence'])\n", "information_intent_additional_queries_df['target'] = 'information_intent'\n", "information_intent_additional_queries_df" ] }, { "cell_type": "code", "execution_count": null, "id": "99e63bbe-fd81-4810-83b9-2ab30d345fef", "metadata": {}, "outputs": [], "source": [] }, { "cell_type": "code", "execution_count": null, "id": "fa993a76-b1a2-4c64-8f1f-49db477c1666", "metadata": {}, "outputs": [], "source": [ "# len(partial_queries_with_intents)\n", "\n", "# yelp_keywords_data = pd.read_json(\"https://firefox-settings-attachments.cdn.mozilla.net/main-workspace/quicksuggest/33987d71-9e87-4b7e-86d3-6f292b89e8bf.json\")['subjects'].values[0]" ] }, { "cell_type": "code", "execution_count": null, "id": "5ccf232d-6ffe-45b3-a964-9eeef9fcaea3", "metadata": {}, "outputs": [], "source": [ "print(len(yelp_keywords_data))\n", "yelp_keywords_data[:10]" ] }, { "cell_type": "code", "execution_count": null, "id": "79f2b2d6-bfbf-4bb5-bcbd-ff96e28673d2", "metadata": {}, "outputs": [], "source": [ "import random\n", "\n", "# Expanded base examples for each intent\n", "information_examples_partial = [\n", " \"capital of\", \"history of\", \"current news\", \"population of\", \"how to make\",\n", " \"meaning of\", \"invention of\", \"who discovered\", \"history of\", \"what is\",\n", " \"symptoms of\", \"definition of\", \"why is\", \"facts about\", \"signs of\", \n", " \"how does\", \"global warming\", \"causes of\", \"influence of\", \"effects of\",\n", " \"famous quotes\", \"important events\", \"founder of\", \"principles of\", \n", " \"basics of\", \"impact of\", \"recent studies\", \"causes of\", \"research about\",\n", " \"inventions by\", \"works of\", \"origin of\", \"foundation of\",\n", " \"world war\", \"founding fathers\", \"civil rights\", \"ancient civilizations\", \n", " \"DNA structure\", \"gravity\", \"nobel prize\", \"space exploration\",\n", " \"vaccination history\", \"internet development\", \"economic recession\", \n", " \"major religions\", \"greenhouse gases\", \"solar system\", \"industrial revolution\", \n", " \"history of technology\", \"evolution of species\", \"brain functions\", \"famous personalities\",\n", " \"meaning of\", \"definition\", \"age of\", \"side effects\", \"how to \", \"explain me\",\n", " \"largest country\", \"oldest language\", \"famous battles\", \"biggest animal\", \n", " \"smallest planet\", \"tallest mountain\", \"fastest car\", \"deepest ocean\", \n", " \"heaviest element\", \"largest desert\", \"how electricity works\", \n", " \"origin of music\", \"who is the richest\", \"what is AI\", \"how planes fly\", \n", " \"why we dream\", \"why the sky is blue\", \"meaning of life\", \"origin of pizza\", \n", " \"discovery of fire\", \"who invented the wheel\", \"benefits of exercise\", \n", " \"causes of obesity\", \"why we sleep\", \"origin of the internet\", \n", " \"who built the pyramids\", \"what is democracy\", \"founder of apple\", \n", " \"who created bitcoin\", \"why people yawn\", \"first computer\", \n", " \"how rain forms\", \"who invented cars\", \"why water is wet\", \n", " \"how plants grow\", \"why the moon shines\", \"origin of coffee\", \n", " \"who is the president\", \"what is inflation\", \"how atoms work\", \n", " \"what is a black hole\", \"first man on moon\", \"fastest animal\", \n", " \"oldest tree\", \"why oceans are salty\", \"who built the Taj Mahal\", \n", " \"origin of Christmas\", \"causes of earthquakes\", \"who discovered penicillin\", \n", " \"what is time\", \"meaning of happiness\", \"history of jazz\", \"largest volcano\", \n", " \"who founded America\", \"how tides work\", \"what is evolution\", \n", " \"causes of climate change\", \"who created Google\", \"why stars twinkle\", \n", " \"origin of yoga\", \"what is philosophy\", \"largest mammal\", \n", " \"how computers work\", \"meaning of justice\", \"history of cinema\", \n", " \"famous painters\", \"when did dinosaurs exist\", \"how magnets work\", \n", " \"famous philosophers\", \"largest river\", \"origin of beer\", \n", " \"who is Cleopatra\", \"why do we laugh\", \"how do vaccines work\", \n", " \"founder of Amazon\", \"what is meditation\", \"first smartphone\", \n", " \"history of money\", \"first human\", \"what is photosynthesis\", \n", " \"biggest galaxy\", \"origin of tea\", \"first civilization\", \n", " \"causes of addiction\", \"largest waterfall\", \"oldest book\", \n", " \"who is Shakespeare\", \"how phones work\", \"founder of Tesla\", \n", " \"largest continent\", \"origin of chocolate\", \"what is gravity\", \n", " \"meaning of friendship\", \"how cells work\", \"what is quantum physics\", \n", " \"why people lie\", \"who is Buddha\", \"origin of math\", \n", " \"what is linguistics\", \"famous explorers\",\n", " \"who is Albert Einstein\", \"life of Mahatma Gandhi\", \"legacy of Martin Luther King\", \n", " \"biography of Leonardo da Vinci\", \"about Cleopatra\", \"teachings of Confucius\", \n", " \"philosophy of Socrates\", \"contributions of Marie Curie\", \"ideas of Karl Marx\", \n", " \"what did Nikola Tesla invent\", \"about Winston Churchill\", \"works of Vincent van Gogh\", \n", " \"principles of Sigmund Freud\", \"achievements of Isaac Newton\", \"writings of J.K. Rowling\", \n", " \"who is Oprah Winfrey\", \"about Steve Jobs\", \"success of Jeff Bezos\", \n", " \"what is relativity\", \"theory of evolution\", \"who is Elon Musk\", \n", " \"biography of Pablo Picasso\", \"life of Bruce Lee\", \"teachings of Buddha\", \n", " \"works of Ernest Hemingway\", \"about Charles Darwin\", \"philosophy of Friedrich Nietzsche\", \n", " \"impact of Beethoven\", \"life of Shakespeare\", \"contributions of Thomas Edison\", \n", " \"discoveries of Galileo\", \"teachings of Jesus\", \"who is Beyoncé\", \n", " \"about Muhammad Ali\", \"contributions of Ada Lovelace\", \"achievements of Michael Jackson\", \n", " \"works of Mark Twain\", \"discoveries of Alexander Fleming\", \"who is Rihanna\", \n", " \"about Walt Disney\", \"inventions of Alexander Graham Bell\", \"what is the Big Bang theory\", \n", " \"legacy of Mother Teresa\", \"ideas of Aristotle\", \"works of Jane Austen\", \n", " \"achievements of Usain Bolt\", \"who is Michael Jordan\", \"philosophy of John Locke\", \n", " \"life of Malcolm X\", \"discoveries of Louis Pasteur\", \"about Frida Kahlo\", \n", " \"impact of Mozart\", \"biography of Bob Marley\", \"contributions of Carl Jung\", \n", " \"who is Stephen Hawking\", \"legacy of Rosa Parks\", \"who is Billie Eilish\", \n", " \"writings of Franz Kafka\", \"philosophy of Jean-Jacques Rousseau\", \"about Coco Chanel\", \n", " \"works of Michelangelo\", \"who is Vladimir Putin\", \"discoveries of Dmitri Mendeleev\", \n", " \"about Salvador Dalí\", \"theory of Alfred Wegener\", \"contributions of Alan Turing\", \n", " \"what is existentialism\", \"about Greta Thunberg\", \"philosophy of Immanuel Kant\", \n", " \"who is Mahatma Buddha\", \"ideas of Max Weber\", \"discoveries of Gregor Mendel\", \n", " \"who is Prince\", \"impact of The Beatles\", \"biography of Neil Armstrong\", \n", " \"about Amelia Earhart\", \"contributions of Enrico Fermi\", \"discoveries of Henry Ford\", \n", " \"who is Malala Yousafzai\", \"philosophy of Plato\", \"works of Andy Warhol\", \n", " \"life of Florence Nightingale\", \"impact of Jimi Hendrix\", \"who is Serena Williams\", \n", " \"about Desmond Tutu\", \"legacy of Malcolm Gladwell\", \"contributions of James Watson\", \n", " \"achievements of Charles Dickens\", \"ideas of Noam Chomsky\", \"biography of Stephen King\", \n", " \"teachings of Mahavira\", \"about Maya Angelou\", \"who is Alfred Nobel\", \n", " \"philosophy of Bertrand Russell\", \"discoveries of Hans Christian Andersen\", \n", " \"legacy of Marie Antoinette\", \"life of Helen Keller\", \"who is Ludwig van Beethoven\", \n", " \"about Genghis Khan\", \"teachings of Laozi\",\n", " \"latest news\", \"who won the game\", \"movie releases\", \"upcoming TV shows\", \n", " \"best new movies\", \"celebrity gossip\", \"who is dating\", \"sports highlights\", \n", " \"current stock prices\", \"what is inflation\", \"latest trends\", \"who is the president\", \n", " \"climate change updates\", \"new technology trends\", \"upcoming elections\", \n", " \"Olympic results\", \"famous actors\", \"blockbuster movies\", \"NBA scores\", \n", " \"trending music\", \"celebrity net worth\", \"economic growth\", \"who won the Grammy\", \n", " \"what is cryptocurrency\", \"latest from Hollywood\", \"box office hits\", \n", " \"who won the World Cup\", \"new Marvel movie\", \"political scandals\", \n", " \"Oscars winners\", \"top Netflix shows\", \"popular TV series\", \"current affairs\", \n", " \"who won the award\", \"crypto news\", \"popular streaming shows\", \"best books of the year\", \n", " \"housing market trends\", \"what is GDP\", \"who won the election\", \"new iPhone release\", \n", " \"what is recession\", \"latest in fashion\", \"upcoming concerts\", \"celebrity marriages\", \n", " \"sports schedules\", \"movie box office\", \"biggest TV show\", \"current unemployment rate\", \n", " \"what is TikTok\", \"latest science news\", \"trending diets\", \"popular YouTubers\", \n", " \"what is Metaverse\", \"who is the governor\", \"latest in medicine\", \"NFL scores\", \n", " \"latest political news\", \"updates on the economy\", \"best restaurants near me\", \n", " \"new space discoveries\", \"streaming top charts\", \"celebrity breakups\", \"football scores\", \n", " \"Oscars nominations\", \"recent Nobel winners\", \"what is AI\", \"who won the Superbowl\", \n", " \"what is quantum computing\", \"latest health news\", \"viral social media trends\", \n", " \"global warming news\", \"best-selling albums\", \"political debates\", \n", " \"new vaccine updates\", \"stock market predictions\", \"who won the Emmys\", \n", " \"top-rated series\", \"economic policies\", \"fashion week highlights\", \n", " \"best reality shows\", \"latest space missions\", \"cryptocurrency trends\", \n", " \"sports team rankings\", \"who won the Golden Globes\", \"who is the prime minister\", \n", " \"what is net neutrality\", \"climate change effects\", \"famous sports players\", \n", " \"who won Wimbledon\", \"top YouTube videos\", \"election results\", \"biggest IPOs\", \n", " \"celebrity endorsements\", \"new movie trailers\", \"global economic trends\", \n", " \"biggest tech companies\", \"influential leaders\", \"what is NATO\", \n", " \"top tourist destinations\", \"world leaders summit\", \"upcoming sporting events\",\n", " \"Taylor Swift songs\", \"Leonardo DiCaprio movies\", \"Beyoncé albums\", \n", " \"Friends TV show\", \"Breaking Bad episodes\", \"Game of Thrones cast\", \n", " \"Marvel Cinematic Universe\", \"Star Wars movies\", \"Inception plot\", \n", " \"lyrics to Bohemian Rhapsody\", \"Stranger Things characters\", \"The Beatles discography\", \n", " \"Ariana Grande latest album\", \"Elvis Presley hits\", \"Black Mirror episodes\", \n", " \"Westworld show\", \"Lady Gaga songs\", \"Drake top hits\", \"Harry Potter movies\", \n", " \"The Godfather actors\", \"Taylor Swift tour\", \"Stranger Things season 4\", \n", " \"Dwayne Johnson movies\", \"Selena Gomez songs\", \"Friends reunion\", \n", " \"Taylor Swift Eras Tour\", \"Top Gun Maverick\", \"The Office episodes\", \n", " \"Rihanna Fenty Beauty\", \"Adele 30 album\", \"Star Trek series\", \n", " \"Billie Eilish new album\", \"Fast and Furious cast\", \"James Bond movies\", \n", " \"SpongeBob SquarePants characters\", \"House of the Dragon plot\", \"Super Bowl halftime show\", \n", " \"Coldplay discography\", \"Jennifer Aniston roles\", \"Avatar movie\", \n", " \"The Avengers actors\", \"Michael Jackson hits\", \"Narcos series\", \n", " \"Justin Bieber songs\", \"Taylor Swift lyrics\", \"The Mandalorian show\", \n", " \"Ed Sheeran albums\", \"Kanye West controversies\", \"The Crown Netflix\", \n", " \"BTS Butter lyrics\", \"Game of Thrones finale\", \"Spider-Man No Way Home\", \n", " \"Joker movie plot\", \"Kim Kardashian fashion\", \"Avengers Endgame cast\", \n", " \"Bridgerton Netflix\", \"Post Malone songs\", \"Friends theme song\", \n", " \"Star Wars characters\", \"Euphoria cast\", \"Frozen movie\", \"Ariana Grande discography\", \n", " \"Megan Thee Stallion hits\", \"Kendrick Lamar albums\", \"Lizzo music\", \n", " \"The Lion King soundtrack\", \"Selena Gomez movies\", \"Will Smith Oscars\", \n", " \"Wonder Woman cast\", \"Dua Lipa songs\", \"The Simpsons episodes\", \n", " \"Stranger Things season 5\", \"Queen band members\", \"Michael Jordan career\", \n", " \"Madonna songs\", \"The Twilight Saga movies\", \"Shawn Mendes latest album\", \n", " \"The Weeknd discography\", \"Friends Thanksgiving episodes\", \"Billie Eilish Grammy wins\", \n", " \"The Sopranos cast\", \"Matrix movies\", \"Taylor Swift Red album\", \n", " \"Drake collaborations\", \"The Witcher Netflix\", \"Peaky Blinders characters\", \n", " \"Bohemian Rhapsody movie\", \"Adele Hello lyrics\", \"Rocky Balboa movies\", \n", " \"The Walking Dead cast\", \"Nirvana band members\", \"A Star is Born soundtrack\", \n", " \"Tom Hanks movies\", \"Fleetwood Mac hits\", \"Meryl Streep roles\", \n", " \"Dune movie cast\", \"Friends Ross and Rachel\", \"Miley Cyrus top songs\", \n", " \"Ariana Grande and The Weeknd\", \"Shrek movies\", \"Backstreet Boys songs\", \n", " \"The Great Gatsby movie\", \"The Beatles Yellow Submarine\",\n", " # Entertainment and Music\n", " \"Taylor Swift\", \"Billie Eilish\", \"Drake\", \"Ariana Grande\", \"Rihanna\", \n", " \"Beyoncé\", \"Ed Sheeran\", \"Harry Styles\", \"Shakira\", \"Kanye West\", \n", " \"Lady Gaga\", \"Post Malone\", \"The Weeknd\", \"Justin Bieber\", \"Selena Gomez\", \n", " \"Dua Lipa\", \"Bruno Mars\", \"Katy Perry\", \"Shawn Mendes\", \"Camila Cabello\", \n", " \"Bad Bunny\", \"J Balvin\", \"Olivia Rodrigo\", \"Lil Nas X\", \"Doja Cat\", \n", " \"Cardi B\", \"Lizzo\", \"Sam Smith\", \"SZA\", \"Chris Brown\", \n", " \"BLACKPINK\", \"BTS\", \"Jungkook\", \"Lisa Manoban\", \"Rosé\", \n", " \"Megan Thee Stallion\", \"Karol G\", \"Anitta\", \"Jack Harlow\", \"Nicki Minaj\", \n", " \"Kendrick Lamar\", \"Imagine Dragons\", \"Coldplay\", \"John Legend\", \"Adele\", \n", " \"Miley Cyrus\", \"Zayn Malik\", \"Charlie Puth\", \"Halsey\", \"Marshmello\", \n", " \"Jared Leto\", \"Adam Levine\", \"Snoop Dogg\", \"Pharrell Williams\", \"Travis Scott\",\n", "\n", " # Film and TV\n", " \"Leonardo DiCaprio\", \"Tom Cruise\", \"Dwayne Johnson\", \"Zendaya\", \n", " \"Timothée Chalamet\", \"Florence Pugh\", \"Margot Robbie\", \"Chris Hemsworth\", \n", " \"Robert Downey Jr.\", \"Scarlett Johansson\", \"Tom Holland\", \"Ryan Reynolds\", \n", " \"Gal Gadot\", \"Pedro Pascal\", \"Elizabeth Olsen\", \"Jenna Ortega\", \n", " \"Millie Bobby Brown\", \"Finn Wolfhard\", \"Anya Taylor-Joy\", \"Jason Momoa\", \n", " \"Chris Evans\", \"Natalie Portman\", \"Henry Cavill\", \"Daniel Radcliffe\", \n", " \"Emma Watson\", \"Rupert Grint\", \"Michael B. Jordan\", \"Anne Hathaway\", \n", " \"Brad Pitt\", \"Angelina Jolie\", \"Keanu Reeves\", \"Sandra Bullock\", \n", " \"Jake Gyllenhaal\", \"Christian Bale\", \"Cate Blanchett\", \"Hugh Jackman\", \n", " \"Jennifer Lawrence\", \"Will Smith\", \"Jada Pinkett Smith\", \"Viola Davis\", \n", " \"Austin Butler\", \"Jamie Lee Curtis\", \"Paul Mescal\", \"Tobey Maguire\", \n", " \"Andrew Garfield\", \"Harrison Ford\", \"Helen Mirren\", \"Brendan Fraser\", \n", "\n", " # Classic Hollywood Legends\n", " \"Marlon Brando\", \"James Dean\", \"Audrey Hepburn\", \"Marilyn Monroe\", \n", " \"Humphrey Bogart\", \"Clark Gable\", \"Bette Davis\", \"Elizabeth Taylor\",\n", " \"Fred Astaire\", \"Ginger Rogers\", \"Ingrid Bergman\", \"Greta Garbo\", \n", " \"Katharine Hepburn\", \"Cary Grant\", \"Spencer Tracy\", \"Rita Hayworth\",\n", " \"Grace Kelly\", \"Vivien Leigh\", \"Judy Garland\", \"Henry Fonda\",\n", " \"Lauren Bacall\", \"Paul Newman\", \"Charlton Heston\", \"Joan Crawford\",\n", "\n", " # Modern Hollywood Icons\n", " \"Meryl Streep\", \"Tom Hanks\", \"Denzel Washington\", \"Robert De Niro\", \n", " \"Al Pacino\", \"Jack Nicholson\", \"Julia Roberts\", \"Leonardo DiCaprio\",\n", " \"Brad Pitt\", \"Angelina Jolie\", \"George Clooney\", \"Cate Blanchett\",\n", " \"Johnny Depp\", \"Tom Cruise\", \"Sandra Bullock\", \"Nicole Kidman\", \n", " \"Halle Berry\", \"Harrison Ford\", \"Sigourney Weaver\", \"Morgan Freeman\", \n", " \"Michelle Pfeiffer\", \"Dustin Hoffman\", \"Robin Williams\", \"Will Smith\",\n", "\n", " # Franchise and Action-Adventure Stars\n", " \"Orlando Bloom\", \"Viggo Mortensen\", \"Ian McKellen\", \"Elijah Wood\",\n", " \"Sean Astin\", \"Dominic Monaghan\", \"Billy Boyd\", \"Liv Tyler\", \n", " \"Hugo Weaving\", \"Andy Serkis\", \"Keira Knightley\", \"Geoffrey Rush\",\n", " \"Johnny Depp\", \"Daniel Radcliffe\", \"Emma Watson\", \"Rupert Grint\",\n", " \"Helena Bonham Carter\", \"Ralph Fiennes\", \"Alan Rickman\", \"Michael Gambon\",\n", " \"Ewan McGregor\", \"Liam Neeson\", \"Natalie Portman\", \"Hayden Christensen\",\n", " \"Mark Hamill\", \"Carrie Fisher\", \"Harrison Ford\", \"Daisy Ridley\",\n", " \"Adam Driver\", \"John Boyega\", \"Oscar Isaac\", \"Diego Luna\", \n", " \"Felicity Jones\", \"Pedro Pascal\", \"Chris Hemsworth\", \"Chris Evans\", \n", " \"Scarlett Johansson\", \"Robert Downey Jr.\", \"Mark Ruffalo\", \"Chris Pratt\",\n", " \"Tom Holland\", \"Zendaya\", \"Benedict Cumberbatch\", \"Tobey Maguire\", \n", " \"Andrew Garfield\", \"Hugh Jackman\", \"Patrick Stewart\", \"Ian McKellen\", \n", " \"Ryan Reynolds\", \"Gal Gadot\", \"Henry Cavill\", \"Jason Momoa\", \n", " \"Ben Affleck\", \"Zoe Saldaña\", \"Dave Bautista\", \"Karen Gillan\",\n", "\n", " # Versatile and Popular Contemporary Actors\n", " \"Christian Bale\", \"Amy Adams\", \"Ryan Gosling\", \"Emma Stone\",\n", " \"Anne Hathaway\", \"Jennifer Lawrence\", \"Joaquin Phoenix\", \"Margot Robbie\",\n", " \"Adam Driver\", \"Michael B. Jordan\", \"Florence Pugh\", \"Timothée Chalamet\",\n", " \"Austin Butler\", \"Jessica Chastain\", \"Mahershala Ali\", \"Viola Davis\", \n", " \"Octavia Spencer\", \"Toni Collette\", \"Rami Malek\", \"Lakeith Stanfield\",\n", " \"Cillian Murphy\", \"Matt Damon\", \"Ben Affleck\", \"Jeremy Renner\", \n", "\n", " # Young Rising Stars\n", " \"Millie Bobby Brown\", \"Finn Wolfhard\", \"Sadie Sink\", \"Noah Schnapp\", \n", " \"Anya Taylor-Joy\", \"Jenna Ortega\", \"Hunter Schafer\", \"Hailee Steinfeld\", \n", " \"Lucas Hedges\", \"Elle Fanning\", \"Dakota Fanning\", \"Jacob Elordi\", \n", " \"Sydney Sweeney\", \"Joey King\", \"Sophie Turner\", \"Maisie Williams\",\n", "\n", " # Comedy and Character Actors\n", " \"Steve Carell\", \"Tina Fey\", \"Amy Poehler\", \"Melissa McCarthy\", \n", " \"Kristen Wiig\", \"Seth Rogen\", \"Will Ferrell\", \"Paul Rudd\", \n", " \"Bill Hader\", \"Jason Bateman\", \"Jonah Hill\", \"Michael Cera\",\n", " \"Ken Jeong\", \"Kevin Hart\", \"Maya Rudolph\", \"Chris Rock\", \n", "\n", " # Iconic Action and Adventure Stars\n", " \"Dwayne Johnson\", \"Arnold Schwarzenegger\", \"Sylvester Stallone\", \n", " \"Bruce Willis\", \"Jason Statham\", \"Keanu Reeves\", \"Vin Diesel\", \n", " \"Charlize Theron\", \"Emily Blunt\", \"John Cena\", \"Liam Neeson\", \n", " \"Daniel Craig\", \"Idris Elba\", \"Pierce Brosnan\", \"Angelina Jolie\", \n", " \"Kate Beckinsale\", \"Milla Jovovich\",\n", "\n", " # Supporting Actors and Other Notables\n", " \"John Goodman\", \"Jeff Goldblum\", \"J.K. Simmons\", \"Stanley Tucci\",\n", " \"Frances McDormand\", \"Allison Janney\", \"Angela Bassett\", \"Regina King\",\n", " \"Jessica Lange\", \"Bryan Cranston\", \"Aaron Paul\", \"Bob Odenkirk\", \n", " \"Giancarlo Esposito\", \"David Harbour\", \"Winona Ryder\", \n", "\n", " # Diverse and Internationally Acclaimed Actors\n", " \"Salma Hayek\", \"Antonio Banderas\", \"Diego Luna\", \"Oscar Isaac\", \n", " \"Gael García Bernal\", \"Eva Longoria\", \"Jessica Alba\", \n", " \"Awkwafina\", \"Sandra Oh\", \"Steven Yeun\", \"Simu Liu\", \n", " \"Lucy Liu\", \"Gemma Chan\", \"Mindy Kaling\", \"Ali Wong\", \n", " \"Lupita Nyong'o\", \"Chadwick Boseman\", \"Daniel Kaluuya\", \"Letitia Wright\",\n", " \"Dev Patel\", \"Riz Ahmed\", \"Zazie Beetz\", \"Mahershala Ali\",\n", "\n", " # Sports\n", " \"Lionel Messi\", \"Cristiano Ronaldo\", \"Neymar Jr.\", \"Kylian Mbappé\", \n", " \"LeBron James\", \"Serena Williams\", \"Roger Federer\", \"Novak Djokovic\", \n", " \"Rafael Nadal\", \"Simone Biles\", \"Naomi Osaka\", \"Stephen Curry\", \n", " \"Kevin Durant\", \"Tom Brady\", \"Patrick Mahomes\", \"Virat Kohli\", \n", " \"Rohit Sharma\", \"Shaquille O'Neal\", \"Tiger Woods\", \"Lewis Hamilton\", \n", " \"Max Verstappen\", \"Charles Leclerc\", \"Usain Bolt\", \"Megan Rapinoe\", \n", " \"Alex Morgan\", \"Katie Ledecky\", \"Michael Phelps\", \"Giannis Antetokounmpo\", \n", " \"Damian Lillard\", \"Anthony Davis\", \"Zlatan Ibrahimović\", \"Harry Kane\", \n", " \"Sadio Mané\", \"Karim Benzema\", \"Gareth Bale\", \"Robert Lewandowski\", \n", " \"Erling Haaland\", \"Venus Williams\", \"Iga Świątek\", \"Aryna Sabalenka\", \n", "\n", " # Politics and Leaders\n", " \"Joe Biden\", \"Kamala Harris\", \"Barack Obama\", \"Michelle Obama\", \n", " \"Donald Trump\", \"Melania Trump\", \"Emmanuel Macron\", \"Olaf Scholz\", \n", " \"Volodymyr Zelenskyy\", \"Rishi Sunak\", \"Narendra Modi\", \"Jacinda Ardern\", \n", " \"Justin Trudeau\", \"Xi Jinping\", \"Vladimir Putin\", \"Angela Merkel\", \n", " \"Elizabeth II\", \"King Charles III\", \"Prince William\", \"Prince Harry\", \n", " \"Meghan Markle\", \"Queen Letizia\", \"Pope Francis\", \"Dalai Lama\", \n", " \"Greta Thunberg\", \"Alexandria Ocasio-Cortez\", \"Bernie Sanders\", \n", " \"Nicolas Maduro\", \"Jair Bolsonaro\", \"Fumio Kishida\", \"Yoon Suk-yeol\",\n", "\n", " # Business and Technology\n", " \"Elon Musk\", \"Jeff Bezos\", \"Mark Zuckerberg\", \"Bill Gates\", \"Tim Cook\", \n", " \"Sundar Pichai\", \"Satya Nadella\", \"Warren Buffett\", \"Bernard Arnault\", \n", " \"Larry Page\", \"Sergey Brin\", \"Steve Wozniak\", \"Reed Hastings\", \"Susan Wojcicki\", \n", " \"Jack Ma\", \"Daniel Ek\", \"Evan Spiegel\", \"Andrew Ng\", \"Sam Altman\", \n", " \"Sheryl Sandberg\", \"Peter Thiel\", \"Marc Benioff\", \"Richard Branson\", \n", " \"Oprah Winfrey\", \"Howard Schultz\", \"Larry Ellison\", \"David Baszucki\", \n", " \"Parag Agrawal\", \"Adam Neumann\", \"Kylie Jenner\", \"Kim Kardashian\", \n", " \"Khloé Kardashian\", \"Kris Jenner\", \"Robert Kiyosaki\", \"Barbara Corcoran\", \n", "\n", " # Science and Innovation\n", " \"Jane Goodall\", \"Neil deGrasse Tyson\", \"Brian Cox\", \"Michio Kaku\", \n", " \"Katherine Johnson\", \"Jennifer Doudna\", \"Emmanuelle Charpentier\", \"Tim Berners-Lee\", \n", " \"Mae Jemison\", \"Katie Bouman\", \"Brian Greene\", \"James Lovelock\", \n", " \"Roger Penrose\", \"Dmitry Muratov\", \"Frances Arnold\", \"Venki Ramakrishnan\", \n", " \"Paul Nurse\", \"Elizabeth Blackburn\", \"Carol Greider\", \"David Julius\", \n", " \"Abhijit Banerjee\", \"Esther Duflo\", \"Michael Kremer\", \"Andrea Ghez\", \n", " \"Reinhard Genzel\", \"Jennifer Hudson\", \"Ashoke Sen\", \"Subrahmanyan Chandrasekhar\", \n", "\n", " # Others\n", " \"Ellen DeGeneres\", \"Oprah Winfrey\", \"Trevor Noah\", \"Jimmy Fallon\", \n", " \"Stephen Colbert\", \"John Oliver\", \"James Corden\", \"Conan O'Brien\", \n", " \"Dolly Parton\", \"Gordon Ramsay\", \"David Beckham\", \"Victoria Beckham\", \n", " \"RuPaul\", \"Chris Rock\", \"Dave Chappelle\", \"Trevor Noah\", \"Hasan Minhaj\", \n", " \"Ali Wong\", \"Bo Burnham\", \"Jo Koy\", \"Kevin Hart\", \"Sarah Silverman\", \n", " \"Tiffany Haddish\", \"Joe Rogan\", \"Logan Paul\", \"MrBeast\", \"PewDiePie\", \n", " \"Emma Chamberlain\", \"Charli D'Amelio\", \"Addison Rae\", \"Bella Poarch\",\n", "\n", " # 2019 Movies\n", " \"Avengers: Endgame\", \"The Lion King (2019)\", \"Frozen II\", \"Toy Story 4\", \n", " \"Star Wars: The Rise of Skywalker\", \"Joker\", \"Spider-Man: Far From Home\", \n", " \"Captain Marvel\", \"Aladdin (2019)\", \"Knives Out\", \"Us\", \"Once Upon a Time in Hollywood\", \n", " \"1917\", \"Ford v Ferrari\", \"It Chapter Two\", \"Parasite\", \"Shazam!\", \n", " \"How to Train Your Dragon: The Hidden World\", \"Jumanji: The Next Level\", \"Little Women\", \n", " \"Marriage Story\", \"Jojo Rabbit\", \"The Irishman\", \"Rocketman\", \n", " \"John Wick: Chapter 3 – Parabellum\", \"Glass\", \"Hustlers\", \"The Lego Movie 2: The Second Part\", \n", " \"Dumbo\", \"Alita: Battle Angel\", \"Doctor Sleep\", \"Ad Astra\", \"The Lighthouse\", \n", " \"Frozen II\", \"Zombieland: Double Tap\", \"Midsommar\", \"Good Boys\", \"A Beautiful Day in the Neighborhood\",\n", "\n", " # 2020 Movies\n", " \"Tenet\", \"Sonic the Hedgehog\", \"Wonder Woman 1984\", \"Birds of Prey\", \n", " \"The Invisible Man\", \"Soul\", \"Onward\", \"The Croods: A New Age\", \"Mulan (2020)\", \n", " \"Bad Boys for Life\", \"The Trial of the Chicago 7\", \"Palm Springs\", \n", " \"Hamilton\", \"Ma Rainey's Black Bottom\", \"Borat Subsequent Moviefilm\", \n", " \"The Old Guard\", \"Enola Holmes\", \"The Midnight Sky\", \"Extraction\", \n", " \"The Call of the Wild\", \"Greyhound\", \"The Way Back\", \"Da 5 Bloods\", \n", " \"One Night in Miami...\", \"Sound of Metal\", \"Promising Young Woman\", \n", " \"The Devil All the Time\", \"News of the World\", \"Over the Moon\", \n", " \"A Shaun the Sheep Movie: Farmageddon\", \"My Spy\", \"The Personal History of David Copperfield\", \n", " \"The Half of It\", \"Pieces of a Woman\", \"The King of Staten Island\", \n", " \"The Lovebirds\", \"The Secret Garden\", \"Let Him Go\", \"Kajillionaire\", \"The Witches (2020)\",\n", "\n", " # 2021 Movies\n", " \"Spider-Man: No Way Home\", \"Shang-Chi and the Legend of the Ten Rings\", \n", " \"Black Widow\", \"Eternals\", \"Dune (2021)\", \"The Suicide Squad\", \n", " \"Free Guy\", \"Encanto\", \"Cruella\", \"No Time to Die\", \"The Mitchells vs. the Machines\", \n", " \"Luca\", \"Raya and the Last Dragon\", \"The Green Knight\", \"In the Heights\", \n", " \"A Quiet Place Part II\", \"Don't Look Up\", \"House of Gucci\", \n", " \"West Side Story (2021)\", \"The French Dispatch\", \"Jungle Cruise\", \n", " \"King Richard\", \"Belfast\", \"The Last Duel\", \"CODA\", \"Tick, Tick... Boom!\", \n", " \"Nightmare Alley\", \"The Power of the Dog\", \"Venom: Let There Be Carnage\", \n", " \"Ghostbusters: Afterlife\", \"The Forever Purge\", \"The Eyes of Tammy Faye\", \n", " \"Malcolm & Marie\", \"Spencer\", \"Antlers\", \"The Many Saints of Newark\", \n", " \"Fear Street Part One: 1994\", \"The Tomorrow War\", \"Bo Burnham: Inside\",\n", "\n", " # 2022 Movies\n", " \"Top Gun Maverick\", \"The Batman\", \"Black Panther: Wakanda Forever\", \n", " \"Doctor Strange in the Multiverse of Madness\", \"Avatar: The Way of Water\", \n", " \"Minions: The Rise of Gru\", \"Jurassic World Dominion\", \"Thor: Love and Thunder\", \n", " \"Everything Everywhere All at Once\", \"Nope\", \"The Woman King\", \"Smile\", \n", " \"The Menu\", \"Turning Red\", \"Glass Onion: A Knives Out Mystery\", \"Prey\", \n", " \"The Fabelmans\", \"Puss in Boots: The Last Wish\", \"Lightyear\", \"Pinocchio (2022)\", \n", " \"The Whale\", \"All Quiet on the Western Front\", \"Bullet Train\", \"Elvis\", \n", " \"The Banshees of Inisherin\", \"Barbarian\", \"Babylon\", \"Don't Worry Darling\", \n", " \"Amsterdam\", \"Marcel the Shell with Shoes On\", \"Hocus Pocus 2\", \"Bodies Bodies Bodies\", \n", " \"Bones and All\", \"The Northman\", \"RRR\", \"Emancipation\", \"Thirteen Lives\", \n", " \"The Adam Project\", \"Apollo 10½\", \"The Lost City\", \"Deep Water\", \n", " \"Where the Crawdads Sing\", \"No Exit\", \"Scream (2022)\", \"Women Talking\",\n", "\n", " # 2023 Movies\n", " \"Barbie\", \"Oppenheimer\", \"Spider-Man: Across the Spider-Verse\", \n", " \"Guardians of the Galaxy Vol. 3\", \"The Super Mario Bros. Movie\", \"The Little Mermaid (2023)\", \n", " \"Mission: Impossible – Dead Reckoning Part One\", \"Fast X\", \"John Wick: Chapter 4\", \n", " \"The Flash\", \"Elemental\", \"Indiana Jones and the Dial of Destiny\", \n", " \"Dungeons & Dragons: Honor Among Thieves\", \"Creed III\", \"The Marvels\", \n", " \"Ant-Man and the Wasp: Quantumania\", \"Evil Dead Rise\", \"The Hunger Games: The Ballad of Songbirds and Snakes\", \n", " \"Killers of the Flower Moon\", \"The Equalizer 3\", \"A Haunting in Venice\", \n", " \"Napoleon\", \"Wish\", \"The Nun II\", \"The Boogeyman\", \"Talk to Me\", \n", " \"Blue Beetle\", \"Teenage Mutant Ninja Turtles: Mutant Mayhem\", \n", " \"The Creator\", \"Transformers: Rise of the Beasts\", \"Asteroid City\", \n", " \"Saw X\", \"The Exorcist: Believer\", \"Five Nights at Freddy's\", \n", " \"Shazam! Fury of the Gods\", \"The Whale (Wide Release)\", \n", " \"Air\", \"Joy Ride\", \"The Pale Blue Eye\", \"Polite Society\", \n", " \"Are You There God? It’s Me, Margaret.\", \"Beau Is Afraid\", \"Gran Turismo\", \n", " \"Past Lives\", \"Next Goal Wins\", \"Maestro\", \"The Holdovers\", \"Poor Things\", \n", " \"The Killer\", \"TÁR (Wide Release)\", \"Foe\", \"Saltburn\", \"Knox Goes Away\", \n", " \"Wonka\", \"Flamin' Hot\", \"One Piece Film: Red\",\n", "\n", " # 2010 Movies\n", " \"Inception\", \"Toy Story 3\", \"The Social Network\", \"Harry Potter and the Deathly Hallows: Part 1\",\n", " \"Shutter Island\", \"Black Swan\", \"Iron Man 2\", \"The King's Speech\", \"Tangled\", \"Despicable Me\",\n", " \"How to Train Your Dragon\", \"The Twilight Saga: Eclipse\", \"Alice in Wonderland (2010)\", \n", " \"True Grit\", \"The Fighter\", \"Kick-Ass\", \"127 Hours\", \"Scott Pilgrim vs. The World\", \"Easy A\", \n", " \"The Town\", \"The Other Guys\", \"Buried\", \"The Expendables\", \"The Book of Eli\", \"Salt\", \n", " \"Clash of the Titans\", \"Robin Hood (2010)\", \"Percy Jackson & the Olympians: The Lightning Thief\", \n", " \"Tron: Legacy\", \"The Karate Kid (2010)\", \"Grown Ups\", \"Date Night\", \"Due Date\",\n", "\n", " # 2011 Movies\n", " \"Harry Potter and the Deathly Hallows: Part 2\", \"The Help\", \"Thor\", \"Captain America: The First Avenger\", \n", " \"The Twilight Saga: Breaking Dawn – Part 1\", \"The Girl with the Dragon Tattoo (2011)\", \"Rise of the Planet of the Apes\",\n", " \"Bridesmaids\", \"X-Men: First Class\", \"The Hunger Games\", \"Drive\", \"Moneyball\", \"War Horse\",\n", " \"The Artist\", \"Midnight in Paris\", \"Horrible Bosses\", \"Crazy, Stupid, Love\", \"The Descendants\", \n", " \"Super 8\", \"Tinker Tailor Soldier Spy\", \"Rango\", \"Hugo\", \"Kung Fu Panda 2\", \"Cars 2\", \n", " \"Fast Five\", \"The Adjustment Bureau\", \"Contagion\", \"Sherlock Holmes: A Game of Shadows\", \"Real Steel\", \n", " \"Paranormal Activity 3\", \"Puss in Boots\", \"The Smurfs\", \"Sucker Punch\", \"The Tree of Life\",\n", "\n", " # 2012 Movies\n", " \"The Avengers\", \"The Dark Knight Rises\", \"The Hunger Games\", \"Skyfall\", \"The Amazing Spider-Man\",\n", " \"The Twilight Saga: Breaking Dawn – Part 2\", \"Django Unchained\", \"Life of Pi\", \"The Hobbit: An Unexpected Journey\",\n", " \"Les Misérables\", \"Brave\", \"Wreck-It Ralph\", \"Silver Linings Playbook\", \"Argo\", \"Zero Dark Thirty\", \n", " \"Prometheus\", \"21 Jump Street\", \"Looper\", \"Magic Mike\", \"Ted\", \"Hotel Transylvania\", \"The Bourne Legacy\", \n", " \"Lincoln\", \"The Master\", \"Pitch Perfect\", \"The Perks of Being a Wallflower\", \"Beasts of the Southern Wild\", \n", " \"Flight\", \"Rise of the Guardians\", \"Cloud Atlas\", \"The Cabin in the Woods\", \"Chronicle\",\n", "\n", " # 2013 Movies\n", " \"Frozen\", \"Iron Man 3\", \"Despicable Me 2\", \"The Hunger Games: Catching Fire\", \"Man of Steel\", \n", " \"Gravity\", \"The Wolf of Wall Street\", \"American Hustle\", \"Thor: The Dark World\", \"The Great Gatsby (2013)\", \n", " \"The Hobbit: The Desolation of Smaug\", \"Monsters University\", \"12 Years a Slave\", \"The Conjuring\", \n", " \"Frozen\", \"World War Z\", \"Pacific Rim\", \"Captain Phillips\", \"Now You See Me\", \"The Heat\", \n", " \"Blue Jasmine\", \"Dallas Buyers Club\", \"Prisoners\", \"Saving Mr. Banks\", \"Her\", \"Rush\", \"This Is the End\", \n", " \"The Croods\", \"Elysium\", \"The Secret Life of Walter Mitty\", \"Inside Llewyn Davis\", \"The Wolverine\",\n", "\n", " # 2014 Movies\n", " \"Guardians of the Galaxy\", \"The LEGO Movie\", \"Captain America: The Winter Soldier\", \"Interstellar\", \n", " \"The Hunger Games: Mockingjay – Part 1\", \"Gone Girl\", \"The Hobbit: The Battle of the Five Armies\", \n", " \"Big Hero 6\", \"The Fault in Our Stars\", \"X-Men: Days of Future Past\", \"Maleficent\", \"Divergent\", \n", " \"The Grand Budapest Hotel\", \"How to Train Your Dragon 2\", \"The Imitation Game\", \"Birdman\", \n", " \"Whiplash\", \"American Sniper\", \"The Maze Runner\", \"Edge of Tomorrow\", \"Nightcrawler\", \n", " \"Unbroken\", \"The Theory of Everything\", \"The Equalizer\", \"Fury\", \"Godzilla (2014)\", \n", " \"22 Jump Street\", \"The Babadook\", \"A Most Violent Year\", \"Selma\", \"Boyhood\",\n", "\n", " # 2015 Movies\n", " \"Star Wars: The Force Awakens\", \"Avengers: Age of Ultron\", \"Jurassic World\", \"Inside Out\", \n", " \"The Martian\", \"Mad Max: Fury Road\", \"The Revenant\", \"Furious 7\", \"The Hunger Games: Mockingjay – Part 2\", \n", " \"Cinderella (2015)\", \"The Peanuts Movie\", \"Ant-Man\", \"Minions\", \"Spectre\", \"Pitch Perfect 2\", \n", " \"Creed\", \"The Big Short\", \"Ex Machina\", \"Room\", \"Spotlight\", \"Bridge of Spies\", \"Sicario\", \n", " \"Straight Outta Compton\", \"The Danish Girl\", \"Trainwreck\", \"The Good Dinosaur\", \n", " \"Shaun the Sheep Movie\", \"Spy\", \"The Man from U.N.C.L.E.\", \"Paper Towns\", \"Paddington\",\n", "\n", " # 2016 Movies\n", " \"Captain America: Civil War\", \"Rogue One: A Star Wars Story\", \"Finding Dory\", \"Zootopia\", \n", " \"The Jungle Book (2016)\", \"Moana\", \"Doctor Strange\", \"Fantastic Beasts and Where to Find Them\", \n", " \"Deadpool\", \"Batman v Superman: Dawn of Justice\", \"Suicide Squad\", \"La La Land\", \"Hacksaw Ridge\", \n", " \"Hidden Figures\", \"Arrival\", \"Manchester by the Sea\", \"Lion\", \"Moonlight\", \"Hell or High Water\", \n", " \"The Nice Guys\", \"Passengers\", \"The Secret Life of Pets\", \"Sing\", \"Trolls\", \n", " \"Kubo and the Two Strings\", \"10 Cloverfield Lane\", \"The Legend of Tarzan\", \n", " \"The Magnificent Seven (2016)\", \"The Shallows\", \"War Dogs\", \"Deepwater Horizon\",\n", "\n", " # 2017 Movies\n", " \"Wonder Woman\", \"Star Wars: The Last Jedi\", \"Beauty and the Beast (2017)\", \"Thor: Ragnarok\", \n", " \"Guardians of the Galaxy Vol. 2\", \"Spider-Man: Homecoming\", \"Justice League\", \"It (2017)\", \n", " \"Logan\", \"Coco\", \"Get Out\", \"Dunkirk\", \"The Shape of Water\", \"Blade Runner 2049\", \"Lady Bird\", \n", " \"Three Billboards Outside Ebbing, Missouri\", \"Call Me by Your Name\", \"Baby Driver\", \"The Disaster Artist\", \n", " \"The Post\", \"Darkest Hour\", \"I, Tonya\", \"Phantom Thread\", \"Paddington 2\", \"The Greatest Showman\", \n", " \"Jumanji: Welcome to the Jungle\", \"The Lego Batman Movie\", \"War for the Planet of the Apes\", \n", " \"The Boss Baby\", \"Ferdinand\", \"Split\", \"John Wick: Chapter 2\", \"Atomic Blonde\",\n", "\n", " # Hit Songs (Various Years)\n", " \"Blinding Lights - The Weeknd\", \"Shape of You - Ed Sheeran\", \"Uptown Funk - Mark Ronson ft. Bruno Mars\", \n", " \"Old Town Road - Lil Nas X ft. Billy Ray Cyrus\", \"Bad Guy - Billie Eilish\", \n", " \"Dynamite - BTS\", \"Watermelon Sugar - Harry Styles\", \"Stay - The Kid LAROI & Justin Bieber\", \n", " \"Levitating - Dua Lipa ft. DaBaby\", \"Rockstar - Post Malone ft. 21 Savage\", \n", " \"Savage Love - Jawsh 685 & Jason Derulo\", \"Circles - Post Malone\", \"Drivers License - Olivia Rodrigo\", \n", " \"Sunflower - Post Malone & Swae Lee\", \"All of Me - John Legend\", \"Someone Like You - Adele\", \n", " \"Rolling in the Deep - Adele\", \"Hello - Adele\", \"As It Was - Harry Styles\", \"Bad Habits - Ed Sheeran\", \n", " \"Industry Baby - Lil Nas X & Jack Harlow\", \"Happier - Marshmello ft. Bastille\", \n", " \"Good 4 U - Olivia Rodrigo\", \"Montero (Call Me By Your Name) - Lil Nas X\", \n", " \"Peaches - Justin Bieber ft. Daniel Caesar & Giveon\", \"Butter - BTS\", \n", " \"Permission to Dance - BTS\", \"We Don't Talk About Bruno - Encanto Cast\", \n", " \"Shallow - Lady Gaga & Bradley Cooper\", \"Havana - Camila Cabello ft. Young Thug\", \n", " \"Senorita - Shawn Mendes & Camila Cabello\", \"Perfect - Ed Sheeran\", \"Love Yourself - Justin Bieber\", \n", " \"Despacito - Luis Fonsi & Daddy Yankee ft. Justin Bieber\", \"Sorry - Justin Bieber\", \n", " \"Closer - The Chainsmokers ft. Halsey\", \"Something Just Like This - The Chainsmokers & Coldplay\", \n", " \"Don't Start Now - Dua Lipa\", \"Break My Heart - Dua Lipa\", \"Titanium - David Guetta ft. Sia\", \n", " \"Chandelier - Sia\", \"Elastic Heart - Sia\", \"Alive - Sia\", \"Cheap Thrills - Sia ft. Sean Paul\", \n", " \"Toxic - Britney Spears\", \"Oops!... I Did It Again - Britney Spears\", \"Shake It Off - Taylor Swift\", \n", " \"Blank Space - Taylor Swift\", \"Bad Blood - Taylor Swift ft. Kendrick Lamar\", \n", " \"Anti-Hero - Taylor Swift\", \"You Belong With Me - Taylor Swift\", \"Delicate - Taylor Swift\", \n", " \"All Too Well - Taylor Swift\", \"I Knew You Were Trouble - Taylor Swift\", \n", " \"Midnight Rain - Taylor Swift\", \"Lavender Haze - Taylor Swift\", \"22 - Taylor Swift\", \n", " \"Me! - Taylor Swift ft. Brendon Urie\", \"Cruel Summer - Taylor Swift\", \"Style - Taylor Swift\", \n", " \"Wildest Dreams - Taylor Swift\", \"Look What You Made Me Do - Taylor Swift\", \n", " \"Anti-Hero - Taylor Swift\", \"Tim McGraw - Taylor Swift\", \"Cardigan - Taylor Swift\", \n", " \"Willow - Taylor Swift\", \"Bejeweled - Taylor Swift\", \"We Are Never Ever Getting Back Together - Taylor Swift\", \n", " \"This Love - Taylor Swift\", \"Gold Rush - Taylor Swift\", \"My Tears Ricochet - Taylor Swift\", \n", " \"Shake It Off - Taylor Swift\", \"Maroon - Taylor Swift\", \"Wildest Dreams - Taylor Swift\", \n", " \"You're On Your Own, Kid - Taylor Swift\", \"The 1 - Taylor Swift\", \"Invisible String - Taylor Swift\", \n", " \"Enchanted - Taylor Swift\", \"Welcome to New York - Taylor Swift\", \"Dear John - Taylor Swift\", \n", " \"Evermore - Taylor Swift ft. Bon Iver\", \"Exile - Taylor Swift ft. Bon Iver\", \n", " \"Champagne Problems - Taylor Swift\", \"Betty - Taylor Swift\", \"Paper Rings - Taylor Swift\", \n", " \"The Archer - Taylor Swift\", \"Getaway Car - Taylor Swift\", \"August - Taylor Swift\", \n", " \"Cornelia Street - Taylor Swift\", \"King of My Heart - Taylor Swift\", \n", " \"Love Story - Taylor Swift\", \"You Belong With Me - Taylor Swift\", \"White Horse - Taylor Swift\", \n", " \"You Should Be Here - Taylor Swift\", \"End Game - Taylor Swift ft. Future & Ed Sheeran\", \n", " \"Call It What You Want - Taylor Swift\", \"We Are Never Ever Getting Back Together - Taylor Swift\", \n", " \"Lover - Taylor Swift\", \"You Need to Calm Down - Taylor Swift\", \"Daylight - Taylor Swift\", \n", " \"I Forgot That You Existed - Taylor Swift\", \"Cruel Summer - Taylor Swift\", \n", " \"All Too Well - Taylor Swift\", \"Enchanted - Taylor Swift\", \n", " \"Style - Taylor Swift\", \"Wildest Dreams - Taylor Swift\", \"Gold Rush - Taylor Swift\", \n", " \"The Archer - Taylor Swift\", \"Getaway Car - Taylor Swift\", \"Cornelia Street - Taylor Swift\", \n", " \"Betty - Taylor Swift\", \"Exile - Taylor Swift ft. Bon Iver\", \n", " \"Champagne Problems - Taylor Swift\", \"The 1 - Taylor Swift\", \"Invisible String - Taylor Swift\", \n", " \"You're On Your Own, Kid - Taylor Swift\", \"Enchanted - Taylor Swift\",\n", "\n", " # Taylor Swift Albums\n", " \"Midnights - Taylor Swift\", \"Folklore - Taylor Swift\", \"Evermore - Taylor Swift\",\n", " \"1989 - Taylor Swift\", \"Reputation - Taylor Swift\", \"Fearless (Taylor’s Version) - Taylor Swift\",\n", " \"Speak Now (Taylor’s Version) - Taylor Swift\", \"Red (Taylor’s Version) - Taylor Swift\",\n", " \"Lover - Taylor Swift\", \"Fearless - Taylor Swift\", \"Speak Now - Taylor Swift\",\n", "\n", " # Beyoncé Albums\n", " \"Renaissance - Beyoncé\", \"Lemonade - Beyoncé\", \"4 - Beyoncé\", \n", " \"B’Day - Beyoncé\", \"Dangerously in Love - Beyoncé\", \"The Gift - Beyoncé\",\n", "\n", " # Drake Albums\n", " \"Certified Lover Boy - Drake\", \"Scorpion - Drake\", \"Views - Drake\",\n", " \"Take Care - Drake\", \"Nothing Was the Same - Drake\", \"Her Loss - Drake & 21 Savage\",\n", "\n", " # Adele Albums\n", " \"30 - Adele\", \"25 - Adele\", \"21 - Adele\", \"19 - Adele\",\n", "\n", " # The Weeknd Albums\n", " \"Dawn FM - The Weeknd\", \"After Hours - The Weeknd\", \"Starboy - The Weeknd\",\n", " \"Beauty Behind the Madness - The Weeknd\", \"Kiss Land - The Weeknd\",\n", "\n", " # Billie Eilish Albums\n", " \"Happier Than Ever - Billie Eilish\", \"When We All Fall Asleep, Where Do We Go? - Billie Eilish\",\n", " \"Don’t Smile at Me - Billie Eilish\",\n", "\n", " # Harry Styles Albums\n", " \"Harry’s House - Harry Styles\", \"Fine Line - Harry Styles\", \"Harry Styles - Harry Styles\",\n", "\n", " # Olivia Rodrigo Albums\n", " \"SOUR - Olivia Rodrigo\", \"GUTS - Olivia Rodrigo\",\n", "\n", " # BTS Albums\n", " \"Map of the Soul: 7 - BTS\", \"BE - BTS\", \"Proof - BTS\",\n", " \"Love Yourself: Tear - BTS\", \"Love Yourself: Answer - BTS\", \"Wings - BTS\",\n", "\n", " # Bad Bunny Albums\n", " \"Un Verano Sin Ti - Bad Bunny\", \"YHLQMDLG - Bad Bunny\", \"El Último Tour Del Mundo - Bad Bunny\",\n", "\n", " # Taylor Swift Expanded\n", " \"Red - Taylor Swift\", \"Fearless - Taylor Swift\", \"Lover - Taylor Swift\",\n", " \"Reputation - Taylor Swift\", \"Speak Now - Taylor Swift\", \"Midnights - Taylor Swift\",\n", "\n", " # Hip-Hop Albums\n", " \"DAMN. - Kendrick Lamar\", \"Mr. Morale & the Big Steppers - Kendrick Lamar\", \n", " \"Good Kid, M.A.A.D City - Kendrick Lamar\", \"The Off-Season - J. Cole\", \n", " \"4 Your Eyez Only - J. Cole\", \"2014 Forest Hills Drive - J. Cole\", \n", " \"Astroworld - Travis Scott\", \"Birds in the Trap Sing McKnight - Travis Scott\", \n", " \"Rodeo - Travis Scott\", \"Montero - Lil Nas X\", \"The Pinkprint - Nicki Minaj\",\n", " \"Queen - Nicki Minaj\", \"The Marshall Mathers LP - Eminem\", \n", " \"The Eminem Show - Eminem\", \"Kamikaze - Eminem\", \"Encore - Eminem\",\n", " \"My Turn - Lil Baby\", \"It's Only Me - Lil Baby\",\n", "\n", " # Rock Albums\n", " \"AM - Arctic Monkeys\", \"Humbug - Arctic Monkeys\", \"Tranquility Base Hotel & Casino - Arctic Monkeys\",\n", " \"When We Were Young - The Killers\", \"Wonderful Wonderful - The Killers\", \n", " \"American Idiot - Green Day\", \"Dookie - Green Day\", \"Father of All... - Green Day\",\n", " \"Rumours - Fleetwood Mac\", \"Tusk - Fleetwood Mac\", \"The Dark Side of the Moon - Pink Floyd\", \n", " \"The Wall - Pink Floyd\", \"Wish You Were Here - Pink Floyd\",\n", "\n", " # Pop Albums\n", " \"Future Nostalgia - Dua Lipa\", \"Levitating - Dua Lipa\", \"Don’t Start Now - Dua Lipa\",\n", " \"Chromatica - Lady Gaga\", \"Born This Way - Lady Gaga\", \"The Fame Monster - Lady Gaga\",\n", " \"Lemonade - Beyoncé\", \"4 - Beyoncé\",\n", "\n", " # Country Albums\n", " \"Golden Hour - Kacey Musgraves\", \"Same Trailer Different Park - Kacey Musgraves\", \n", " \"Star-Crossed - Kacey Musgraves\", \"Traveller - Chris Stapleton\", \n", " \"From A Room: Volume 1 - Chris Stapleton\", \"What You See Is What You Get - Luke Combs\", \n", " \"Growin’ Up - Luke Combs\", \"Dangerous: The Double Album - Morgan Wallen\",\n", "\n", " # More Pop Albums\n", " \"Fine Line - Harry Styles\", \"When We All Fall Asleep, Where Do We Go? - Billie Eilish\",\n", " \"Harry’s House - Harry Styles\", \"SOUR - Olivia Rodrigo\",\n", "\n", " # Albums from the Last Decade\n", " \"Random Access Memories - Daft Punk\", \"25 - Adele\", \"Anti - Rihanna\", \n", " \"Lemonade - Beyoncé\", \"Currents - Tame Impala\", \"Melodrama - Lorde\", \n", " \"Pure Heroine - Lorde\", \"Invasion of Privacy - Cardi B\", \n", " \"Blonde - Frank Ocean\", \"Channel Orange - Frank Ocean\", \n", " \"CTRL - SZA\", \"SOS - SZA\", \"Heard It in a Past Life - Maggie Rogers\", \n", " \"The Slow Rush - Tame Impala\", \"Manic - Halsey\", \"Hopeless Fountain Kingdom - Halsey\", \n", " \"Badlands - Halsey\", \"Human - Rag'n'Bone Man\", \"After Laughter - Paramore\",\n", " \"Brand New Eyes - Paramore\", \"Riot! - Paramore\", \"This Is Why - Paramore\",\n", " \"Divide - Ed Sheeran\", \"Multiply - Ed Sheeran\", \"Equals - Ed Sheeran\",\n", "\n", " # Top Albums of All Time\n", " \"Abbey Road - The Beatles\", \"Revolver - The Beatles\", \"Sgt. Pepper’s Lonely Hearts Club Band - The Beatles\",\n", " \"Rumours - Fleetwood Mac\", \"Thriller - Michael Jackson\", \"Off the Wall - Michael Jackson\",\n", " \"Purple Rain - Prince\", \"1999 - Prince\", \"The Joshua Tree - U2\", \n", " \"Achtung Baby - U2\", \"OK Computer - Radiohead\", \"Kid A - Radiohead\", \n", " \"Nevermind - Nirvana\", \"In Utero - Nirvana\", \"Led Zeppelin IV - Led Zeppelin\",\n", " \"Physical Graffiti - Led Zeppelin\", \"Hotel California - Eagles\", \n", " \"Back in Black - AC/DC\", \"Highway to Hell - AC/DC\", \"The Suburbs - Arcade Fire\",\n", " \"Funeral - Arcade Fire\", \"Born to Run - Bruce Springsteen\", \n", " \"The River - Bruce Springsteen\", \"Darkness on the Edge of Town - Bruce Springsteen\",\n", " \"21 - Adele\", \"25 - Adele\", \"30 - Adele\", \"Midnights - Taylor Swift\",\n", " \"1989 - Taylor Swift\", \"Fearless (Taylor's Version) - Taylor Swift\",\n", " \"Red (Taylor's Version) - Taylor Swift\", \"Speak Now (Taylor's Version) - Taylor Swift\",\n", " \"Lover - Taylor Swift\", \"Folklore - Taylor Swift\", \"Evermore - Taylor Swift\",\n", "\n", " # More Hip-Hop Albums\n", " \"Illmatic - Nas\", \"It Was Written - Nas\", \"The Blueprint - Jay-Z\", \n", " \"Reasonable Doubt - Jay-Z\", \"The Black Album - Jay-Z\", \"Watch the Throne - Jay-Z & Kanye West\",\n", " \"Graduation - Kanye West\", \"My Beautiful Dark Twisted Fantasy - Kanye West\", \n", " \"The College Dropout - Kanye West\", \"Late Registration - Kanye West\",\n", " \"Life of Pablo - Kanye West\", \"Astroworld - Travis Scott\", \n", " \"Rodeo - Travis Scott\", \"DAMN. - Kendrick Lamar\", \"To Pimp a Butterfly - Kendrick Lamar\",\n", " \"Good Kid, M.A.A.D City - Kendrick Lamar\", \"The Eminem Show - Eminem\",\n", " \"The Marshall Mathers LP - Eminem\", \"Kamikaze - Eminem\", \"Encore - Eminem\",\n", "\n", " # Electronic & Indie Albums\n", " \"Discovery - Daft Punk\", \"Random Access Memories - Daft Punk\", \n", " \"Currents - Tame Impala\", \"The Slow Rush - Tame Impala\", \n", " \"An Awesome Wave - Alt-J\", \"This Is All Yours - Alt-J\", \n", " \"Relaxer - Alt-J\", \"AM - Arctic Monkeys\", \"Whatever People Say I Am, That’s What I’m Not - Arctic Monkeys\",\n", " \"Humbug - Arctic Monkeys\", \"Suck It and See - Arctic Monkeys\", \n", " \"Tranquility Base Hotel & Casino - Arctic Monkeys\",\n", "\n", " # Netflix Original Series\n", " \"Stranger Things\", \"The Crown\", \"The Witcher\", \"Money Heist\", \"Wednesday\", \n", " \"Bridgerton\", \"The Umbrella Academy\", \"Ozark\", \"Mindhunter\", \"The Queen's Gambit\", \n", " \"You\", \"Narcos\", \"13 Reasons Why\", \"BoJack Horseman\", \"Big Mouth\", \n", " \"The Sandman\", \"Locke & Key\", \"Cobra Kai\", \"Russian Doll\", \"Sweet Tooth\", \n", " \"Heartstopper\", \"Sex Education\", \"Shadow and Bone\", \"The Lincoln Lawyer\", \n", " \"Outer Banks\", \"Lucifer\", \"The Last Kingdom\", \"Elite\", \"The Dark Crystal: Age of Resistance\", \n", " \"Arcane\", \"Daredevil\", \"Jessica Jones\", \"Luke Cage\", \"Iron Fist\", \"The Punisher\", \n", " \"The Defenders\", \"Unbreakable Kimmy Schmidt\", \"Grace and Frankie\", \"Glow\", \n", " \"The Kominsky Method\", \"Dead to Me\", \"Queen Charlotte: A Bridgerton Story\", \n", " \"Maniac\", \"Altered Carbon\", \"Black Mirror\", \"House of Cards\", \"F Is for Family\", \n", " \"American Vandal\", \"Bloodline\", \"Hemlock Grove\", \"The Chilling Adventures of Sabrina\", \n", " \"Emily in Paris\", \"The Haunting of Hill House\", \"The Haunting of Bly Manor\",\n", "\n", " # Disney+ Original Series\n", " \"The Mandalorian\", \"WandaVision\", \"Loki\", \"The Falcon and the Winter Soldier\", \n", " \"Hawkeye\", \"What If...?\", \"She-Hulk: Attorney at Law\", \"Ms. Marvel\", \n", " \"Moon Knight\", \"Andor\", \"The Book of Boba Fett\", \"Obi-Wan Kenobi\", \n", " \"Star Wars: The Bad Batch\", \"Star Wars: Visions\", \"The Imagineering Story\", \n", " \"Marvel's 616\", \"High School Musical: The Musical: The Series\", \"Diary of a Future President\", \n", " \"Big Shot\", \"The Mighty Ducks: Game Changers\", \"Doogie Kameāloha, M.D.\", \"The World According to Jeff Goldblum\",\n", "\n", " # Amazon Prime Video Original Series\n", " \"The Boys\", \"The Marvelous Mrs. Maisel\", \"Fleabag\", \"Jack Ryan\", \"The Wheel of Time\", \n", " \"Good Omens\", \"Reacher\", \"The Lord of the Rings: The Rings of Power\", \n", " \"Invincible\", \"The Expanse\", \"Upload\", \"The Man in the High Castle\", \n", " \"Carnival Row\", \"Mozart in the Jungle\", \"Transparent\", \"Patriot\", \"Goliath\", \n", " \"Bosch\", \"Tales from the Loop\", \"The Underground Railroad\", \"Outer Range\", \n", " \"A League of Their Own\", \"The Wilds\", \"Red Oaks\", \"Hanna\", \"Utopia\",\n", "\n", " # HBO and HBO Max Original Series\n", " \"Game of Thrones\", \"House of the Dragon\", \"Succession\", \"Euphoria\", \"The Last of Us\", \n", " \"Barry\", \"The White Lotus\", \"Westworld\", \"Big Little Lies\", \"Chernobyl\", \n", " \"Veep\", \"True Detective\", \"Silicon Valley\", \"The Flight Attendant\", \n", " \"Insecure\", \"Raised by Wolves\", \"The Righteous Gemstones\", \"Station Eleven\", \n", " \"The Undoing\", \"Winning Time: The Rise of the Lakers Dynasty\", \"Industry\", \n", " \"Perry Mason\", \"Love Life\", \"Peacemaker\", \"Mare of Easttown\", \"The Outsider\", \n", " \"Doom Patrol\", \"Titans\", \"His Dark Materials\", \"The Nevers\", \"Watchmen\",\n", "\n", " # Hulu Original Series\n", " \"The Handmaid's Tale\", \"Only Murders in the Building\", \"The Bear\", \"Castle Rock\", \n", " \"Nine Perfect Strangers\", \"Dopesick\", \"The Act\", \"Little Fires Everywhere\", \n", " \"Shrill\", \"Ramy\", \"Solar Opposites\", \"Animaniacs (Reboot)\", \"Chance\", \n", " \"The Great\", \"Woke\", \"Future Man\", \"Love, Victor\", \"Pen15\", \"The Looming Tower\", \n", " \"Difficult People\", \"Casual\", \"Harlots\", \"The Path\", \"11.22.63\", \n", " \"The Dropout\", \"Pam & Tommy\", \"How I Met Your Father\", \"Victoria’s Secret: Angels and Demons\",\n", "\n", " # Apple TV+ Original Series\n", " \"Ted Lasso\", \"Severance\", \"The Morning Show\", \"For All Mankind\", \"Foundation\", \n", " \"Pachinko\", \"Servant\", \"See\", \"Shrinking\", \"Mythic Quest\", \"Truth Be Told\", \n", " \"The Afterparty\", \"Dickinson\", \"Tehran\", \"Defending Jacob\", \"Slow Horses\", \n", " \"Invasion\", \"Black Bird\", \"Lisey’s Story\", \"Snoopy in Space\", \"Fraggle Rock: Back to the Rock\",\n", "\n", " # Other Platforms (FX, Showtime, AMC, Peacock, Paramount+)\n", " \"The Walking Dead\", \"Breaking Bad\", \"Better Call Saul\", \"Mad Men\", \n", " \"Fargo\", \"The Americans\", \"Sons of Anarchy\", \"Dexter\", \"Dexter: New Blood\", \n", " \"Billions\", \"Yellowjackets\", \"Shameless\", \"Ray Donovan\", \"The Chi\", \n", " \"Penny Dreadful\", \"Penny Dreadful: City of Angels\", \"Twin Peaks (2017)\", \n", " \"Bates Motel\", \"Mr. Robot\", \"Hannibal\", \"Preacher\", \"Orphan Black\", \n", " \"Killing Eve\", \"The Killing\", \"Broadchurch\", \"Sherlock\", \"Downton Abbey\", \n", " \"Dr. Death\", \"Girls5eva\", \"Yellowstone\", \"1883\", \"Mayor of Kingstown\", \n", " \"Star Trek: Discovery\", \"Star Trek: Picard\", \"Star Trek: Strange New Worlds\", \n", " \"Halo\", \"The Good Fight\", \"Evil\", \"A Discovery of Witches\", \"The Morning Show\", \n", " \"Glee\", \"New Girl\", \"How I Met Your Mother\", \"Parks and Recreation\", \n", " \"The Office (US)\", \"Brooklyn Nine-Nine\", \"30 Rock\", \"Community\", \n", " \"Archer\", \"Rick and Morty\", \"Family Guy\", \"Bob’s Burgers\", \"The Simpsons\", \n", " \"South Park\", \"Big Bang Theory\", \"Young Sheldon\", \"Two and a Half Men\", \n", " \"Friends\", \"How I Met Your Mother\", \"The Middle\", \"Supernatural\", \"Gotham\", \n", " \"Smallville\", \"Arrow\", \"The Flash\", \"Supergirl\", \"Legends of Tomorrow\", \n", " \"Batwoman\", \"Glee\", \"Futurama\", \"Scrubs\", \"Charmed\", \"The Vampire Diaries\", \n", " \"The Originals\", \"Legacies\", \"True Blood\", \"Once Upon a Time\", \"Grimm\",\n", "\n", " # Fiction Authors\n", " \"Colleen Hoover\", \"Taylor Jenkins Reid\", \"Emily Henry\", \"Lisa Jewell\", \n", " \"Kristin Hannah\", \"Alice Feeney\", \"Fredrik Backman\", \"Jodi Picoult\", \n", " \"Elin Hilderbrand\", \"Jennifer Weiner\", \"Brit Bennett\", \"Liane Moriarty\", \n", " \"Sally Rooney\", \"Celeste Ng\", \"Jojo Moyes\", \"Madeline Miller\", \"Delia Owens\", \n", " \"Barbara Kingsolver\", \"Ruth Ware\", \"Karen McManus\", \"Nicholas Sparks\", \n", " \"Christina Lauren\", \"Khaled Hosseini\", \"Chloe Gong\", \"Amor Towles\", \n", " \"Ann Patchett\", \"Jamie Ford\", \"Colson Whitehead\", \"Hanya Yanagihara\", \n", " \"Téa Obreht\", \"Douglas Stuart\", \"Min Jin Lee\", \"Eleanor Catton\", \n", " \"Anthony Doerr\", \"Kazuo Ishiguro\", \"Jeanine Cummins\", \"Rebecca Serle\", \n", " \"Katherine Center\", \"Laura Dave\", \"Elizabeth Strout\", \"Maggie O'Farrell\", \n", " \"Erin Morgenstern\", \"Tara Westover\", \"Alex Michaelides\", \"Lisa See\", \n", " \"Taylor Adams\", \"Mary Kubica\", \"Shari Lapena\", \"Rachel Hawkins\", \n", " \"Veronica Roth\", \"Erin A. Craig\", \"Cynthia Hand\", \"Karen White\", \n", " \"Mary Beth Keane\", \"Abbi Waxman\", \"Frances Cha\", \"Carley Fortune\", \n", "\n", " # Fantasy and Sci-Fi Authors\n", " \"Sarah J. Maas\", \"Leigh Bardugo\", \"V.E. Schwab\", \"Brandon Sanderson\", \n", " \"Marissa Meyer\", \"Sabaa Tahir\", \"Victoria Aveyard\", \"Jay Kristoff\", \n", " \"Tahereh Mafi\", \"Cassandra Clare\", \"R.F. Kuang\", \"Naomi Novik\", \n", " \"T.J. Klune\", \"Patrick Rothfuss\", \"Holly Black\", \"Laini Taylor\", \n", " \"Adrienne Young\", \"N.K. Jemisin\", \"Tracy Deonn\", \"Samantha Shannon\", \n", " \"Tomi Adeyemi\", \"Pierce Brown\", \"A.G. Slatter\", \"Rebecca Yarros\", \n", " \"Martha Wells\", \"P. Djèlí Clark\", \"Christopher Paolini\", \n", " \"Daniel Abraham\", \"James S.A. Corey\", \"Joe Abercrombie\", \"Neal Shusterman\", \n", "\n", " # Mystery, Thriller, and Suspense Authors\n", " \"Stephen King\", \"Riley Sager\", \"Harlan Coben\", \"Gillian Flynn\", \n", " \"Tana French\", \"Lisa Gardner\", \"Karin Slaughter\", \"Paula Hawkins\", \n", " \"Louise Penny\", \"Michael Connelly\", \"David Baldacci\", \"John Grisham\", \n", " \"Dan Brown\", \"Greer Hendricks\", \"Sarah Pekkanen\", \"Lucy Foley\", \n", " \"C.J. Box\", \"Don Winslow\", \"James Patterson\", \"Stieg Larsson\", \n", " \"Robert Galbraith\", \"Dean Koontz\", \"Clive Cussler\", \"Mark Greaney\", \n", " \"A.J. Finn\", \"B.A. Paris\", \"Tess Gerritsen\", \"Peter Swanson\", \"Megan Miranda\", \n", " \"Sophie Hannah\", \"Sandra Brown\", \"Alyssa Cole\", \"Rachel Caine\", \n", " \"Fiona Barton\", \"Shari Lapena\", \"Lisa Scottoline\", \n", "\n", " # Young Adult and Children's Authors\n", " \"Rick Riordan\", \"Angie Thomas\", \"Adam Silvera\", \"Jenny Han\", \n", " \"Marie Lu\", \"Rainbow Rowell\", \"Becky Albertalli\", \"John Green\", \n", " \"Karen M. McManus\", \"Kiera Cass\", \"Nicola Yoon\", \"Leigh Bardugo\", \n", " \"Sarah Dessen\", \"Victoria Schwab\", \"Brigid Kemmerer\", \"Neal Shusterman\", \n", " \"E. Lockhart\", \"Kami Garcia\", \"Tomi Adeyemi\", \"Melissa de la Cruz\", \n", " \"Roshani Chokshi\", \"Tahereh Mafi\", \"Julie Murphy\", \"Marissa Meyer\", \n", " \"Jennifer L. Armentrout\", \"Stephanie Garber\", \"Ashley Poston\", \n", " \"Jasmine Warga\", \"Kalynn Bayron\", \"Amie Kaufman\", \"Holly Jackson\", \n", "\n", " # Non-Fiction and Memoir Authors\n", " \"Michelle Obama\", \"Barack Obama\", \"Trevor Noah\", \"Matthew Perry\", \n", " \"Viola Davis\", \"David Sedaris\", \"Tara Westover\", \"Chanel Miller\", \n", " \"Glennon Doyle\", \"Brené Brown\", \"Elizabeth Gilbert\", \"Malcolm Gladwell\", \n", " \"Yuval Noah Harari\", \"Atul Gawande\", \"Michael Pollan\", \"Chimamanda Ngozi Adichie\", \n", " \"Isabel Wilkerson\", \"Jon Krakauer\", \"Ta-Nehisi Coates\", \"Ijeoma Oluo\", \n", " \"Robin DiAngelo\", \"Michelle Alexander\", \"Daniel Kahneman\", \n", " \"Adam Grant\", \"Robert Greene\", \"Marie Forleo\", \"James Clear\", \n", " \"Mark Manson\", \"Cal Newport\", \"David Goggins\", \"Simon Sinek\", \n", "\n", " # Romance Authors\n", " \"Colleen Hoover\", \"Emily Henry\", \"Christina Lauren\", \"Helen Hoang\", \n", " \"Ali Hazelwood\", \"Tessa Bailey\", \"Abby Jimenez\", \"Jasmine Guillory\", \n", " \"Sally Thorne\", \"Casey McQuiston\", \"Lyssa Kay Adams\", \"Lauren Layne\", \n", " \"R.S. Grey\", \"Katherine Center\", \"Penelope Douglas\", \"Mariana Zapata\", \n", " \"E.L. James\", \"Elle Kennedy\", \"Vi Keeland\", \"Sarina Bowen\", \n", " \"Cora Reilly\", \"Meghan Quinn\", \"Lucy Score\", \"K.A. Tucker\", \n", "\n", " # Historical Fiction Authors\n", " \"Kristin Hannah\", \"Kate Quinn\", \"Madeline Miller\", \"Anthony Doerr\", \n", " \"Ruta Sepetys\", \"Pam Jenoff\", \"Heather Morris\", \"Lisa Wingate\", \n", " \"Christina Baker Kline\", \"Martha Hall Kelly\", \"Paula McLain\", \n", " \"Alyssa Cole\", \"Jennifer Robson\", \"Imogen Kealey\", \"Natasha Lester\", \n", "\n", " # Business and Self-Help Authors\n", " \"Tim Ferriss\", \"Tony Robbins\", \"Dale Carnegie\", \"Napoleon Hill\", \n", " \"Stephen R. Covey\", \"James Clear\", \"Mark Manson\", \"Ryan Holiday\", \n", " \"Simon Sinek\", \"Jen Sincero\", \"Rachel Hollis\", \"Marie Kondo\", \n", " \"Robin Sharma\", \"Hal Elrod\", \"Mel Robbins\", \"John Maxwell\", \n", " \"David Allen\", \"Gary Vaynerchuk\", \"Seth Godin\", \"Grant Cardone\", \n", "\n", " # Poetry and Literary Fiction Authors\n", " \"Rupi Kaur\", \"Amanda Gorman\", \"Ocean Vuong\", \"Maggie Nelson\", \n", " \"Danez Smith\", \"Mary Oliver\", \"Margaret Atwood\", \"Louise Glück\", \n", " \"Jhumpa Lahiri\", \"Kazuo Ishiguro\", \"Zadie Smith\", \"Chimamanda Ngozi Adichie\", \n", " \"Arundhati Roy\", \"Ann Patchett\", \"Jonathan Franzen\", \"Colson Whitehead\", \n", " \"George Saunders\", \"Elizabeth Strout\", \"Alice Walker\", \"Toni Morrison\",\n", "\n", " # Basketball (NBA/WNBA)\n", " \"LeBron James\", \"Stephen Curry\", \"Kevin Durant\", \"Kobe Bryant\", \"Giannis Antetokounmpo\", \n", " \"Shaquille O'Neal\", \"Michael Jordan\", \"Tim Duncan\", \"Magic Johnson\", \"Larry Bird\", \n", " \"Wilt Chamberlain\", \"Kareem Abdul-Jabbar\", \"Russell Westbrook\", \"Anthony Davis\", \n", " \"Jayson Tatum\", \"Luka Dončić\", \"Damian Lillard\", \"Chris Paul\", \"James Harden\", \n", " \"Kyrie Irving\", \"Devin Booker\", \"Zion Williamson\", \"Ja Morant\", \"Draymond Green\", \n", " \"Klay Thompson\", \"Nikola Jokić\", \"Joel Embiid\", \"Jimmy Butler\", \"Paul George\", \n", " \"Diana Taurasi\", \"Sue Bird\", \"Candace Parker\", \"Breanna Stewart\", \"A'ja Wilson\", \n", " \"Elena Delle Donne\", \"Sabrina Ionescu\", \"Skylar Diggins-Smith\", \"Lisa Leslie\", \n", " \"Maya Moore\", \"Sylvia Fowles\",\n", "\n", " # Football (NFL)\n", " \"Tom Brady\", \"Patrick Mahomes\", \"Aaron Rodgers\", \"Josh Allen\", \"Lamar Jackson\", \n", " \"Jalen Hurts\", \"Russell Wilson\", \"Joe Burrow\", \"Justin Herbert\", \"Derrick Henry\", \n", " \"Christian McCaffrey\", \"Cooper Kupp\", \"Davante Adams\", \"Deebo Samuel\", \"Stefon Diggs\", \n", " \"Travis Kelce\", \"George Kittle\", \"Aaron Donald\", \"Von Miller\", \"J.J. Watt\", \n", " \"T.J. Watt\", \"Nick Bosa\", \"Myles Garrett\", \"Micah Parsons\", \"Tyreek Hill\", \n", " \"Ja'Marr Chase\", \"Ezekiel Elliott\", \"Saquon Barkley\", \"Jonathan Taylor\", \n", " \"Justin Jefferson\", \"Kirk Cousins\", \"Dak Prescott\", \"Kyler Murray\", \n", " \"DeAndre Hopkins\", \"Chris Godwin\", \"A.J. Brown\", \"Mark Andrews\", \"Dalvin Cook\",\n", "\n", " # Soccer (MLS/USMNT/USWNT)\n", " \"Christian Pulisic\", \"Weston McKennie\", \"Tyler Adams\", \"Gio Reyna\", \"Matt Turner\", \n", " \"Brenden Aaronson\", \"Tim Weah\", \"Walker Zimmerman\", \"Antonee Robinson\", \"Sergiño Dest\", \n", " \"Landon Donovan\", \"Clint Dempsey\", \"Alexi Lalas\", \"Jozy Altidore\", \"Brad Guzan\", \n", " \"Megan Rapinoe\", \"Alex Morgan\", \"Carli Lloyd\", \"Abby Wambach\", \"Tobin Heath\", \n", " \"Crystal Dunn\", \"Julie Ertz\", \"Kelley O'Hara\", \"Mallory Swanson\", \"Sophia Smith\", \n", " \"Rose Lavelle\", \"Becky Sauerbrunn\", \"Lindsey Horan\", \"Ashlyn Harris\", \n", " \"Christen Press\", \"Hope Solo\",\n", "\n", " # Tennis\n", " \"Serena Williams\", \"Venus Williams\", \"Coco Gauff\", \"Sloane Stephens\", \"Jessica Pegula\", \n", " \"Madison Keys\", \"Danielle Collins\", \"Jennifer Brady\", \"Taylor Townsend\", \"Alison Riske\", \n", " \"Sofia Kenin\", \"Frances Tiafoe\", \"Taylor Fritz\", \"John Isner\", \"Jack Sock\", \n", " \"Reilly Opelka\", \"Tommy Paul\", \"Sebastian Korda\", \"Ben Shelton\", \"Brandon Nakashima\", \n", " \"Michael Chang\", \"Pete Sampras\", \"Andre Agassi\", \"Andy Roddick\", \n", "\n", " # Golf\n", " \"Tiger Woods\", \"Phil Mickelson\", \"Jordan Spieth\", \"Brooks Koepka\", \"Bryson DeChambeau\", \n", " \"Dustin Johnson\", \"Justin Thomas\", \"Xander Schauffele\", \"Collin Morikawa\", \"Patrick Cantlay\", \n", " \"Scottie Scheffler\", \"Rickie Fowler\", \"Matt Kuchar\", \"Tony Finau\", \"Zach Johnson\", \n", " \"Lexi Thompson\", \"Nelly Korda\", \"Jessica Korda\", \"Michelle Wie\", \"Stacy Lewis\", \n", " \"Danielle Kang\", \"Paula Creamer\", \"Natalie Gulbis\", \n", "\n", " # Track and Field\n", " \"Allyson Felix\", \"Carl Lewis\", \"Florence Griffith Joyner\", \"Usain Bolt (Caribbean Legend)\", \n", " \"Sydney McLaughlin\", \"Noah Lyles\", \"Michael Norman\", \"Dalilah Muhammad\", \"Sha'Carri Richardson\", \n", " \"Athing Mu\", \"Donavan Brazier\", \"Fred Kerley\", \"Erriyon Knighton\", \"Trayvon Bromell\", \n", " \"Christian Coleman\", \"Grant Holloway\", \"DeAnna Price\", \"Emma Coburn\", \"Kara Winger\", \n", "\n", " # Swimming\n", " \"Michael Phelps\", \"Katie Ledecky\", \"Caeleb Dressel\", \"Ryan Lochte\", \"Missy Franklin\", \n", " \"Simone Manuel\", \"Nathan Adrian\", \"Lilly King\", \"Regan Smith\", \"Chase Kalisz\", \n", " \"Maggie Steffens\", \"Abbey Weitzeil\", \n", "\n", " # Boxing and MMA\n", " \"Floyd Mayweather Jr.\", \"Mike Tyson\", \"Deontay Wilder\", \"Terence Crawford\", \n", " \"Errol Spence Jr.\", \"Gervonta Davis\", \"Shakur Stevenson\", \"Claressa Shields\", \n", " \"Holly Holm\", \"Ronda Rousey\", \"Conor McGregor\", \"Dustin Poirier\", \"Israel Adesanya\", \n", " \"Jon Jones\", \"Kamaru Usman\", \"Amanda Nunes\", \"Julianna Peña\", \n", "\n", " # Baseball (MLB)\n", " \"Mike Trout\", \"Shohei Ohtani\", \"Aaron Judge\", \"Bryce Harper\", \"Mookie Betts\", \n", " \"Jacob deGrom\", \"Clayton Kershaw\", \"Juan Soto\", \"Ronald Acuña Jr.\", \"Trea Turner\", \n", " \"Nolan Arenado\", \"Freddie Freeman\", \"Max Scherzer\", \"Justin Verlander\", \n", " \"Gerrit Cole\", \"Francisco Lindor\", \"Corey Seager\", \"Manny Machado\", \"Yadier Molina\", \n", "\n", " # Hockey (NHL)\n", " \"Wayne Gretzky\", \"Sidney Crosby\", \"Alex Ovechkin\", \"Connor McDavid\", \n", " \"Nathan MacKinnon\", \"Auston Matthews\", \"Patrick Kane\", \"Jonathan Toews\", \n", " \"Carey Price\", \"Igor Shesterkin\", \"Cale Makar\", \"Steven Stamkos\", \n", " \"Victor Hedman\", \"Leon Draisaitl\", \"Jack Eichel\", \"Matthew Tkachuk\", \n", "\n", " # Gymnastics\n", " \"Simone Biles\", \"Gabby Douglas\", \"Aly Raisman\", \"Jade Carey\", \n", " \"Sunisa Lee\", \"Laurie Hernandez\", \"McKayla Maroney\", \"Katelyn Ohashi\", \n", " \"Nastia Liukin\", \"Shawn Johnson\", \n", "\n", " # Other Sports\n", " \"Chloe Kim (Snowboarding)\", \"Shaun White (Snowboarding)\", \"Lindsey Vonn (Skiing)\", \n", " \"Mikaela Shiffrin (Skiing)\", \"Nathan Chen (Figure Skating)\", \"Evan Lysacek (Figure Skating)\", \n", " \"Sydney McLaughlin (Track)\", \"Katie Zaferes (Triathlon)\", \"Maggie Nichols (Gymnastics)\", \n", " \"April Ross (Beach Volleyball)\", \"Kerri Walsh Jennings (Beach Volleyball)\",\n", "\n", " # Lifestyle and Fashion Influencers\n", " \"Emma Chamberlain\", \"Chiara Ferragni\", \"Camila Coelho\", \"Negin Mirsalehi\", \"Julie Sariñana\", \n", " \"Danielle Bernstein\", \"Aimee Song\", \"Lauren Conrad\", \"Nicole Guerriero\", \"Chriselle Lim\", \n", " \"Raven Elyse\", \"Amber Fillerup Clark\", \"Jenn Im\", \"Caitlin Covington\", \"Tess Christine\", \n", " \"Sivan Ayla\", \"Arielle Charnas\", \"Julia Engel\", \"Kelsey Simone\", \"Jackie Aina\", \n", " \"Marianna Hewitt\", \"Rachel Parcell\", \"Jacey Duprie\", \"Brittany Xavier\", \"Claire Marshall\", \n", " \"Tezza Barton\", \"Sarah Ashcroft\", \"Alisha Marie\", \"Remi Cruz\", \"Ashley Brooke\",\n", "\n", " # Beauty Influencers\n", " \"James Charles\", \"Nikkie de Jager (NikkieTutorials)\", \"Huda Kattan\", \"Manny MUA\", \n", " \"Jeffree Star\", \"Patrick Starrr\", \"Jackie Aina\", \"Tati Westbrook\", \"Kathleen Lights\", \n", " \"Carli Bybel\", \"Bretman Rock\", \"Desi Perkins\", \"Iluvsarahii\", \"Christen Dominique\", \n", " \"RawBeautyKristi\", \"Jkissa\", \"RCL Beauty101\", \"Chloe Morello\", \"Sophia Esperanza\", \n", " \"Michelle Phan\", \"Cindy Kimberly\", \"Abby Roberts\", \"Eleanor Barnes (Snitchery)\", \n", " \"Melissa Alatorre\", \"Aliss Bonython\", \"Amrezy\", \"Kaitlyn Bristowe\", \"Pony Syndrome\", \n", " \"Leah Halton\", \"Soph Does Nails\", \"Nabela Noor\",\n", "\n", " # Fitness Influencers\n", " \"Chloe Ting\", \"Whitney Simmons\", \"Cassey Ho (Blogilates)\", \"Joe Wicks\", \n", " \"Kayla Itsines\", \"Pamela Reif\", \"Emily Skye\", \"Kelsey Wells\", \"Brittany Dawn\", \n", " \"Massy Arias\", \"Nikki Blackketter\", \"Sami Clarke\", \"Cydney Gillon\", \"Courtney King\", \n", " \"Jeff Nippard\", \"Chris Heria\", \"Amanda Bisk\", \"Anna Victoria\", \"Rachel Brathen (Yoga Girl)\", \n", " \"Stefanie Cohen\", \"Steve Cook\", \"Alex Toussaint\", \"Robin Arzón\", \"Ally Love\", \n", " \"Tunde Oyeneyin\", \"Remi Ishizuka\", \"Lauren Simpson\", \"Hannah Bower\", \"Ashleigh Jordan\",\n", "\n", " # Food Influencers\n", " \"Gordon Ramsay\", \"Molly Yeh\", \"Rosanna Pansino\", \"Andrew Rea (Binging with Babish)\", \n", " \"Tasty\", \"Half Baked Harvest (Tieghan Gerard)\", \"Joshua Weissman\", \"Delish\", \n", " \"The Pioneer Woman (Ree Drummond)\", \"Yumna Jawad (Feel Good Foodie)\", \"Munchies\", \n", " \"Claire Saffitz\", \"Erwan Heussaff\", \"Laura Vitale\", \"Rachael Ray\", \"Sohla El-Waylly\", \n", " \"Damn Delicious (Chungah Rhee)\", \"Eitan Bernath\", \"The Woks of Life\", \"Binging with Babish\", \n", " \"Preppy Kitchen (John Kanell)\", \"Honeysuckle (Dzung Lewis)\", \"Brothers Green Eats\", \n", " \"Minimalist Baker (Dana Shultz)\", \"Tasty\", \"My Healthy Dish\", \"Skinnytaste (Gina Homolka)\", \n", " \"Jessica in the Kitchen\", \"Deliciously Ella\", \"Jocelyn Delk Adams (Grandbaby Cakes)\", \n", " \"Fit Men Cook (Kevin Curry)\",\n", "\n", " # Tech Influencers\n", " \"Marques Brownlee (MKBHD)\", \"Linus Sebastian (Linus Tech Tips)\", \"Austin Evans\", \n", " \"Unbox Therapy (Lewis George Hilsenteger)\", \"Dave Lee (Dave2D)\", \"iJustine\", \n", " \"Jonathan Morrison (TLD)\", \"Sara Dietschy\", \"Marques Brownlee\", \"TechMeOut\", \n", " \"TechnoBuffalo\", \"Linus Tech Tips\", \"Mrwhosetheboss\", \"Casey Neistat\", \"Justine Ezarik\", \n", " \"JerryRigEverything\", \"Dave Lee\", \"Joanna Stern\", \"Michael Fisher (MrMobile)\", \n", " \"Jon Rettinger\", \"DetroitBORG\", \"Ali Abdaal\", \"Andru Edwards\", \"Snazzy Labs\", \n", " \"TechLinked\", \"Brandon Butch\", \"Kevin Stratvert\", \"Supersaf\", \"UACrew\", \"Rene Ritchie\",\n", "\n", " # Comedy Influencers\n", " \"Lilly Singh\", \"Lele Pons\", \"King Bach\", \"Amanda Cerny\", \"Rudy Mancuso\", \n", " \"David Dobrik\", \"Logan Paul\", \"Jake Paul\", \"Anwar Jibawi\", \"Zach King\", \n", " \"Gabriel Iglesias\", \"Kevin Hart\", \"Chris D'Elia\", \"Bo Burnham\", \"Trevor Wallace\", \n", " \"Sarah Cooper\", \"Shane Dawson\", \"Ryan Higa (Nigahiga)\", \"Ian Hecox (Smosh)\", \n", " \"Jenna Marbles\", \"Liza Koshy\", \"Markiplier\", \"PewDiePie\", \"MatPat (Game Theory)\", \n", " \"Vsauce\", \"Danny Gonzalez\", \"Drew Gooden\", \"Cody Ko\", \"Noel Miller\", \n", " \"Kurtis Conner\", \"Nikita Dragun\",\n", "\n", " # TikTok Stars\n", " \"Charli D'Amelio\", \"Addison Rae\", \"Bella Poarch\", \"Loren Gray\", \"Dixie D'Amelio\", \n", " \"Bryce Hall\", \"Avani Gregg\", \"Noah Beck\", \"Josh Richards\", \"Nikita Dragun\", \n", " \"Michael Le (JustMaiko)\", \"Zoe LaVerne\", \"Griffin Johnson\", \"Vinnie Hacker\", \n", " \"Chase Hudson (Lil Huddy)\", \"Nessa Barrett\", \"Anwar Jibawi\", \"Madi Monroe\", \n", " \"Anna Shumate\", \"Quinton Griggs\", \"Spencer X\", \"Khaby Lame\", \"Nick Austin\", \n", " \"Ryland Storms\", \"Brooklyn and Bailey\", \"Montana Tucker\", \"Tayler Holder\", \n", " \"Brent Rivera\", \"Lexi Rivera\", \"Pierson Wodzynski\", \n", "\n", " # YouTube Stars\n", " \"MrBeast\", \"Dude Perfect\", \"Markiplier\", \"Nikita Dragun\", \"Emma Chamberlain\", \n", " \"Casey Neistat\", \"Logan Paul\", \"Jake Paul\", \"David Dobrik\", \"Shane Dawson\", \n", " \"Lilly Singh\", \"Smosh\", \"PewDiePie\", \"Zoella\", \"NikkieTutorials\", \n", " \"James Charles\", \"Jenna Marbles\", \"Ryan Higa\", \"Tana Mongeau\", \"Colleen Ballinger\", \n", " \"Liza Koshy\", \"Tyler Oakley\", \"Superwoman\", \"Anthony Padilla\", \"H3H3 Productions\", \n", " \"Philip DeFranco\", \"Vsauce\", \"Gabbie Hanna\", \"Manny MUA\", \"Bretman Rock\",\n", "\n", " # Miscellaneous\n", " \"Trevor Noah\", \"Bretman Rock\", \"Huda Kattan\", \"Casey Neistat\", \"JoJo Siwa\", \n", " \"Amanda Steele\", \"PewDiePie\", \"Emma Chamberlain\", \"Marques Brownlee\", \"Jeffree Star\",\n", "\n", " # Science and Technology\n", " \"What is quantum physics\", \"How do black holes form\", \"What is the theory of relativity\", \n", " \"How does Wi-Fi work\", \"What is artificial intelligence\", \"What is machine learning\", \n", " \"How does 5G technology work\", \"What is the Internet of Things\", \"What is blockchain technology\", \n", " \"How does cryptocurrency work\", \"What is virtual reality\", \"What is augmented reality\", \n", " \"How do electric cars work\", \"What is renewable energy\", \"What is nuclear fusion\", \n", " \"How do solar panels work\", \"What is genetic engineering\", \"What is CRISPR\", \n", " \"How does GPS work\", \"What is cloud computing\", \"What is a quantum computer\", \n", " \"How do vaccines work\", \"What is herd immunity\", \"What is the immune system\", \n", " \"How does DNA work\", \"What are stem cells\", \"What causes earthquakes\", \n", " \"How do volcanoes form\", \"What is plate tectonics\", \"How does the water cycle work\", \n", " \"What is global warming\", \"What are greenhouse gases\", \"How do hurricanes form\", \n", " \"What is the Big Bang theory\", \"How does gravity work\", \"What are exoplanets\", \n", " \"What is dark matter\", \"What is dark energy\", \"What are gravitational waves\",\n", "\n", " # History and Geography\n", " \"What caused World War I\", \"What caused World War II\", \"Who discovered America\", \n", " \"What is the history of the Roman Empire\", \"Who were the founding fathers\", \n", " \"What caused the Great Depression\", \"What was the Cold War\", \"What is the Industrial Revolution\", \n", " \"What is the Renaissance\", \"What is the history of the United States\", \n", " \"What caused the Civil War\", \"What is the history of slavery\", \"What is the history of democracy\", \n", " \"What are the Seven Wonders of the World\", \"What is the tallest mountain\", \n", " \"What is the longest river\", \"What is the largest desert\", \"What are the continents\", \n", " \"What is the smallest country\", \"What is the largest ocean\", \"What are the major oceans\", \n", " \"What are the Great Lakes\", \"What is the history of Europe\", \"What is the history of Asia\", \n", " \"What is the history of Africa\", \"What is the history of South America\", \n", " \"What is the history of Australia\", \"What is the history of Antarctica\", \n", " \"What is the history of space exploration\", \"What is the history of the moon landing\",\n", "\n", " # Health and Medicine\n", " \"What are the symptoms of diabetes\", \"What are the symptoms of heart disease\", \n", " \"What is depression\", \"What are the symptoms of anxiety\", \"What are the symptoms of ADHD\", \n", " \"What are the benefits of exercise\", \"What is a balanced diet\", \"What is cholesterol\", \n", " \"What are the effects of smoking\", \"What are the effects of alcohol\", \n", " \"What is mental health\", \"What is physical health\", \"What is holistic health\", \n", " \"What is mindfulness\", \"What is meditation\", \"What is yoga\", \n", " \"What are the benefits of sleep\", \"What causes insomnia\", \"What are the stages of sleep\", \n", " \"What are the benefits of drinking water\", \"What is intermittent fasting\", \n", " \"What are the symptoms of COVID-19\", \"What are the benefits of vaccines\", \n", " \"What is the difference between a virus and bacteria\", \"What is the common cold\", \n", " \"What is the flu\", \"What is cancer\", \"What is chemotherapy\", \n", " \"What are the symptoms of stroke\", \"What causes high blood pressure\", \n", " \"What is the treatment for migraines\", \"What is a food allergy\",\n", "\n", " # General Knowledge and Curiosities\n", " \"What is the meaning of life\", \"What is philosophy\", \"What is ethics\", \n", " \"What is morality\", \"What are the laws of physics\", \"What are the principles of mathematics\", \n", " \"What is the history of language\", \"What is the history of writing\", \n", " \"What is the history of art\", \"What is the history of music\", \n", " \"What are the major religions\", \"What is Christianity\", \"What is Islam\", \n", " \"What is Buddhism\", \"What is Hinduism\", \"What is Judaism\", \n", " \"What is atheism\", \"What is agnosticism\", \"What is astrology\", \n", " \"What is astronomy\", \"What is biology\", \"What is chemistry\", \n", " \"What is physics\", \"What is geology\", \"What is meteorology\", \n", " \"What is oceanography\", \"What is paleontology\", \"What is archaeology\", \n", " \"What is anthropology\", \"What is sociology\", \"What is psychology\", \n", " \"What is economics\", \"What is political science\", \"What is law\", \n", " \"What is business\", \"What is marketing\", \"What is management\",\n", "\n", " # Technology and Innovation\n", " \"What is social media\", \"What is Facebook\", \"What is Instagram\", \n", " \"What is Twitter\", \"What is TikTok\", \"What is YouTube\", \n", " \"What is a smartphone\", \"What is an operating system\", \n", " \"What is a computer virus\", \"What is cybersecurity\", \"What is artificial intelligence\", \n", " \"What is a chatbot\", \"What is a search engine\", \"What is e-commerce\", \n", " \"What is online banking\", \"What is mobile payment\", \"What is a cryptocurrency wallet\", \n", " \"What is a self-driving car\", \"What is a smart home\", \"What is a 3D printer\", \n", " \"What is a drone\", \"What is a robot\", \"What is a space telescope\", \n", " \"What is a satellite\", \"What is the International Space Station\", \n", " \"What is Mars exploration\", \"What is a lunar rover\",\n", "\n", " # Arts and Culture\n", " \"What is classical music\", \"What is jazz\", \"What is rock music\", \n", " \"What is hip hop\", \"What is pop music\", \"What is country music\", \n", " \"What is electronic music\", \"What is reggae\", \"What is blues\", \n", " \"What is opera\", \"What is ballet\", \"What is contemporary dance\", \n", " \"What is theater\", \"What is literature\", \"What are the major literary genres\", \n", " \"What is poetry\", \"What is prose\", \"What is drama\", \"What is a novel\", \n", " \"What is a short story\", \"What is a play\", \"What is a musical\", \n", " \"What are the major art movements\", \"What is surrealism\", \"What is cubism\", \n", " \"What is impressionism\", \"What is modernism\", \"What is postmodernism\",\n", "\n", " # Nature and Environment\n", " \"What are ecosystems\", \"What are biomes\", \"What is a rainforest\", \n", " \"What is a desert\", \"What is a tundra\", \"What is an ocean\", \n", " \"What is a coral reef\", \"What is a mountain range\", \"What is a river basin\", \n", " \"What are wetlands\", \"What is biodiversity\", \"What are endangered species\", \n", " \"What is conservation\", \"What is deforestation\", \"What is reforestation\", \n", " \"What are national parks\", \"What is the greenhouse effect\", \n", " \"What is climate change\", \"What is global warming\", \"What is sustainable development\",\n", "\n", " # Common nouns\n", " \"city\", \"country\", \"river\", \"mountain\", \"lake\", \"ocean\",\n", " \"history\", \"population\", \"language\", \"philosophy\", \"justice\", \n", " \"idea\", \"belief\", \"thought\", \"sky\", \"star\", \"volcano\", \n", " \"tree\", \"animal\", \"bird\", \"book\", \"clock\", \"computer\", \n", " \"school\", \"student\", \"teacher\", \"scientist\", \n", "\n", " # general medical terms\n", " \"symptoms\", \"diagnosis\", \"treatment\", \"prevention\", \"prognosis\",\n", " \"risk factors\", \"complications\", \"chronic\", \"acute\", \"infection\",\n", " \"inflammation\", \"allergy\", \"immunity\", \"vaccine\", \"side effects\",\n", " \"therapy\", \"surgery\", \"rehabilitation\", \"recovery\", \"anesthesia\",\n", " \"specialist\", \"primary care\", \"emergency\", \"ICU\", \"outpatient\",\n", " \"inpatient\", \"referral\", \"second opinion\", \"medical history\",\n", " \"prescription\", \"over-the-counter\", \"placebo\", \"clinical trial\",\n", " \"medical imaging\", \"MRI\", \"CT scan\", \"ultrasound\", \"x-ray\",\n", "\n", " # common symptoms\n", " \"fever\", \"cough\", \"cold\", \"headache\", \"nausea\", \"vomiting\",\n", " \"diarrhea\", \"dizziness\", \"fatigue\", \"chills\", \"rash\",\n", " \"pain\", \"swelling\", \"shortness of breath\", \"chest pain\",\n", " \"itching\", \"sore throat\", \"joint pain\", \"muscle pain\", \"cramps\",\n", " \"loss of taste\", \"loss of smell\", \"blurred vision\", \"hearing loss\",\n", " \"bleeding\", \"weakness\", \"tingling\", \"numbness\", \"weight loss\",\n", " \"weight gain\", \"insomnia\", \"night sweats\", \"abdominal pain\",\n", " \"constipation\", \"heartburn\", \"bloating\", \"confusion\",\n", "\n", " # common conditions\n", " \"diabetes\", \"hypertension\", \"asthma\", \"arthritis\", \"allergies\",\n", " \"obesity\", \"depression\", \"anxiety\", \"migraine\", \"epilepsy\",\n", " \"insomnia\", \"anemia\", \"thyroid disorder\", \"acid reflux\",\n", " \"COPD\", \"osteoporosis\", \"gout\", \"eczema\", \"psoriasis\",\n", " \"UTI\", \"high cholesterol\", \"vitamin deficiency\", \"heart disease\",\n", " \"stroke\", \"heart attack\", \"liver disease\", \"kidney stones\",\n", " \"gallstones\", \"irritable bowel syndrome (IBS)\", \"GERD\",\n", " \"celiac disease\", \"autoimmune disease\", \"sepsis\", \"seizures\",\n", " \"pneumonia\", \"bronchitis\", \"sinusitis\", \"chronic pain\",\n", "\n", " # infectious diseases\n", " \"COVID-19\", \"flu\", \"common cold\", \"HIV/AIDS\", \"tuberculosis\",\n", " \"hepatitis A\", \"hepatitis B\", \"hepatitis C\", \"dengue fever\",\n", " \"malaria\", \"measles\", \"mumps\", \"rubella\", \"chickenpox\",\n", " \"shingles\", \"herpes\", \"HPV\", \"mononucleosis\", \"strep throat\",\n", " \"E. coli\", \"salmonella\", \"Zika virus\", \"Ebola virus\",\n", " \"RSV (respiratory syncytial virus)\", \"Lyme disease\",\n", " \"rabies\", \"H1N1\", \"norovirus\", \"rotavirus\", \"pertussis (whooping cough)\",\n", "\n", " # chronic diseases\n", " \"diabetes\", \"hypertension\", \"chronic kidney disease\", \"COPD\",\n", " \"heart failure\", \"rheumatoid arthritis\", \"Parkinson's disease\",\n", " \"Alzheimer's disease\", \"multiple sclerosis\", \"Crohn's disease\",\n", " \"ulcerative colitis\", \"chronic fatigue syndrome\", \"fibromyalgia\",\n", " \"chronic migraines\", \"cystic fibrosis\", \"sickle cell anemia\",\n", "\n", " # common cancers\n", " \"breast cancer\", \"lung cancer\", \"prostate cancer\", \"colorectal cancer\",\n", " \"skin cancer\", \"melanoma\", \"leukemia\", \"lymphoma\", \"brain cancer\",\n", " \"pancreatic cancer\", \"ovarian cancer\", \"cervical cancer\",\n", " \"testicular cancer\", \"thyroid cancer\", \"liver cancer\", \"esophageal cancer\",\n", " \"stomach cancer\", \"bone cancer\", \"sarcoma\", \"oral cancer\",\n", "\n", " # mental health conditions\n", " \"depression\", \"anxiety\", \"bipolar disorder\", \"schizophrenia\",\n", " \"OCD (obsessive-compulsive disorder)\", \"PTSD (post-traumatic stress disorder)\",\n", " \"ADHD\", \"autism spectrum disorder\", \"eating disorders\", \"anorexia nervosa\",\n", " \"bulimia nervosa\", \"binge eating disorder\", \"panic disorder\",\n", " \"social anxiety disorder\", \"phobias\", \"dissociative identity disorder\",\n", " \"borderline personality disorder\",\n", "\n", " # rare diseases\n", " \"ALS (amyotrophic lateral sclerosis)\", \"Huntington's disease\",\n", " \"Lupus\", \"scleroderma\", \"Marfan syndrome\", \"Ehlers-Danlos syndrome\",\n", " \"Tay-Sachs disease\", \"Gaucher disease\", \"Fabry disease\",\n", " \"Duchenne muscular dystrophy\", \"myasthenia gravis\", \"Prader-Willi syndrome\",\n", " \"Angelman syndrome\", \"Charcot-Marie-Tooth disease\",\n", "\n", " # womens health\n", " \"menstruation\", \"pregnancy\", \"fertility\", \"menopause\", \"PCOS (polycystic ovary syndrome)\",\n", " \"endometriosis\", \"gestational diabetes\", \"pre-eclampsia\", \"miscarriage\",\n", " \"postpartum depression\", \"breastfeeding\", \"fibroids\", \"ovarian cysts\",\n", " \"cervical dysplasia\", \"HPV infection\", \"pelvic inflammatory disease (PID)\",\n", "\n", " # childhood illnesses\n", " \"chickenpox\", \"measles\", \"mumps\", \"rubella\", \"RSV (respiratory syncytial virus)\",\n", " \"whooping cough\", \"hand-foot-and-mouth disease\", \"ear infections\",\n", " \"scarlet fever\", \"croup\", \"strep throat\", \"fifth disease\",\n", " \"Kawasaki disease\", \"bronchiolitis\", \"teething issues\",\n", "\n", " # emrgency conditions\n", " \"heart attack\", \"stroke\", \"sepsis\", \"anaphylaxis\", \"asthma attack\",\n", " \"heat stroke\", \"hypothermia\", \"poisoning\", \"drowning\", \"seizures\",\n", " \"burns\", \"fractures\", \"traumatic brain injury\", \"cardiac arrest\",\n", " \"shock\", \"severe dehydration\",\n", " \n", " # general technology terms\n", " \"artificial intelligence\", \"machine learning\", \"cloud computing\", \n", " \"blockchain\", \"cryptocurrency\", \"virtual reality\", \"augmented reality\", \n", " \"Internet of Things\", \"big data\", \"cybersecurity\", \"data privacy\", \n", " \"5G technology\", \"VPN\", \"cloud storage\", \"edge computing\", \n", " \"DevOps\", \"microservices\", \"API\", \"operating system\", \"open source\",\n", " \"data science\", \"automation\", \"autonomous vehicles\", \"quantum computing\",\n", " \"deep learning\", \"software as a service (SaaS)\",\n", " \n", " # software applications\n", " \"Microsoft Office\", \"Zoom\", \"Slack\", \"Google Drive\", \n", " \"Adobe Photoshop\", \"Figma\", \"Canva\", \"AutoCAD\", \"Final Cut Pro\",\n", " \"QuickBooks\", \"Notion\", \"Trello\", \"Asana\", \"Spotify\", \n", " \"Netflix\", \"YouTube\", \"TikTok\", \"Instagram\", \"Facebook\", \n", " \"Twitter\", \"Snapchat\", \"LinkedIn\", \"WhatsApp\", \"Discord\",\n", " \"VS Code\", \"IntelliJ IDEA\", \"Eclipse\", \"Microsoft Teams\", \n", " \"iMovie\", \"GarageBand\", \"GIMP\",\n", "\n", " # programming terms\n", " \"Python\", \"JavaScript\", \"Java\", \"C++\", \"C#\", \"Swift\", \n", " \"Ruby\", \"Kotlin\", \"Rust\", \"PHP\", \"SQL\", \"HTML\", \"CSS\", \n", " \"React\", \"Angular\", \"Vue.js\", \"Node.js\", \"Django\", \n", " \"Flask\", \"TensorFlow\", \"PyTorch\", \"Docker\", \"Kubernetes\", \n", " \"AWS\", \"Azure\", \"Google Cloud\", \"GitHub\", \"GitLab\", \n", " \"API development\", \"REST API\", \"GraphQL\", \"CI/CD pipelines\",\n", "\n", " # cyber security terms\n", " \"password manager\", \"firewall\", \"antivirus software\", \n", " \"multi-factor authentication\", \"ransomware\", \"phishing attacks\", \n", " \"data breach\", \"malware\", \"spyware\", \"DDoS attack\", \n", " \"encryption\", \"endpoint security\", \"zero trust architecture\",\n", " \"dark web\", \"ethical hacking\", \"cybersecurity certifications\", \n", " \"identity theft\", \"dark web monitoring\", \"social engineering\", \n", " \"VPN services\", \"privacy laws\", \"GDPR\", \"CCPA\",\n", "\n", " # trends and innovations\n", " \"ChatGPT\", \"Generative AI\", \"Tesla autopilot\", \n", " \"Metaverse\", \"NFTs\", \"self-driving cars\", \n", " \"electric vehicles\", \"AR glasses\", \"robotics\", \n", " \"3D printing\", \"smart cities\", \"renewable energy tech\", \n", " \"biometric authentication\", \"wearable tech\", \n", " \"voice recognition\", \"personalized medicine technology\", \n", " \"quantum computing breakthroughs\", \"fusion energy\", \n", " \"cloud gaming\", \"AI ethics\", \"neural networks\",\n", "\n", " # gaming and entertainment\n", " \"Fortnite\", \"Minecraft\", \"Call of Duty\", \"Valorant\", \n", " \"League of Legends\", \"Elden Ring\", \"Cyberpunk 2077\", \n", " \"Overwatch\", \"Roblox\", \"Among Us\", \"GTA V\", \n", " \"The Legend of Zelda\", \"Animal Crossing\", \"FIFA\", \"Madden NFL\", \n", " \"eSports\", \"streaming platforms\", \"Twitch\", \"YouTube Gaming\", \n", " \"game development tools\", \"Unreal Engine\", \"Unity\", \n", " \"VR gaming\", \"Steam\", \"Epic Games Store\",\n", "\n", " # cloud and data\n", " \"AWS\", \"Google Cloud\", \"Microsoft Azure\", \n", " \"cloud storage\", \"cloud migration\", \"data lake\", \n", " \"data warehouse\", \"data analytics\", \"machine learning models\", \n", " \"serverless architecture\", \"edge computing\", \n", " \"data visualization tools\", \"Tableau\", \"Power BI\", \n", " \"BigQuery\", \"Snowflake\", \"data pipeline\", \n", " \"real-time data processing\", \"ETL process\",\n", "\n", " # tech giants\n", " \"Apple\", \"Google\", \"Amazon\", \"Microsoft\", \"Meta\", \n", " \"Tesla\", \"Netflix\", \"Nvidia\", \"Intel\", \"AMD\", \n", " \"SpaceX\", \"Blue Origin\", \"Samsung\", \"Sony\", \"Dell\", \n", " \"HP\", \"IBM\", \"Cisco\", \"Salesforce\", \"Oracle\",\n", " \n", " # science and space\n", " \"NASA\", \"SpaceX\", \"astronomy\", \"astrophysics\", \"black holes\", \n", " \"quantum physics\", \"the Big Bang theory\", \"Mars exploration\", \n", " \"moon landing\", \"James Webb Telescope\", \"Hubble Telescope\", \n", " \"gravitational waves\", \"dark matter\", \"dark energy\", \n", " \"International Space Station\", \"space tourism\", \"solar system\", \n", " \"exoplanets\", \"Milky Way galaxy\", \"cosmic microwave background\", \n", " \"physics laws\", \"DNA structure\", \"CRISPR\", \"genetic engineering\", \n", " \"stem cells\", \"evolution\", \"paleontology\", \"geology\", \n", " \"oceanography\", \"meteorology\", \"climate change\", \"global warming\",\n", "\n", " # history and events\n", " \"American Revolution\", \"Civil War\", \"World War I\", \n", " \"World War II\", \"Cold War\", \"Great Depression\", \n", " \"Industrial Revolution\", \"9/11 attacks\", \"Pearl Harbor\", \n", " \"Civil Rights Movement\", \"Boston Tea Party\", \"the New Deal\", \n", " \"Vietnam War\", \"Korean War\", \"Apollo 11\", \"Watergate scandal\", \n", " \"Trail of Tears\", \"Women’s suffrage movement\", \n", " \"Prohibition era\", \"Manhattan Project\", \"Space Race\", \n", " \"Gold Rush\", \"founding of America\", \"Declaration of Independence\", \n", " \"Emancipation Proclamation\", \"Louisiana Purchase\", \n", " \"March on Washington\", \"Famous assassinations (JFK, MLK Jr.)\",\n", "\n", " # education and academics\n", " \"SAT preparation\", \"ACT study guides\", \"AP exams\", \n", " \"college application process\", \"scholarship opportunities\", \n", " \"student loans\", \"FAFSA\", \"Ivy League universities\", \n", " \"community colleges\", \"trade schools\", \"STEM education\", \n", " \"liberal arts programs\", \"online degrees\", \"vocational training\", \n", " \"education technology\", \"early childhood education\", \n", " \"special education programs\", \"school rankings\", \n", " \"teacher certifications\", \"homeschooling\", \n", " \"MOOCs (Massive Open Online Courses)\", \"edtech platforms\", \n", " \"study abroad programs\", \"education reforms\", \n", " \"standardized testing\", \"extracurricular activities\",\n", "\n", " # finance and economy\n", " \"stock market\", \"cryptocurrency\", \"Bitcoin\", \"Ethereum\", \n", " \"personal finance\", \"budgeting\", \"retirement planning\", \n", " \"401(k)\", \"Roth IRA\", \"investment strategies\", \n", " \"mutual funds\", \"ETFs\", \"real estate market\", \n", " \"credit scores\", \"credit cards\", \"debt consolidation\", \n", " \"student loans\", \"mortgages\", \"auto loans\", \n", " \"inflation\", \"recession\", \"unemployment rates\", \n", " \"economic policies\", \"Federal Reserve\", \"GDP\", \n", " \"consumer spending\", \"tax filing\", \"tax deductions\", \n", " \"small business loans\", \"venture capital\", \n", " \"financial literacy resources\",\n", "\n", " # # health & fitness\n", " # \"nutrition\", \"exercise routines\", \"cardio workouts\", \n", " # \"strength training\", \"yoga\", \"pilates\", \"HIIT workouts\", \n", " # \"mental health\", \"stress management\", \"mindfulness\", \n", " # \"sleep hygiene\", \"weight loss programs\", \"diet plans\", \n", " # \"vegan diet\", \"keto diet\", \"intermittent fasting\", \n", " # \"hydration tips\", \"health apps\", \"calorie tracking\", \n", " # \"fitness trackers\", \"step challenges\", \"home gym equipment\", \n", " # \"physical therapy\", \"posture correction\", \"rehabilitation exercises\",\n", "\n", " # law, policies and legal\n", " \"constitutional rights\", \"Bill of Rights\", \"Supreme Court cases\", \n", " \"immigration laws\", \"tax laws\", \"labor laws\", \n", " \"intellectual property\", \"copyright laws\", \"patent filing\", \n", " \"civil rights\", \"criminal justice system\", \"gun control laws\", \n", " \"marriage laws\", \"environmental laws\", \"housing policies\", \n", " \"healthcare policies\", \"education reforms\", \"voting rights\", \n", " \"prison reform\", \"whistleblower protections\", \"consumer rights\",\n", "\n", " # social issues\n", " \"gender equality\", \"racial equality\", \"LGBTQ+ rights\", \n", " \"climate justice\", \"income inequality\", \"mental health awareness\", \n", " \"poverty alleviation\", \"access to education\", \"homelessness\", \n", " \"human trafficking\", \"substance abuse\", \"voter suppression\", \n", " \"child welfare\", \"domestic violence\", \"animal rights\", \n", " \"cyberbullying\", \"freedom of speech\", \"healthcare access\", \n", " \"workplace harassment\", \"data privacy concerns\",\n", "\n", " \n", " \n", "]\n", "\n", "information_examples_partial = [item for item in information_examples_partial if len(item) >4 ]\n", "\n", "yelp_examples_partial = [\n", " \"best pizza\", \"top restaurant\", \"gym near\", \"spa open\", \"mexican food\",\n", " \"coffee shop\", \"laundry near\", \"good places to eat\", \"sushi near\", \n", " \"hair salon\", \"nearby cafes\", \"local barbers\", \"laundry nearby\", \n", " \"hotel deals\", \"gym membership\", \"top dining spots\", \"top nightlife\",\n", " \"bakery nearby\", \"famous bars\", \"nearest grocery\", \"parking nearby\",\n", " \"family restaurants\", \"dog parks\", \"organic shops\", \"delis open\", \n", " \"live music bars\", \"seafood places\", \"bbq joints\", \"vegan options\",\n", " \"pet stores\", \"hardware stores\", \"movie theaters\", \"car wash\",\n", " \"home improvement\", \"paint stores\", \"dance studios\", \"music shops\",\n", " \"wine stores\", \"health stores\", \"barbecue spots\", \"dim sum places\",\n", " \"italian restaurants\", \"beach resorts\", \"karaoke bars\", \"juice bars\",\n", " \"top takeout\", \"electricians near\", \"plumbers\", \"rooftop bars\",\n", " \"restaurant\", \"hotel\", \"mall\", \"theater\", \n", " \"park\", \"market\", \"museum\", \"hospital\", \"office\",\n", " \"factory\", \"dentist\", \"doctor\", \"chef\",\n", "] + yelp_keywords_data\n", " \n", " \n", "weather_examples_partial = [\n", " \"weather tomorrow\", \"rain in\", \"temperature\", \"forecast for\", \"sunrise time\",\n", " \"storm warning\", \"rainy season\", \"hurricane update\", \"snow tomorrow\", \n", " \"today's climate\", \"UV index\", \"coldest day\", \"wind conditions\", \n", " \"humidity level\", \"current weather\", \"today’s temperature\", \n", " \"hourly forecast\", \"weather updates\", \"snowfall predictions\", \"wind speed\",\n", " \"high temperature\", \"freezing temperatures\", \"sunny days\", \"storm chances\", \n", " \"next week forecast\", \"weather map\", \"air quality\", \"heatwave warnings\",\n", " \"drought warnings\", \"fog advisory\", \"visibility levels\", \"temperature fluctuations\",\n", " \"sunset times\", \"tornado warning\", \"heat index\", \"lightning storms\",\n", " \"tropical storm\", \"hail prediction\", \"UV forecast\", \"rainfall accumulation\",\n", " \"barometric pressure\", \"seasonal forecast\", \"dew point\", \"morning mist\",\n", " \"typhoon forecast\", \"cyclone warnings\", \"climate trends\", \"polar vortex\",\n", " \"weekly weather outlook\", \"temperature drop\", \"clear skies forecast\", \"storm tracker\", \n", " \"today's rain probability\", \"overnight temperatures\", \"winter forecast\", \"heat advisory\", \n", " \"real feel temperature\", \"weather near me\", \"sunny spells\", \"cloud cover\", \"pollen count\", \n", " \"flood warnings\", \"weather tomorrow morning\", \"weather alert\", \"rain chance this evening\", \n", " \"cold front update\", \"frost warnings\", \"spring forecast\", \"evening temperature\", \n", " \"next 10 days weather\", \"weather radar\", \"weather history\", \"long-range forecast\", \n", " \"weekly temperature highs\", \"low visibility\", \"wind advisory\", \"morning frost\", \n", " \"real-time weather\", \"humidity forecast\", \"ice storm warning\", \"rain forecast today\", \n", " \"temperature variation\", \"fall forecast\", \"hourly rain chances\", \"summer heat predictions\", \n", " \"wind chill factor\", \"sunrise and sunset times\", \"gale warnings\", \"arctic blast\", \n", " \"light rain or showers\", \"severe weather alerts\", \"regional forecast\", \"tornado risk\", \n", " \"wind gust forecast\", \"chilly mornings\", \"monsoon season update\", \"muggy conditions\", \n", " \"foggy days\", \"weather conditions\", \"storm risk\", \"current climate conditions\", \n", " \"precipitation levels\", \"UV alert\", \"heatwave duration\", \"snow accumulation\", \"cold wave warning\", \n", " \"snow depth\", \"drizzle forecast\", \"evening showers\", \"freezing rain warning\", \"hot and humid\", \n", " \"dry spell\", \"local weather news\", \"snow squall warning\", \"storm outlook\", \"weather watch\", \n", " \"sunshine hours\", \"weather patterns\", \"damp conditions\", \"extreme heat forecast\", \n", " \"temperature records\", \"record high temperatures\", \"unseasonably warm\", \"wind direction\", \n", " \"monthly climate outlook\", \"extreme cold forecast\", \"falling temperatures\", \"temperature swings\", \n", " \"cyclone path\", \"current weather radar\", \"gusty winds\", \"cold temperatures tonight\", \"weather now\", \n", " \"latest snow forecast\", \"frost formation\", \"air quality levels\", \"seasonal weather trends\", \n", " \"afternoon thunderstorms\", \"nighttime temperatures\", \"freezing point\", \"global warming impact\", \n", " \"hail forecast\", \"humidity today\", \"wildfire weather conditions\", \"barometric trend\", \"snowfall totals\",\n", " \"rain\", \"wind\", \"sky\", \"cloud\", \"sun\", \"moon\", \"star\", \n", " \"ocean\", \"river\", \"lake\", \"sand\", \"volcano\", \"forest\", \n", " \"desert\", \"storm\", \"hurricane\", \"snow\", \"temperature\", \n", " \"climate\", \"season\", \"spring\", \"summer\", \"autumn\", \"winter\",\n", "]\n", "\n", "navigation_examples_partial = [\n", " \"login to my bank account\", \"open Facebook\", \"Amazon sign in\", \"Twitter homepage\", \n", " \"navigate to YouTube\", \"check Gmail login\", \"open Instagram\", \"eBay account login\",\n", " \"find Netflix homepage\", \"sign in to LinkedIn\", \"Pinterest account\", \n", " \"Reddit homepage\", \"Spotify login page\", \"access Google Drive\", \"open Zoom meeting\", \n", " \"Yahoo Mail login\", \"Hotmail account access\", \"Slack workspace sign in\", \n", " \"open Microsoft Teams\", \"navigate to Dropbox\", \"sign on to Salesforce\", \n", " \"WordPress admin login\", \"WhatsApp Web access\", \"navigate to Hulu\", \"Apple ID sign in\", \n", " \"sign into PayPal\", \"open Skype\", \"open Trello board\", \"find Evernote account\", \n", " \"Quora homepage\", \"sign in to Snapchat\", \"access to Reddit inbox\", \n", " \"sign into iCloud\", \"sign on to Asana\", \"Notion account access\", \"navigate to Medium\", \n", " \"Uber Eats sign in\", \"Grubhub login page\", \"Google Analytics login\", \n", " \"open Shopify store\", \"navigate to Etsy seller account\", \"Figma login\", \n", " \"open Venmo\", \"Twitch homepage\", \"access Outlook\", \"open Steam account\", \n", " \"navigate to Amazon Prime\", \"sign into Dropbox Paper\", \"Canvas student login\", \n", " \"sign on to Coursera\", \"Pluralsight login page\", \"open Basecamp\", \"open GitHub\", \n", " \"access my T-Mobile account\", \"find Verizon login\", \"navigate to AT&T website\", \n", " \"Walmart homepage\", \"open Best Buy\", \"sign into Chegg\", \"navigate to Khan Academy\", \n", " \"find Zillow homepage\", \"Redfin sign in\", \"Spotify Web access\", \n", " \"navigate to Robinhood\", \"Coinbase login\", \"Crypto.com sign on\", \"Etsy login\", \n", " \"find Airbnb login page\", \"navigate to Discord\", \"access Slack messages\", \n", " \"open Google Photos\", \"navigate to iTunes store\", \"Yelp homepage\", \"Craigslist login\", \n", " \"Home Depot account\", \"open Lowe's account\", \"sign in to Target\", \n", " \"access Dropbox Business\", \"find Udemy login\", \"Skillshare homepage\", \n", " \"Medium sign on\", \"navigate to Tumblr\", \"sign into TikTok\", \"GitLab login page\", \n", " \"open Binance account\", \"sign in to Adobe\", \"open Shopify admin\", \n", " \"navigate to Bank of America\", \"Chase bank login\", \"Wells Fargo online banking\", \n", " \"access Capital One account\", \"sign in to Square\", \"Google My Business login\", \n", " \"navigate to Fidelity\", \"sign into Vanguard\", \"sign on to TD Ameritrade\", \n", " \"open E*TRADE account\", \"American Express login\", \"Bank of America sign in\", \n", " \"H&R Block login\", \"TurboTax homepage\", \"QuickBooks sign in\", \"Dropbox team account\", \n", " \"Yahoo homepage\", \"open DuckDuckGo\", \"Wikipedia main page\", \"navigate to IMDb\", \n", " \"open BBC News\", \"CNN live access\", \"ESPN homepage\", \"navigate to WebMD\", \n", " \"access LinkedIn Learning\", \"open CNN Business\", \"Google Calendar login\", \n", " \"find Google News\", \"navigate to Reddit homepage\",\n", " \"Amazon customer support\", \"Netflix help center\", \"contact PayPal support\", \n", " \"Spotify FAQs\", \"manage subscription on YouTube\", \"update profile settings on Facebook\", \n", " \"change payment method on Etsy\", \"privacy settings on Instagram\", \n", " \"explore new movies on Netflix\", \"latest tech deals on Amazon\", \n", " \"bestselling books on Kindle\", \"shop new arrivals on Zara\", \n", " \"track my order on Amazon\", \"eBay order status\", \"Uber Eats delivery status\", \n", " \"check FedEx shipment\", \"book tickets on Eventbrite\", \"movie showtimes on AMC\", \n", " \"upcoming events on Meetup\", \"openTable reservations\", \"live TV on Hulu\", \n", " \"watchlist on Disney+\", \"browse podcasts on Spotify\", \"explore documentaries on Prime Video\", \n", " \"my courses on Coursera\", \"learn Python on Udemy\", \"training portal on LinkedIn Learning\", \n", " \"online classes on Khan Academy\", \"shared documents on Google Drive\", \n", " \"files on OneDrive\", \"Dropbox shared folders\", \"recent uploads on Box\", \n", " \"view portfolio on Fidelity\", \"bill payment on PayPal\", \"credit score on Credit Karma\", \n", " \"investment dashboard on Robinhood\", \"browse topics on Reddit\", \n", " \"community forum on Stack Overflow\", \"support group on Facebook Groups\", \n", " \"Q&A on Quora\", \"manage trip on Expedia\", \"flight details on Delta\", \n", " \"vacation rentals on Airbnb\", \"car rental on Hertz\", \"find doctors on Zocdoc\", \n", " \"health articles on WebMD\", \"online appointment on Walgreens\", \n", " \"fitness tracker on Fitbit\",\n", " \"view Amazon Prime movies\", \"Google Photos backup access\", \"Facebook privacy settings\",\n", " \"manage HBO Max account\", \"Instagram explore page\", \"Reddit trending posts\",\n", " \"explore Apple Music playlists\", \"Twitter trending topics\", \"best deals on Walmart\",\n", " \"view account balance on Chase\", \"Prime Video watchlist\", \"Amazon Music account access\",\n", " \"Pinterest saved boards\", \"LinkedIn job postings\", \"Reddit community posts\",\n", " \"My Verizon account overview\", \"edit LinkedIn profile\", \"Facebook marketplace\",\n", " \"CNN top stories\", \"Spotify podcasts\", \"shop Walmart grocery\", \"Etsy order history\",\n", " \"check Apple iCloud storage\", \"Google One storage management\", \"manage Google subscriptions\",\n", " \"Disney Plus movie categories\", \"Uber driver login\", \"DoorDash customer service\",\n", " \"latest news on NPR\", \"Google Workspace admin login\", \"Facebook group discussions\",\n", " \"Pinterest trending pins\", \"GitHub repositories\", \"Google Maps recent searches\",\n", " \"YouTube playlist access\", \"Google Photos shared albums\", \"edit Amazon profile\",\n", " \"explore Fitbit dashboard\", \"open Google Keep notes\", \"Venmo transaction history\",\n", " \"Slack channel notifications\", \"Redfin housing market\", \"Google Assistant settings\",\n", " \"Microsoft Office online\", \"Facebook account activity log\", \"Reddit saved posts\",\n", " \"edit Spotify playlists\", \"latest releases on SoundCloud\", \"TikTok discover page\",\n", " \"Facebook memories\", \"edit Apple Music library\", \"Zillow property search\",\n", " \"check Grubhub rewards\", \"Netflix kids mode\", \"Instagram stories archive\",\n", " \"view Lyft ride history\", \"edit profile on Coursera\", \"Amazon gift card balance\",\n", " \"Dropbox folder sharing\", \"Eventbrite event discovery\", \"Google account security check\",\n", " \"Best Buy rewards access\", \"Google My Business analytics\", \"Twitter notifications\",\n", " \"manage Reddit subscriptions\", \"PayPal transaction history\", \"Google Books my library\",\n", " \"Walmart order tracker\", \"Craigslist free items section\", \"Microsoft Teams meetings\",\n", " \"Instagram saved posts\", \"Netflix account settings\", \"YouTube comment notifications\",\n", " \"Pinterest saved recipes\", \"Google Pay payment history\", \"Bing rewards dashboard\",\n", " \"My T-Mobile data usage\", \"Etsy store dashboard\", \"Microsoft 365 subscriptions\",\n", " \"YouTube upload page\", \"Google account backup options\", \"edit Amazon address book\",\n", " \"Audible library access\", \"Apple Wallet settings\", \"CNN live news updates\",\n", " \"Google Play Music playlists\", \"Reddit account preferences\", \"Uber trip receipts\",\n", " \"Notion workspace settings\", \"Pinterest boards management\", \"Dropbox recent activity\",\n", " \"Google Meet history\", \"find Hulu profile settings\", \"Google Analytics reports\",\n", " \"Quora inbox\", \"Twitter direct messages\", \"Slack user profiles\", \"LinkedIn news feed\",\n", " \"Google News trending\", \"Instagram explore reels\", \"BBC World News live\",\n", " \"access Google Authenticator\", \"Google Translate history\", \"manage Amazon wish list\",\n", " \"Apple Podcasts browse\", \"view Google Calendar invites\", \"edit Zoom profile picture\",\n", " \"login to Wells Fargo\", \"open Chase QuickPay\", \"access Capital One credit card\",\n", " \"find Fidelity 401k account\", \"view Merrill Lynch portfolio\", \"sign into Schwab account\",\n", " \"navigate to SoFi dashboard\", \"open Ally Bank login\", \"sign into Discover card account\",\n", " \"open CitiBank online\", \"access my US Bank account\", \"find Navy Federal login\",\n", " \"navigate to Truist Bank\", \"login to Regions Bank\", \"PNC online banking access\",\n", " \"open Robinhood app\", \"access my Vanguard funds\", \"open Acorns dashboard\",\n", " \"sign into Betterment\", \"login to Mint.com\", \"PayPal business account access\",\n", " \"navigate to Venmo transaction history\", \"login to Zelle\", \"access Cash App\",\n", " \"find Square dashboard\", \"open Stripe account\", \"login to QuickBooks Online\",\n", " \"access Xero accounting software\", \"navigate to Shopify admin\", \n", " \"login to Google Workspace\", \"find Google Admin console\", \"open Microsoft Azure portal\",\n", " \"access AWS Management Console\", \"navigate to Heroku dashboard\",\n", " \"login to GitHub Enterprise\", \"find Atlassian Jira login\", \"open Trello workspace\",\n", " \"access Asana tasks\", \"open Monday.com dashboard\", \"login to Basecamp\",\n", " \"navigate to Slack channels\", \"access Zoom recordings\", \"find Microsoft Teams workspace\",\n", " \"open Google Meet settings\", \"access WebEx meetings\", \"login to Dropbox Paper\",\n", " \"navigate to OneDrive Business\", \"find Google Drive shared folders\", \"open Notion workspace\",\n", " \"login to Evernote\", \"access Airtable base\", \"open Coda docs\",\n", " \"navigate to Box cloud storage\", \"find Adobe Creative Cloud\", \"login to Canva\",\n", " \"access Figma files\", \"open Sketch workspace\", \"navigate to InVision\",\n", " \"find Behance projects\", \"login to Dribbble profile\", \"access my Pinterest boards\",\n", " \"find Etsy store dashboard\", \"navigate to Amazon Seller Central\", \"open Walmart Marketplace\",\n", " \"access Target Circle rewards\", \"login to Home Depot Pro Xtra\", \"open Lowe's for Pros\",\n", " \"access Best Buy Totaltech\", \"navigate to Costco membership portal\", \"find Sam's Club login\",\n", " \"open Staples rewards\", \"access Office Depot account\", \"navigate to FedEx Delivery Manager\",\n", " \"login to UPS My Choice\", \"open USPS informed delivery\", \"access DHL tracking portal\",\n", " \"find Uber driver portal\", \"navigate to Lyft driver login\", \"open DoorDash merchant dashboard\",\n", " \"access Grubhub for Restaurants\", \"find Postmates Fleet login\", \"open Instacart Shopper app\",\n", " \"login to Shipt Shopper portal\", \"navigate to Rover pet sitters\", \"find Wag walker account\",\n", " \"open Care.com dashboard\", \"access TaskRabbit tasks\", \"find Fiverr seller login\",\n", " \"navigate to Upwork profile\", \"login to Freelancer.com\", \"access 99designs workspace\",\n", " \"open Toptal freelancer portal\", \"navigate to Indeed employer login\", \"find Glassdoor employer account\",\n", " \"open LinkedIn Recruiter\", \"login to AngelList Talent\", \"access Crunchbase profile\",\n", " \"navigate to Google Ads\", \"find Facebook Business Manager\", \"open Instagram Insights\",\n", " \"access TikTok for Business\", \"login to Twitter Ads Manager\", \"navigate to Pinterest Analytics\",\n", " \"open Snapchat Ads Manager\", \"find Reddit Ads dashboard\", \"access Amazon Advertising\",\n", " \"navigate to eBay Seller Hub\", \"open Etsy Ads Manager\", \"find Walmart Connect login\",\n", " \"access Shopify Marketing\", \"navigate to HubSpot CRM\", \"find Salesforce Marketing Cloud\",\n", " \"open Zoho CRM dashboard\", \"login to Pipedrive\", \"access Freshworks CRM\",\n", " \"navigate to Mailchimp campaigns\", \"find Constant Contact login\", \"open Campaign Monitor dashboard\",\n", " \"access Klaviyo account\", \"navigate to Drip marketing\", \"find ActiveCampaign login\",\n", " \"open SendGrid dashboard\", \"login to Twilio account\", \"access WhatsApp Business API\",\n", " \"navigate to Telegram channels\", \"open Discord server\", \"access Reddit community\",\n", " \"login to Twitch streamer portal\", \"navigate to YouTube Studio\", \"open Vimeo dashboard\",\n", " \"find Dailymotion login\", \"access Hulu Live TV\", \"navigate to Peacock homepage\",\n", " \"open Paramount Plus\", \"login to Discovery Plus\", \"access HBO Max profiles\",\n", " \"find Disney Plus Kids Mode\", \"navigate to Apple TV+\", \"open Netflix family account\",\n", " \"access Google TV settings\", \"find Roku Channel Store\", \"navigate to Amazon Fire TV\",\n", " \"login to Plex Media Server\", \"open Kodi settings\", \"access Sling TV lineup\",\n", " \"navigate to ESPN+ Live Sports\", \"open Fox Sports account\", \"access CBS All Access\",\n", " \"find NBC Sports login\", \"navigate to MLS Season Pass\", \"open NFL Sunday Ticket\",\n", " \"access NBA League Pass\", \"find MLB.tv homepage\", \"navigate to NHL.tv\",\n", " \"login to Peacock Sports\", \"access Spotify Premium\", \"navigate to SoundCloud Go+\",\n", " \"open Amazon Music Unlimited\", \"find Apple Music settings\", \"access Tidal HiFi\",\n", " \"navigate to Pandora Plus\", \"open iHeartRadio All Access\", \"access Audible library\",\n", " \"find OverDrive eBooks\", \"navigate to Libby app\", \"open Google Books\",\n", " \"login to Kindle Unlimited\", \"access Barnes & Noble Nook\", \"find Kobo eReader settings\",\n", " \"navigate to Chegg eTextbooks\", \"open Pearson MyLab\", \"access Coursera for Business\",\n", " \"navigate to edX Professional Certificate\", \"find LinkedIn Learning Paths\",\n", " \"open Skillshare Premium\", \"access Khan Academy Teacher Dashboard\",\n", " \"navigate to Duolingo Classroom\", \"find Babbel for Business login\", \"open Rosetta Stone settings\",\n", " \"access Berlitz Virtual Classroom\", \"navigate to Codecademy Pro\", \"find Udemy Business login\",\n", " \"open Pluralsight Skills\", \"access DataCamp for Teams\", \"navigate to Tableau eLearning\",\n", " \"find Power BI tutorials\", \"open Salesforce Trailhead\", \"access Google Cloud Training\",\n", " \"navigate to AWS Certification Hub\", \"find Microsoft Learn homepage\",\n", " \"go to Netflix homepage\", \"jump to Gmail inbox\", \"land on Facebook profile\", \n", " \"reach my bank dashboard\", \"launch Spotify Web Player\", \"head to Instagram DMs\",\n", " \"access my LinkedIn jobs\", \"dive into Dropbox files\", \"log back into Zoom account\",\n", " \"resume Slack messages\", \"continue Microsoft Teams call\", \"check Google Meet invites\",\n", " \"start streaming on Hulu\", \"fire up Disney Plus\", \"direct me to Apple TV settings\",\n", " \"relocate to Amazon login\", \"get to eBay watchlist\", \"retrieve Pinterest saved pins\",\n", " \"step into Reddit comments\", \"locate TikTok notifications\", \"teleport to Trello boards\",\n", " \"jumpstart Basecamp projects\", \"fetch Notion workspaces\", \"fast track to Coursera lessons\",\n", " \"open my GitHub repositories\", \"tap into Spotify playlist settings\", \n", " \"activate SoundCloud premium\", \"pull up my Google Calendar events\", \n", " \"snap back to Snapchat messages\", \"rewind to Netflix episode list\",\n", " \"unlock my Apple ID\", \"show me my Amazon orders\", \"review Gmail sent folder\", \n", " \"trace Etsy order tracking\", \"queue up Twitch live streams\", \n", " \"jump into Google Drive shared docs\", \"link to my PayPal wallet\", \n", " \"shortcut to TikTok discover feed\", \"bridge to Microsoft Outlook mail\", \n", " \"dock at Dropbox team account\", \"step into Evernote notebooks\", \n", " \"trace my Venmo transaction history\", \"pick up Spotify wrapped list\", \n", " \"shoot over to Reddit trending posts\", \"open Google Photos albums\", \n", " \"redirect to Shopify dashboard\", \"revive WordPress editor\", \n", " \"bookmark my Goodreads reading list\", \"restart Trello daily tasks\", \n", " \"return to Zillow saved homes\", \"visit my Lyft ride history\", \n", " \"map out Uber trip logs\", \"toggle to Fitbit fitness stats\", \n", " \"retrieve OneDrive shared links\", \"examine Pinterest analytics\", \n", " \"switch back to Slack channels\", \"restore GitLab issues\", \n", " \"cross into CNN live headlines\", \"pop into ESPN game scores\", \n", " \"load Instagram reels\", \"reach back to WhatsApp chat\", \n", " \"switch on Google Authenticator codes\", \"flip through Google Docs recent edits\", \n", " \"hitch onto Dropbox team space\", \"toggle Netflix parental controls\", \n", " \"stick to Amazon cart\", \"hover over Walmart pickup info\", \n", " \"skip back to PayPal balance\", \"circle back to Google Keep notes\", \n", " \"browse Amazon Prime video categories\", \"trace Spotify queue\", \n", " \"line up LinkedIn messages\", \"jog back to Facebook memories\", \n", " \"dock into YouTube history\", \"reconnect to Zoom call recordings\", \n", " \"swap into GitHub pull requests\", \"route back to Google Maps timeline\", \n", " \"set off Netflix subtitles page\", \"track LinkedIn news feed\", \n", " \"navigate home on Etsy dashboard\", \"run back to Twitch follower list\", \n", " \"lock onto my Airbnb bookings\", \"reroute to DoorDash account\", \n", " \"shuttle to Slack notification center\", \"switch over to Dropbox shared folder\",\n", " \"touch base on Hulu profiles\", \"arrive at Microsoft Azure portal\", \n", " \"send me back to Trello boards\", \"connect to T-Mobile billing portal\", \n", " \"rewind to Spotify premium benefits\", \"point to Reddit private messages\", \n", " \"spot my Fitbit sleep logs\", \"line up Zillow new listings\", \n", " \"push me to Apple Wallet settings\", \"cue up Google Meet recordings\", \n", " \"head back to Disney Plus movie categories\", \"restore Google Play account info\", \n", " \"revisit Audible audiobook library\", \"streamline Dropbox business files\", \n", " \"find my iPhone via iCloud\", \"adjust Venmo privacy settings\", \n", " \"follow Google Calendar reminders\", \"unlock Uber Eats saved locations\", \n", " \"queue Twitch subscription details\", \"resume Twitter trending stories\", \n", " \"cycle back to Target order tracker\", \"refresh Etsy payment methods\", \n", " \"access DoorDash saved addresses\", \"park at Dropbox upload history\", \n", " \"dive back into Amazon Music\", \"unlock Capital One credit history\", \n", " \"expand Slack sidebar\", \"load TikTok shared videos\", \n", " \"toggle between Spotify family accounts\", \"locate Google Workspace apps\", \n", " \"check Apple ID device list\", \"snap to WhatsApp voice messages\", \n", " \"ping Dropbox business folders\", \"start Gmail calendar integration\", \n", " \"zone into Zoom virtual backgrounds\", \"line up Netflix continue-watching list\", \n", " \"fast-track LinkedIn learning progress\", \"shuffle into Spotify podcast library\", \n", " \"take me to PayPal login portal\", \"boost Google One settings\", \n", " \"power on Disney Plus kids profiles\", \"make a shortcut to Quora drafts\", \n", " \"link to Instagram saved stories\", \"reset to Facebook ad manager\", \n", " \"retrieve my YouTube channel analytics\", \"cross over to Amazon delivery details\", \n", " \"dock on Hulu recent episodes\", \"pop up Reddit moderator tools\", \n", " \"trace Apple ID subscription details\", \"jumpstart LinkedIn recruiter tools\", \n", " \"switch on Twitter direct mentions\", \"bookmark HBO Max recent streams\", \n", " \"pin Evernote shared notes\", \"fast-forward Spotify discover playlists\", \n", " \"recover Zoom chat history\", \"zone into Fitbit dashboard\", \n", " \"cut to Google Maps saved routes\", \"track down Reddit profile info\", \n", " \"trace Netflix payment details\", \"trigger Hulu parental settings\", \n", " \"restore Etsy transaction history\", \"find Disney Plus sign-in page\", \n", " \"jump back to Airbnb saved stays\", \"pinpoint Target Circle rewards\", \n", " \"lock back to Zillow real estate trends\", \"link me to Amazon Alexa skills\",\n", " \"bring up Twitch drops page\", \"quick pull up Spotify equalizer settings\", \n", " \"nudge into eBay seller dashboard\", \"roll over to Hulu account details\", \n", " \"pick up Facebook notifications page\", \"route through Lyft shared rides\", \n", " \"dock into Canva project drafts\", \"rewind Reddit comment history\", \n", " \"fetch Microsoft Office online apps\", \"reopen Google Pay transaction records\", \n", " \"cue into Pinterest shopping pins\", \"bounce back to SoundCloud followers\", \n", " \"knit to Walmart mobile checkout\", \"open the Dropbox collaboration panel\", \n", " \"gear into Shopify fulfillment options\", \"step into my GitHub issues\", \n", " \"shift to Reddit personal chats\", \"spin up TikTok creator tools\", \n", " \"turn on my Disney Plus profiles\", \"land me on Hulu billing info\", \n", " \"jump into Snapchat recent snaps\", \"reopen Airbnb host settings\", \n", " \"pin onto my Lyft rider details\", \"align my Google Photos albums\", \n", " \"mount Dropbox file explorer\", \"flag Evernote pinned notes\", \n", " \"warp to Twitch streamer highlights\", \"shift Spotify private session mode\", \n", " \"browse Netflix family movies\", \"kick-start Google Calendar syncs\", \n", " \"funnel into Amazon wishlist tracker\", \"dig into Reddit poll results\", \n", " \"swipe Slack pinned messages\", \"flip Spotify favorites\", \n", " \"cross Netflix series updates\", \"sync to Fitbit daily activity logs\", \n", " \"retune my YouTube uploads\", \"set off Venmo shared expenses tracker\", \n", " \"realign Hulu group watch rooms\", \"dock into Google Workspace tools\",\n", " \"renew my driver's license online\", \"DMV appointment scheduler\", \"California DMV forms\",\n", " \"check New York DMV status\", \"apply for REAL ID online\", \"Texas driver's license renewal\",\n", " \"update vehicle registration\", \"replace lost license\", \"pay traffic ticket online\",\n", " \"check speeding ticket status\", \"Florida DMV login\", \"DMV learner's permit application\",\n", " \"schedule road test appointment\", \"find DMV office near me\", \"Illinois DMV online services\",\n", " \"submit emissions test results\", \"update license address\", \"vehicle title transfer form\",\n", " \"access DMV practice tests\", \"find my voter registration form\", \"register to vote online\",\n", " \"update voter registration\", \"find polling location\", \"track my absentee ballot\",\n", " \"apply for US passport online\", \"renew passport application\", \"lost passport replacement\",\n", " \"check passport appointment status\", \"DS-11 application form\", \"visa application form DS-160\",\n", " \"apply for US citizenship\", \"check green card application status\", \"track immigration case online\",\n", " \"find USCIS forms\", \"schedule USCIS biometrics appointment\", \"renew permanent resident card\",\n", " \"apply for asylum online\", \"check ESTA status\", \"pay USCIS fees online\", \"file I-130 petition\",\n", " \"file N-400 citizenship application\", \"access Social Security statement\", \"apply for SSN replacement\",\n", " \"check Medicare enrollment\", \"file unemployment benefits claim\", \"update unemployment claim status\",\n", " \"access state disability insurance\", \"apply for SNAP benefits\", \"check food stamps balance\",\n", " \"renew Medicaid application\", \"find Affordable Care Act plans\", \"apply for TANF benefits\",\n", " \"track child support payments\", \"file for child custody modification\", \"apply for Section 8 housing\",\n", " \"find federal housing programs\", \"check HUD foreclosure listings\", \"submit FAFSA application\",\n", " \"track FAFSA status\", \"find Pell Grant eligibility\", \"apply for student loan forgiveness\",\n", " \"check student loan repayment status\", \"access Parent PLUS loan application\",\n", " \"find IRS forms online\", \"file federal tax return\", \"track tax refund status\",\n", " \"find tax transcripts\", \"submit W-9 form\", \"apply for an EIN number\", \"file 1099 form online\",\n", " \"file state tax return\", \"check estimated tax payment status\", \"apply for tax extension\",\n", " \"access IRS identity verification\", \"find ITIN application form\", \"update my tax withholding\",\n", " \"apply for property tax exemption\", \"check state sales tax rates\", \"file use tax online\",\n", " \"find tax relief programs\", \"apply for utility bill assistance\", \"pay electricity bill online\",\n", " \"check gas bill statement\", \"find water bill payment portal\", \"apply for energy assistance\",\n", " \"submit meter reading online\", \"update utility account information\", \"report power outage\",\n", " \"schedule service reconnection\", \"find low-income energy programs\", \"file insurance claim online\",\n", " \"check car insurance policy\", \"access home insurance documents\", \"apply for life insurance benefits\",\n", " \"file health insurance appeal\", \"renew renters insurance policy\", \"update beneficiary information\",\n", " \"find accident claim status\", \"check flood insurance eligibility\", \"apply for business insurance\",\n", " \"pay mortgage online\", \"access loan modification forms\", \"file property lien release\",\n", " \"apply for mortgage pre-approval\", \"check credit report online\", \"dispute credit report errors\",\n", " \"find credit score report\", \"freeze my credit file\", \"apply for personal loan online\",\n", " \"submit small business loan application\", \"track SBA loan status\", \"apply for PPP loan forgiveness\",\n", " \"check bank account balance\", \"transfer funds between accounts\", \"report lost debit card\",\n", " \"order new checks online\", \"update account beneficiaries\", \"open a business checking account\",\n", " \"apply for home equity loan\", \"file fraud dispute online\", \"find FDIC insured banks\",\n", " \"apply for school enrollment\", \"track school application status\", \"find FAFSA application deadlines\",\n", " \"submit college transcripts\", \"find school district boundaries\", \"schedule parent-teacher conferences\",\n", " \"check school lunch menus\", \"access student attendance records\", \"file private school applications\",\n", " \"apply for IEP services\", \"track college admission status\", \"find SAT test dates\",\n", " \"register for ACT test\", \"find Common App login\", \"submit application fee waiver\",\n", " \"schedule college campus tour\", \"find dorm assignment details\", \"apply for work-study programs\",\n", " \"access my college financial aid portal\", \"find student portal login\", \"file residency reclassification form\",\n", " \"register for university classes\", \"find professor office hours\", \"submit academic appeal form\",\n", " \"pay parking ticket online\", \"file public records request\", \"submit FOIA request online\",\n", " \"apply for concealed carry permit\", \"renew hunting license\", \"register for fishing license\",\n", " \"find state parks pass application\", \"apply for veterans benefits\", \"track VA disability claim\",\n", " \"find VA forms online\", \"apply for GI Bill benefits\", \"access military records\",\n", " \"check Selective Service registration\", \"register for disaster assistance\",\n", " \"apply for FEMA benefits\", \"track FEMA application status\", \"submit disaster loan application\",\n", " \"find local FEMA offices\", \"apply for business permits online\", \"renew professional license\",\n", " \"file workplace discrimination claim\", \"check workers' compensation status\",\n", " \"find OSHA complaint form\", \"file wage theft complaint\", \"find labor law posters\",\n", " \"check WIC eligibility\", \"apply for Head Start programs\", \"find child care subsidies\",\n", " \"schedule doctor appointment online\", \"access telehealth portal\", \"renew driver's medical card\",\n", " \"submit disability parking application\", \"check ADA accommodation status\",\n", " \"apply for court records online\", \"file restraining order petition\", \"track divorce case status\",\n", " \"find small claims court forms\", \"apply for legal aid assistance\", \"find pro bono attorneys\",\n", " \"submit jury duty questionnaire\", \"check court hearing schedule\", \"access public defender services\",\n", " \"find state attorney general forms\", \"submit police report online\", \"find criminal background check forms\",\n", " \"renew firearm registration\", \"file firearm transfer forms\", \"check TSA PreCheck application status\",\n", " \"apply for Global Entry\", \"renew TSA Known Traveler Number\", \"find CLEAR enrollment status\",\n", " \"apply for Amtrak Guest Rewards\", \"check flight cancellation policies\", \"find airport TSA hours\",\n", " \"apply for local library card\", \"find library eBook portal\", \"access library digital resources\",\n", " \"track interlibrary loan status\", \"submit book purchase suggestion\", \"apply for volunteer positions\",\n", " \"find senior center activities\", \"register for community classes\", \"apply for homeless assistance\",\n", " \"find affordable childcare resources\", \"access neighborhood watch program\",\n", " # Tax-related forms and actions\n", " \"file IRS Form 1040\", \"download Form W-2\", \"apply for EIN online\", \n", " \"submit 1099-NEC form\", \"track federal tax refund\", \"file state tax return\", \n", " \"check estimated tax payments\", \"apply for tax extension online\", \n", " \"update tax withholding on IRS website\", \"access Form 8962 for premium tax credits\", \n", " \"correct filed tax return online\", \"request IRS tax transcripts\", \n", " \"report tax fraud to IRS\", \"apply for small business tax relief\", \n", " \"find IRS instructions for Schedule C\", \"pay quarterly estimated taxes online\",\n", "\n", " # Legal-related actions\n", " \"file a civil lawsuit online\", \"submit FOIA request form\", \"apply for restraining order online\", \n", " \"check court hearing schedule\", \"access small claims court forms\", \n", " \"apply for public defender services\", \"file a discrimination complaint\", \n", " \"report workplace harassment to EEOC\", \"submit police report online\", \n", " \"check criminal background online\", \"apply for power of attorney forms\", \n", " \"find legal aid for low-income families\", \"track immigration case status\", \n", " \"submit appeal for denied claims\", \"file for child custody modification\", \n", " \"apply for tenant's rights assistance\", \"submit consumer complaint to FTC\", \n", "\n", " # Anti-abuse and reporting\n", " \"report cyberbullying online\", \"file a complaint with IC3 for cybercrime\", \n", " \"report identity theft to FTC\", \"submit spam calls complaint to FCC\", \n", " \"file a claim for bank fraud online\", \"report phishing emails to banks\", \n", " \"report financial scams to SEC\", \"access National Center for Missing and Exploited Children website\", \n", " \"file domestic violence report online\", \"apply for stalking protection order\", \n", " \"report elder abuse in my state\", \"file a human trafficking report online\", \n", " \"submit internet safety tip to FBI\", \"report fake job scams online\",\n", "\n", " # Bank and financial fraud\n", " \"report lost or stolen credit card\", \"file bank fraud report online\", \n", " \"dispute credit card charges\", \"check FDIC claim status\", \n", " \"apply for fraud protection services\", \"block fraudulent transactions on PayPal\", \n", " \"file a chargeback request online\", \"report unauthorized debit transactions\", \n", " \"freeze credit through Equifax\", \"lock credit file through Experian\", \n", " \"file report of elder financial abuse\", \"access fraud department for Capital One\", \n", " \"dispute transaction with Chase bank\", \"report fraudulent Zelle payment\",\n", "\n", " # Government forms and services\n", " \"apply for Social Security card replacement\", \"access Medicare enrollment forms\", \n", " \"file unemployment benefits claim\", \"submit disability benefits application\", \n", " \"check SNAP eligibility online\", \"apply for WIC benefits\", \n", " \"find FEMA disaster relief forms\", \"submit voter registration online\", \n", " \"report government waste to GAO\", \"access OSHA workplace safety complaint form\", \n", " \"file whistleblower complaint online\", \"report corruption to Department of Justice\", \n", " \"apply for Affordable Care Act subsidies\", \"submit housing discrimination complaint\", \n", " \"track Section 8 housing application\", \"report workplace injuries online\",\n", " \"find online utility bill assistance forms\", \"apply for FEMA disaster loans\", \n", " \"report identity fraud to SSA\", \"track disability determination online\", \n", " \"access Department of Labor claims portal\", \"submit veterans benefits application\",\n", " # School-related actions\n", " \"apply for school enrollment online\", \"check school district boundaries\", \n", " \"submit parent-teacher conference form\", \"pay for school lunches online\", \n", " \"access student attendance records\", \"check school supply lists\", \n", " \"apply for special education services\", \"find PTA meeting schedule\", \n", " \"access online gradebook\", \"register for after-school programs\", \n", " \"pay school fees online\", \"download school event calendar\", \n", " \"submit absence excuse form\", \"apply for school transportation\", \n", " \"find classroom supply requests\", \"access teacher contact information\", \n", " \"request school transcript\", \"schedule a school counselor meeting\", \n", "\n", " # College application and admission\n", " \"access Common App portal\", \"apply for early decision online\", \n", " \"track college admission status\", \"submit SAT scores to colleges\", \n", " \"register for ACT test\", \"apply for college application fee waiver\", \n", " \"check college essay requirements\", \"find college admission deadlines\", \n", " \"schedule campus visit\", \"access college financial aid portal\", \n", " \"find scholarship opportunities\", \"submit FAFSA application\", \n", " \"track FAFSA status online\", \"apply for student work-study programs\", \n", " \"submit letters of recommendation\", \"access AP test score portal\",\n", "\n", " # Student services and resources\n", " \"log in to student portal\", \"register for college classes\", \n", " \"find professor office hours\", \"schedule academic advising appointment\", \n", " \"pay tuition fees online\", \"download class schedule\", \n", " \"apply for dormitory housing\", \"find roommate assignment\", \n", " \"check dining hall menu\", \"access campus map\", \n", " \"submit course withdrawal form\", \"apply for course overload approval\", \n", " \"find library hours\", \"access campus gym schedule\", \n", " \"log in to online learning platform\", \"track student loan repayment status\", \n", " \"request campus parking permit\", \"find textbook list for classes\", \n", "\n", " # Academic and career development\n", " \"apply for internships online\", \"find career fair schedule\", \n", " \"access resume workshop details\", \"log in to career services portal\", \n", " \"schedule mock interview\", \"find alumni networking events\", \n", " \"apply for study abroad programs\", \"access research grant applications\", \n", " \"find academic journal access portal\", \"apply for teaching assistantship\", \n", " \"submit thesis proposal online\", \"check academic probation status\", \n", " \"schedule tutoring session\", \"find group study rooms\", \n", " \"access campus research labs\", \"download degree audit report\", \n", " \"apply for graduation online\", \"track diploma mailing status\",\n", "\n", " # College administration\n", " \"submit residency reclassification form\", \"request change of major\", \n", " \"apply for student health insurance\", \"log in to bursar's office portal\", \n", " \"submit disability accommodation request\", \"access registrar's office forms\", \n", " \"apply for academic appeals online\", \"find transfer credit evaluation\", \n", " \"request official transcript mailing\", \"access Title IX reporting form\", \n", " \"apply for withdrawal leave of absence\", \"find campus IT support login\", \n", " \"update emergency contact information\", \"access financial aid appeal form\",\n", "\n", " # clerk\n", " \"log in to payroll system\", \"submit timesheets online\", \"access company forms\", \n", " \"track office supply orders\", \"request vacation days online\", \n", " \"check work schedule\", \"submit leave application\", \n", " \"log in to employee intranet\", \"update contact information in HR portal\", \n", " \"download meeting minutes\", \"find office seating chart\", \n", " \"check internal email inbox\", \"access document approval workflow\", \n", " \"submit expense reimbursement form\",\n", "\n", " # techie\n", " \"access GitHub repositories\", \"log in to Jira dashboard\", \n", " \"track bug reports in Bugzilla\", \"find API documentation\", \n", " \"access AWS console\", \"log in to Microsoft Azure portal\", \n", " \"navigate to CI/CD pipeline\", \"download Docker images\", \n", " \"access Kubernetes dashboard\", \"log in to GitLab issues\", \n", " \"track server uptime in Grafana\", \"submit code review in Bitbucket\", \n", " \"monitor cloud resource usage\", \"log in to DevOps toolkit\", \n", " \"download SDKs from developer portal\",\n", "\n", " # business owner\n", " \"log in to QuickBooks Online\", \"access Shopify admin dashboard\", \n", " \"track sales performance in Square\", \"log in to Stripe account\", \n", " \"find business tax forms\", \"update products on Etsy seller account\", \n", " \"check inventory levels on Amazon Seller Central\", \n", " \"download profit and loss statements\", \"log in to Google My Business\", \n", " \"access Facebook Ads Manager\", \"update employee records online\", \n", " \"log in to HubSpot CRM\", \"schedule team meeting in Zoom\", \n", " \"apply for business loan online\",\n", "\n", " # homemaker\n", " \"log in to grocery delivery app\", \"track Walmart grocery orders\", \n", " \"find recipes on Pinterest\", \"access online family budget tracker\", \n", " \"order cleaning supplies from Amazon\", \"log in to home security system\", \n", " \"navigate to IKEA furniture shopping\", \"check delivery status on FedEx\", \n", " \"book pest control services online\", \"find local daycare reviews\", \n", " \"manage subscription on Netflix\", \"order home decor from Wayfair\", \n", " \"pay electricity bill online\", \"schedule home repairs on Angi\",\n", "\n", " # school teacher\n", " \"log in to Google Classroom\", \"update grades in school portal\", \n", " \"download lesson plans from Teachers Pay Teachers\", \n", " \"schedule parent-teacher conferences\", \"log in to Zoom for class\", \n", " \"access student attendance records\", \"submit curriculum plans online\", \n", " \"find classroom supply discounts\", \"access educational research journals\", \n", " \"track student progress reports\", \"apply for professional development programs\", \n", " \"log in to school administration portal\", \"download assessment rubrics\",\n", "\n", " # school student\n", " \"log in to school portal\", \"submit homework on Google Classroom\", \n", " \"download study guides\", \"check upcoming tests\", \n", " \"access online library resources\", \"find class schedule\", \n", " \"log in to Khan Academy\", \"access coding lessons on Code.org\", \n", " \"download science fair instructions\", \"log in to Zoom class\", \n", " \"submit project online\", \"find book reports templates\", \n", " \"schedule tutoring sessions online\", \"track grades online\",\n", "\n", " # college student\n", " \"register for college classes online\", \"log in to student portal\", \n", " \"download class syllabus\", \"access online course materials\", \n", " \"submit assignments on Canvas\", \"track financial aid status\", \n", " \"find scholarship application forms\", \"log in to university library system\", \n", " \"schedule advisor meeting\", \"apply for internships online\", \n", " \"find study group sessions\", \"access professor office hours schedule\", \n", " \"pay tuition fees online\", \"download graduation requirements checklist\",\n", "\n", " # accountant\n", " \"log in to QuickBooks Online\", \"access payroll system\", \n", " \"download tax forms\", \"file tax returns for clients\", \n", " \"track income and expense reports\", \"log in to Xero accounting software\", \n", " \"update accounts payable records\", \"access client financial statements\", \n", " \"check IRS e-filing portal\", \"log in to Sage accounting software\", \n", " \"schedule client meetings\", \"submit audit trail reports\", \n", " \"find accounting software updates\", \"access expense tracker apps\",\n", "\n", " # Auditor\n", " \"log in to audit management portal\", \"access financial statement templates\", \n", " \"download compliance checklists\", \"submit internal audit reports\", \n", " \"log in to SEC filing system\", \"access risk assessment tools\", \n", " \"track regulatory updates online\", \"download audit trail data\", \n", " \"log in to GRC software\", \"schedule audit interviews online\", \n", " \"submit client compliance feedback\", \"access previous audit findings\", \n", " \"check ISO audit certification details\", \"review SOX compliance guidelines\",\n", "\n", " # professional\n", " \"log in to LinkedIn profile\", \"access online resume builder\", \n", " \"register for networking events\", \"log in to corporate email\", \n", " \"schedule meetings on Microsoft Teams\", \"log in to Slack channels\", \n", " \"find professional certifications\", \"submit expense reports online\", \n", " \"access job postings on Indeed\", \"track industry news on Bloomberg\", \n", " \"log in to project management tools\", \"update professional portfolio online\", \n", " \"access online learning resources\", \"schedule professional development workshops\",\n", "\n", " # healthcare\n", " \"log in to electronic health records\", \"submit patient prescriptions online\",\n", " \"track lab test results\", \"access telemedicine platform\",\n", " \"schedule patient appointments online\", \"check insurance eligibility\",\n", " \"log in to medical billing portal\", \"access diagnostic imaging systems\",\n", " \"download medical journals\", \"apply for medical licensing online\",\n", "\n", " # legal \n", " \"access case management system\", \"submit legal filings online\",\n", " \"log in to legal research platform\", \"track court schedules\",\n", " \"download legal templates\", \"apply for power of attorney online\",\n", " \"file a discrimination complaint\", \"report workplace harassment to EEOC\",\n", " \"submit FOIA requests\", \"check case verdicts online\",\n", "\n", " # freelancer\n", " \"log in to Upwork account\", \"track project milestones on Fiverr\", \n", " \"submit invoices online\", \"access client feedback\", \n", " \"log in to Payoneer for payments\", \"check freelance job postings\", \n", " \"apply for contracts on Freelancer.com\", \"manage tasks on Trello\", \n", " \"log in to Airtable project workspace\", \"download design files on Canva\", \n", " \"access portfolio on Behance\", \"track hours on Toggl\", \n", " \"submit bids on PeoplePerHour\", \"schedule client calls on Zoom\",\n", "\n", " # retail worker\n", " \"log in to POS system\", \"access shift schedules\", \n", " \"track inventory in stock management system\", \"submit timesheets online\", \n", " \"update customer orders\", \"log in to employee portal\", \n", " \"find product pricing details\", \"download safety training modules\", \n", " \"access loyalty program data\", \"submit return or refund requests\", \n", " \"log in to retail analytics dashboard\", \"track daily sales goals\",\n", " \n", " # delivery driver\n", " \"log in to Uber Eats driver portal\", \"find delivery routes on Google Maps\", \n", " \"check order pick-up details\", \"track earnings on DoorDash app\", \n", " \"access customer delivery instructions\", \"log in to Grubhub driver account\", \n", " \"find fuel discount programs\", \"access Lyft driver support\", \n", " \"schedule shifts on Amazon Flex\", \"log in to Postmates Fleet dashboard\", \n", " \"track delivery performance metrics\", \"access vehicle maintenance records\",\n", "\n", " # artist navigation\n", " \"log in to Etsy seller dashboard\", \"access Behance portfolio\", \n", " \"upload new designs to Redbubble\", \"log in to Patreon creator account\", \n", " \"track art commissions on DeviantArt\", \"download design templates from Canva\", \n", " \"access tutorial videos on Skillshare\", \"log in to Adobe Creative Cloud\", \n", " \"manage gallery submissions online\", \"upload digital art to Procreate gallery\", \n", " \"track merchandise orders on Printful\", \"submit artwork to competitions online\",\n", "\n", " # engineer\n", " \"log in to CAD software portal\", \"access circuit simulation tools online\", \n", " \"download blueprints from company database\", \"track project timelines in Jira\", \n", " \"log in to MATLAB for simulations\", \"access engineering standards online\", \n", " \"submit technical reports online\", \"schedule maintenance checks in SAP\", \n", " \"access IoT device dashboards\", \"log in to 3D printing tools\", \n", " \"find engineering webinars online\", \"submit equipment calibration forms\",\n", "\n", " # content creator\n", " \"log in to YouTube Studio\", \"access video analytics on TikTok Creator Portal\", \n", " \"track engagement metrics on Instagram Insights\", \"upload podcast episodes on Spotify\", \n", " \"find trending topics on Twitter\", \"log in to Canva for graphic design\", \n", " \"schedule posts on Hootsuite\", \"edit videos on Final Cut Pro\", \n", " \"manage ad revenue on Facebook Creator Studio\", \"download media from Dropbox\", \n", " \"log in to Twitch affiliate dashboard\", \"check copyright claims on YouTube\",\n", "\n", " # sports fan\n", " \"log in to ESPN Fantasy Football\", \"track live scores on NBA app\", \n", " \"check upcoming NFL schedules\", \"log in to Strava fitness app\", \n", " \"access training programs on Nike Training Club\", \"find local marathon events\", \n", " \"log in to fitness tracker dashboard\", \"track workout history on Fitbit\", \n", " \"upload running routes to Garmin Connect\", \"check cricket scores on ESPN Cricinfo\", \n", " \"find soccer leagues near me\", \"track progress on Peloton app\",\n", "\n", " # entrepreneur\n", " \"log in to business loan portal\", \"track sales on Shopify dashboard\", \n", " \"access marketing analytics on HubSpot\", \"apply for a business license online\", \n", " \"log in to investor relations portal\", \"download business plan templates\", \n", " \"access pitch deck templates\", \"schedule team meetings on Microsoft Teams\", \n", " \"apply for venture capital funding\", \"track project progress on Monday.com\", \n", " \"log in to Zoom for investor calls\", \"track customer feedback on SurveyMonkey\",\n", "\n", " # govt employee\n", " \"log in to federal employee portal\", \"submit payroll forms online\", \n", " \"access compliance training modules\", \"schedule inter-agency meetings on WebEx\", \n", " \"submit travel reimbursement requests\", \"track citizen service requests\", \n", " \"access state records management system\", \"log in to public health database\", \n", " \"submit procurement forms online\", \"track grants in federal funding system\", \n", " \"download public policy updates\", \"log in to internal GIS dashboard\",\n", "\n", "]\n", "\n", "travel_examples_partial = [\n", " \"flight to\", \"visit\", \"visa requirements\", \"trip planner\", \"tourist spots\",\n", " \"cheap flights\", \"best places to visit\", \"hotel booking\", \"sightseeing\",\n", " \"tourist attractions\", \"road trip\", \"travel insurance\", \"best time to visit\",\n", " \"budget travel\", \"local tours\", \"vacation packages\", \"recommended destinations\",\n", " \"cruise deals\", \"vacation spots\", \"passport renewal\", \"visa rules\",\n", " \"beach resorts\", \"airfare deals\", \"holiday trips\", \"affordable destinations\",\n", " \"international flights\", \"city tours\", \"top landmarks\", \"country guide\", \n", " \"tropical destinations\", \"travel guide\", \"family vacations\", \"romantic getaways\",\n", " \"honeymoon ideas\", \"backpacking trips\", \"adventure travel\", \"historical sites\",\n", " \"city tours\", \"weekend escapes\", \"wilderness tours\", \"hotel reviews\",\n", " \"best tour agencies\", \"theme park trips\", \"water park tickets\", \"beach excursions\",\n", " \"cultural heritage sites\", \"spa resorts\", \"all-inclusive deals\", \"mountain climbing trips\",\n", " \"scenic routes\", \"train to\", \"luxury resorts\", \"ski resorts\", \"travel checklist\", \n", " \"best food spots\", \"travel restrictions\", \"city guide\", \"cultural experiences\", \n", " \"eco-friendly travel\", \"destination weddings\", \"local food tours\", \"historical landmarks\", \n", " \"best museums\", \"national parks\", \"guided tours\", \"travel blogs\", \"itinerary ideas\", \n", " \"vacation rentals\", \"staycations\", \"must-visit islands\", \"nature trails\", \"wildlife safaris\", \n", " \"travel deals\", \"popular road trips\", \"long weekend trips\", \"day trips\", \"romantic stays\", \n", " \"budget hotels\", \"festival dates\", \"safari lodges\", \"desert tours\", \"exploring islands\", \n", " \"wine tours\", \"biking tours\", \"remote locations\", \"travel gadgets\", \"hiking trails\", \n", " \"outdoor adventures\", \"wildlife tours\", \"road trip essentials\", \"unexplored destinations\", \n", " \"beach holidays\", \"rural getaways\", \"city breaks\", \"glamping spots\", \"hostels near\", \n", " \"overwater bungalows\", \"luxury train journeys\", \"heritage hotels\", \"guided city walks\", \n", " \"solo travel tips\", \"local guides\", \"temple tours\", \"urban exploration\", \"roadside attractions\", \n", " \"adventure parks\", \"best hiking spots\", \"spa hotels\", \"island escapes\", \"mountain retreats\", \n", " \"desert safaris\", \"hidden gems\", \"UNESCO world heritage sites\", \"fishing trips\", \n", " \"hot air balloon rides\", \"cultural festivals\", \"top skiing destinations\", \"outdoor excursions\", \n", " \"family-friendly hotels\", \"wildlife sanctuaries\", \"sailing trips\", \"beach clubs\", \"travel essentials\", \n", " \"outdoor campsites\", \"eco-tourism\", \"ferry trips\", \"popular cruise lines\", \"historical city tours\", \n", " \"luxury beach resorts\", \"best places for sunset\", \"city skyline views\", \"hidden beaches\", \n", " \"cooking classes abroad\", \"famous street markets\", \"travel discounts\", \"offbeat destinations\", \n", " \"airport transfers\", \"last-minute getaways\", \"camping near\", \"castle tours\", \"mountain trekking\", \n", " \"road trips with kids\", \"beach activities\", \"travel booking\", \"urban sightseeing\", \n", " \"exotic travel spots\", \"local dining\", \"city festivals\", \"budget airlines\", \"remote island resorts\", \n", " \"best travel agencies\", \"heritage villages\", \"road trip routes\", \"weekend hikes\",\n", " \"tropical beach resorts\", \"volcano tours\", \"camping essentials\", \"national park passes\", \n", " \"city walking tours\", \"local cuisine tasting\", \"nightlife hotspots\", \"family-friendly resorts\", \n", " \"road trip itinerary\", \"where to snorkel\", \"destination guides\", \"pet-friendly hotels\", \n", " \"skiing and snowboarding\", \"lake getaways\", \"historic inns\", \"guided mountain hikes\", \n", " \"waterfall tours\", \"snowboard rentals\", \"sunset cruises\", \"island hopping\", \n", " \"group travel discounts\", \"botanical gardens\", \"roadside diners\", \"where to scuba dive\", \n", " \"road trip packing list\", \"desert camping\", \"travel credit cards\", \"luxury travel experiences\", \n", " \"golf resorts\", \"photography spots\", \"stargazing tours\", \"festival packages\", \n", " \"architecture tours\", \"ghost town tours\", \"city nightlife\", \"climbing expeditions\", \n", " \"rural stays\", \"best beach towns\", \"lighthouse visits\", \"fishing expeditions\", \n", " \"cultural exhibitions\", \"best places for diving\", \"mountain bike trails\", \"wine tasting tours\", \n", " \"eco lodges\", \"luxury camping\", \"hiking with pets\", \"cruise excursions\", \"zip lining adventures\", \n", " \"remote mountain villages\", \"volunteering abroad\", \"sunrise viewpoints\", \"bird watching tours\", \n", " \"yoga retreats\", \"ferry schedules\", \"local handicrafts\", \"wellness retreats\", \"pilgrimage sites\", \n", " \"city skylines\", \"seafood markets\", \"mountain lodges\", \"oceanfront villas\", \"bicycle rentals\", \n", " \"travel souvenirs\", \"bike tours\", \"haunted locations\", \"picnic spots\", \"romantic sunsets\", \n", " \"night market tours\", \"expedition cruises\", \"historical reenactments\", \"luxury spas\", \n", " \"weekend villas\", \"urban parks\", \"cheap car rentals\", \"temple stays\", \"architecture marvels\", \n", " \"cliff diving spots\", \"beach house rentals\", \"public transport guides\", \"rooftop restaurants\", \n", " \"vintage markets\", \"remote villages\", \"water sports rentals\", \"art museum tours\", \n", " \"sustainable travel tips\", \"cultural food festivals\", \"boating rentals\", \"seasonal events\", \n", " \"island retreats\", \"ancient ruins tours\", \"safari trips\", \"adventure resorts\", \"UNESCO sites nearby\", \n", " \"travel vaccinations\", \"lake cabins\", \"train journeys\", \"cruise ship tours\", \"underwater hotels\", \n", " \"iconic landmarks\", \"wilderness camping\", \"unique Airbnbs\", \"fine dining experiences\", \n", " \"cheap destinations\", \"secluded beaches\", \"budget adventures\", \"wildlife preserves\", \"water sports activities\",\n", " # National Parks\n", " \"Grand Canyon National Park\", \"Yellowstone National Park\", \n", " \"Yosemite National Park\", \"Zion National Park\", \"Glacier National Park\", \n", " \"Great Smoky Mountains National Park\", \"Arches National Park\", \n", " \"Rocky Mountain National Park\", \"Bryce Canyon National Park\", \n", " \"Acadia National Park\", \"Sequoia National Park\", \"Joshua Tree National Park\", \n", " \"Grand Teton National Park\", \"Mount Rainier National Park\", \n", " \"Everglades National Park\", \"Denali National Park\", \n", " \"Badlands National Park\", \"Death Valley National Park\", \n", " \"Shenandoah National Park\", \"Big Bend National Park\",\n", "\n", " # Beaches and Coastal Destinations\n", " \"Maui, Hawaii\", \"Waikiki Beach, Oahu\", \"Clearwater Beach, Florida\", \n", " \"South Beach, Miami\", \"Santa Monica Beach, California\", \n", " \"Myrtle Beach, South Carolina\", \"Destin, Florida\", \n", " \"Hilton Head Island, South Carolina\", \"Outer Banks, North Carolina\", \n", " \"Cape Cod, Massachusetts\", \"Malibu, California\", \"Laguna Beach, California\", \n", " \"Siesta Key, Florida\", \"Naples, Florida\", \"Kauai, Hawaii\", \n", " \"Cannon Beach, Oregon\", \"Virginia Beach, Virginia\", \n", " \"Sanibel Island, Florida\", \"Key West, Florida\", \"Rehoboth Beach, Delaware\",\n", "\n", " # Landmarks and Monuments\n", " \"Statue of Liberty, New York\", \"Empire State Building, New York\", \n", " \"Golden Gate Bridge, San Francisco\", \"Mount Rushmore, South Dakota\", \n", " \"The White House, Washington, D.C.\", \"Lincoln Memorial, Washington, D.C.\", \n", " \"Hollywood Sign, Los Angeles\", \"Gateway Arch, St. Louis\", \n", " \"Space Needle, Seattle\", \"Alcatraz Island, San Francisco\", \n", " \"The Pentagon, Virginia\", \"Freedom Tower, New York\", \n", " \"Hoover Dam, Nevada\", \"Graceland, Memphis\", \n", " \"Independence Hall, Philadelphia\", \"The Liberty Bell, Philadelphia\", \n", " \"United States Capitol, Washington, D.C.\", \"Brooklyn Bridge, New York\", \n", " \"Times Square, New York\", \"Biltmore Estate, North Carolina\",\n", "\n", " # Historic Sites\n", " \"Pearl Harbor, Hawaii\", \"Gettysburg National Military Park, Pennsylvania\", \n", " \"Colonial Williamsburg, Virginia\", \"Ellis Island, New York\", \n", " \"Salem Witch Museum, Massachusetts\", \"Plymouth Rock, Massachusetts\", \n", " \"Monticello, Virginia\", \"Alamo Mission, Texas\", \"Fort Sumter, South Carolina\", \n", " \"Mesa Verde National Park, Colorado\", \"San Antonio Missions, Texas\", \n", " \"Martin Luther King Jr. National Historic Site, Georgia\", \n", " \"Chaco Culture National Historical Park, New Mexico\", \n", " \"Trail of Tears National Historic Trail\", \"Antietam National Battlefield, Maryland\", \n", " \"Harper's Ferry, West Virginia\", \"Jamestown Settlement, Virginia\", \n", " \"Wounded Knee, South Dakota\", \"Fredericksburg Battlefield, Virginia\", \n", " \"Fort McHenry, Maryland\",\n", "\n", " # Cultural Destinations\n", " \"Broadway, New York\", \"Metropolitan Museum of Art, New York\", \n", " \"Smithsonian Institution, Washington, D.C.\", \"Art Institute of Chicago, Illinois\", \n", " \"The Getty Center, Los Angeles\", \"MoMA (Museum of Modern Art), New York\", \n", " \"National Gallery of Art, Washington, D.C.\", \"American Museum of Natural History, New York\", \n", " \"The Field Museum, Chicago\", \"Boston Museum of Fine Arts, Massachusetts\", \n", " \"Rock and Roll Hall of Fame, Cleveland\", \"Griffith Observatory, Los Angeles\", \n", " \"The Aquarium of the Pacific, Long Beach\", \"Georgia Aquarium, Atlanta\", \n", " \"Space Center Houston, Texas\", \"National Museum of African American History, Washington, D.C.\", \n", " \"The Henry Ford Museum, Michigan\", \"Country Music Hall of Fame, Nashville\", \n", " \"Dollywood, Tennessee\", \"Stax Museum of American Soul Music, Memphis\",\n", "\n", " # Family-Friendly Attractions\n", " \"Disneyland, California\", \"Walt Disney World, Florida\", \n", " \"Universal Studios, Florida\", \"Universal Studios Hollywood, California\", \n", " \"SeaWorld Orlando, Florida\", \"LEGOLAND Florida, Winter Haven\", \n", " \"San Diego Zoo, California\", \"Monterey Bay Aquarium, California\", \n", " \"Disney's Animal Kingdom, Florida\", \"Epcot, Florida\", \n", " \"Magic Kingdom, Florida\", \"Hollywood Studios, Florida\", \n", " \"Adventure Island, Tampa\", \"Six Flags Magic Mountain, California\", \n", " \"Busch Gardens, Virginia\", \"Knott's Berry Farm, California\", \n", " \"Hersheypark, Pennsylvania\", \"Cedar Point, Ohio\", \"Kings Island, Ohio\", \n", " \"Silver Dollar City, Missouri\",\n", "\n", " # Unique Natural Attractions\n", " \"Niagara Falls, New York\", \"Antelope Canyon, Arizona\", \"Horseshoe Bend, Arizona\", \n", " \"Monument Valley, Arizona/Utah\", \"Sedona, Arizona\", \"Bryce Canyon Hoodoos, Utah\", \n", " \"Devil's Tower, Wyoming\", \"Lake Tahoe, California/Nevada\", \n", " \"Crater Lake, Oregon\", \"Carlsbad Caverns, New Mexico\", \n", " \"Great Salt Lake, Utah\", \"The Wave, Arizona\", \"Mammoth Cave, Kentucky\", \n", " \"Mount St. Helens, Washington\", \"Hot Springs National Park, Arkansas\", \n", " \"The Everglades, Florida\", \"Big Sur, California\", \"Lake Powell, Arizona\", \n", " \"Gulf Shores, Alabama\", \"The Painted Desert, Arizona\",\n", "\n", " # Unique and Unusual Destinations\n", " \"Area 51, Nevada\", \"Roswell, New Mexico\", \"Salvation Mountain, California\", \n", " \"Winchester Mystery House, California\", \"Mystic Seaport, Connecticut\", \n", " \"The House on the Rock, Wisconsin\", \"Voodoo Museum, New Orleans\", \n", " \"International UFO Museum, New Mexico\", \"Carhenge, Nebraska\", \n", " \"World's Largest Ball of Twine, Kansas\", \"Cadillac Ranch, Texas\", \n", " \"Devil's Kettle, Minnesota\", \"Salton Sea, California\", \n", " \"Biosphere 2, Arizona\", \"Gravity Hill, Pennsylvania\", \"Portland Underground, Oregon\", \n", " \"The Thing, Arizona\", \"Fallingwater, Pennsylvania\", \"Neon Museum, Las Vegas\", \n", " \"The Mütter Museum, Philadelphia\",\n", "\n", " # Popular Events and Festivals\n", " \"Mardi Gras, New Orleans\", \"Coachella, California\", \"Burning Man, Nevada\", \n", " \"South by Southwest (SXSW), Texas\", \"Comic-Con, California\", \n", " \"Kentucky Derby, Kentucky\", \"Albuquerque Balloon Fiesta, New Mexico\", \n", " \"The Masters Golf Tournament, Georgia\", \"Lollapalooza, Illinois\", \n", " \"Sturgis Motorcycle Rally, South Dakota\", \"Jazz Fest, New Orleans\", \n", " \"The Rose Parade, California\", \"Times Square Ball Drop, New York\", \n", " \"Thanksgiving Day Parade, New York\", \"Sundance Film Festival, Utah\", \n", " \"Easter Jeep Safari, Utah\", \"Art Basel Miami Beach, Florida\", \n", " \"Nashville Film Festival, Tennessee\", \"American Royal BBQ Contest, Kansas\", \n", " \"Taste of Chicago, Illinois\",\n", "\n", " \"airport\", \"station\", \"hotel\", \"beach\", \"mountain\", \"valley\",\n", " \"ocean\", \"river\", \"lake\", \"park\", \"forest\", \"museum\", \"theater\", \n", " \"tourist\", \"vacation\", \"weekend\", \"holiday\",\n", "]\n", "\n", "purchase_examples_partial = [\n", " \"buy\", \"discounts on\", \"product reviews\", \"top deals\", \"best price for\",\n", " \"shopping for\", \"sale on\", \"cheap\", \"where to find\", \"store near\",\n", " \"affordable\", \"buying guide\", \"online shopping\", \"deal of the day\", \"compare\",\n", " \"electronics deals\", \"clearance\", \"best gift ideas\", \"smartphone discounts\",\n", " \"shop online\", \"find discount\", \"order now\", \"best rated\", \"hot deals\",\n", " \"where to buy\", \"gift for friends\", \"find cheap\", \"cost comparison\",\n", " \"monthly deals\", \"discounted gadgets\", \"price check\", \"stock availability\",\n", " \"sale event\", \"on discount\", \"store open hours\", \"free shipping\", \n", " \"how much is\", \"good quality items\", \"deal store\", \"bargain finder\",\n", " \"warranty coverage\", \"best for price\", \"flash sale\", \"limited offers\",\n", " \"smart home devices\", \"eco-friendly items\", \"vintage collectibles\", \"buy used items\",\n", " \"cheap deals\", \"limited stock\", \"special offers\", \"price match\", \"buy one get one\", \n", " \"gift ideas for family\", \"budget-friendly\", \"exclusive deals\", \"best price guarantee\", \n", " \"bundle offers\", \"best deals on gadgets\", \"customer reviews\", \"discount codes\", \n", " \"holiday discounts\", \"best budget options\", \"shopping deals\", \"affordable gifts\", \n", " \"seasonal sale\", \"luxury items on sale\", \"new arrivals\", \"best in category\", \n", " \"coupon codes\", \"cashback offers\", \"limited-time sale\", \"new discounts\", \n", " \"exclusive online deals\", \"shop by brand\", \"last-minute gift ideas\", \"price drops\", \n", " \"shopping near me\", \"pre-order\", \"buy for less\", \"gift cards\", \"price tracker\", \n", " \"trending items\", \"budget-friendly gifts\", \"buy gift cards\", \"clearance items\", \n", " \"discount store\", \"special promotions\", \"home appliances on sale\", \"best-selling items\", \n", " \"limited edition\", \"budget options\", \"discount for students\", \"free returns\", \n", " \"seasonal clearance\", \"price alerts\", \"find bargains\", \"subscribe and save\", \n", " \"on sale today\", \"holiday specials\", \"discount electronics\", \"order for delivery\", \n", " \"wholesale prices\", \"compare online prices\", \"best gift options\", \"discount on shipping\", \n", " \"weekly discounts\", \"in-store pickup\", \"flash discount\", \"holiday sales\", \"new collection\", \n", " \"luxury deals\", \"limited-time discount\", \"find in stock\", \"refurbished items\", \n", " \"discount furniture\", \"price discounts\", \"compare gadgets\", \"outlet store\", \n", " \"affordable tech\", \"buy more save more\", \"kids’ toys on sale\", \"new in store\", \n", " \"exclusive membership discounts\", \"gifts under $50\", \"back-to-school deals\", \n", " \"best value items\", \"store offers\", \"top-rated electronics\", \"shop today\", \n", " \"affordable fashion\", \"best budget laptops\", \"appliance deals\", \"gift for him\", \n", " \"gift for her\", \"pet supplies sale\", \"baby products on sale\", \"student discounts\", \n", " \"outdoor gear deals\", \"flash price drop\", \"get quotes\", \"bulk purchase discounts\", \n", " \"subscribe for offers\", \"personalized gifts\", \"compare TVs\", \"high-quality items\", \n", " \"best phone under $500\", \"kitchen appliances sale\", \"budget picks\", \"latest deals\",\n", " \"gift sets for holidays\", \"best-rated products\", \"limited stock available\",\n", " \"financing options\", \"pre-owned items\", \"upcoming sales\", \"best sellers in category\",\n", " \"affordable options near me\", \"deals on essentials\", \"rewards programs\",\n", " \"online exclusive items\", \"referral discounts\", \"new stock release\", \"wholesale electronics\",\n", " \"price comparisons for brands\", \"reliable product options\", \"holiday gift bundles\",\n", " \"daily price drops\", \"in-store discounts\", \"gift for pet lovers\", \"seasonal décor discounts\",\n", " \"best deals this week\", \"multi-buy discounts\", \"shopping rewards points\",\n", " \"compare subscription boxes\", \"limited edition sale items\", \"outlet for electronics\",\n", " \"price comparison website\", \"gift baskets under $100\", \"clearance on winter wear\",\n", " \"gift card sale\", \"budget-friendly finds\", \"high-rated items on sale\",\n", " \"low-cost delivery options\", \"home and garden deals\", \"flash sales this weekend\",\n", " \"price guarantee policy\", \"trending holiday gifts\", \"big savings on furniture\",\n", " \"best Black Friday deals on TVs\", \"Cyber Monday smartphone discounts\", \n", " \"discounted laptops for sale\", \"affordable tablets this holiday\", \n", " \"smartwatches on sale\", \"best earbuds for gifts\", \"4K TV holiday discounts\", \n", " \"gaming consoles Black Friday deals\", \"top-rated smart home devices on sale\", \n", " \"holiday deals on headphones\", \"Cyber Monday smartwatch deals\", \n", " \"best holiday discounts on laptops\", \"VR headset offers\", \"wireless speakers on sale\", \n", " \"holiday sale on digital cameras\", \"gaming laptop Black Friday deal\", \n", " \"discount on wireless earbuds\", \"home security gadgets on discount\", \n", " \"budget laptops Cyber Monday deals\", \"buy drones on sale\", \n", " \"holiday discounts on gaming PCs\", \"tablet Black Friday offers\", \n", " \"latest smartphone deals\", \"smart thermostats on sale\", \n", " \"fitness trackers discounted\", \"holiday deals on portable chargers\", \n", " \"affordable smart TVs\", \"Cyber Monday deals on computer monitors\", \n", " \"deals on gaming accessories\", \"best Black Friday soundbar offers\", \n", " \"discounts on streaming devices\", \"smart kitchen gadgets holiday deals\", \n", " \"robot vacuums on sale\", \"best wireless chargers to buy\", \n", " \"discounts on noise-canceling headphones\", \"holiday deals on Bluetooth speakers\", \n", " \"best Black Friday deals on cameras\", \"affordable smartwatches\", \n", " \"top gadgets on sale this holiday\", \"smart bulbs Black Friday deals\", \n", " \"holiday sales on gaming chairs\", \"discount on external hard drives\", \n", " \"smartphone accessory discounts\", \"top holiday deals on tablets\", \n", " \"Cyber Monday deals on PC accessories\", \"budget-friendly smart home gadgets\", \n", " \"best deals on wearable tech\", \"Black Friday sale on laptops\", \n", " \"Bluetooth earbuds holiday discounts\", \"holiday deals on action cameras\", \n", " \"best smartwatch under $200\", \"buy holiday gift tech items\", \n", " \"discount on electric scooters\", \"Cyber Monday laptop sale\", \n", " \"tablet accessory discounts\", \"4K projectors holiday deals\", \n", " \"gaming headset Black Friday sale\", \"affordable video doorbells\", \n", " \"best budget tech gifts\", \"holiday discounts on PC parts\", \n", " \"discounted smart locks\", \"popular tech deals this season\", \n", " \"best tech under $50 holiday sale\", \"Black Friday deals on tablets\", \n", " \"smart home starter kits on sale\", \"affordable drones for kids\", \n", " \"holiday discount on laptops\", \"smart home assistants on discount\", \n", " \"best gaming gadgets for gifts\", \"holiday sale on charging accessories\", \n", " \"budget-friendly tech for teens\", \"holiday price drops on gadgets\",\n", " \"best deals on smart home gadgets\", \"trending kitchen appliances on Amazon\", \n", " \"top-rated fitness trackers\", \"latest wireless earbuds\", \"best pet care products\", \n", " \"most popular home decor items\", \"best holiday gifts on Amazon\", \n", " \"discounted beauty and skincare products\", \"trending books this season\", \n", " \"must-have camping gear\", \"top video games on sale\", \"popular Amazon devices\", \n", " \"best new releases in electronics\", \"hot fashion items on eBay\", \n", " \"trending children's toys\", \"best-selling phone accessories\", \n", " \"latest smartwatches\", \"trending holiday decor\", \"discounted fitness equipment\", \n", " \"popular laptop bags and cases\", \"new trending gadgets\", \"must-have kitchen tools\", \n", " \"trending DIY tools\", \"affordable trending tech accessories\", \"most-wanted gaming consoles\", \n", " \"top-rated skincare tools\", \"most searched for drones\", \"trending home office essentials\", \n", " \"discounted sports gear\", \"latest model phones on Amazon\", \"affordable gaming accessories\", \n", " \"popular outdoor gear\", \"best-selling pet toys\", \"affordable beauty products\", \n", " \"trending holiday outfits\", \"top-selling jewelry items\", \"trending supplements\", \n", " \"top gifts for gadget lovers\", \"most popular smart speakers\", \"trending electric scooters\", \n", " \"popular kids' educational toys\", \"top-rated phone cases\", \"discounts on smart plugs\", \n", " \"new popular beauty tools\", \"best-selling air purifiers\", \"trending cleaning supplies\", \n", " \"latest workout equipment\", \"top deals on wearable tech\", \"popular car accessories\", \n", " \"trending board games\", \"hot deals on small appliances\", \"new Amazon home essentials\", \n", " \"affordable holiday gift ideas\", \"best-selling kitchen appliances\", \n", " \"trending men's grooming kits\", \"top deals on baby essentials\", \n", " \"best new home fitness products\", \"popular home organization items\", \n", " \"top-rated clothing on eBay\", \"latest model headphones\", \"must-have travel accessories\", \n", " \"popular holiday gift baskets\", \"trending video doorbells\", \"best-selling cookbooks\", \n", " \"top-rated sports gear\", \"discounted home automation gadgets\", \n", " \"best new releases in toys\", \"popular subscription boxes\", \"trending wellness products\", \n", " \"top hair care products\", \"affordable smart light bulbs\", \"trending car gadgets\", \n", " \"must-have holiday gift sets\", \"best discounts on essentials\", \n", " \"popular kids' STEM toys\", \"best-rated massage guns\", \"trending water bottles\", \n", " \"most-wanted kitchen gadgets\", \"top pet grooming products\", \n", " \"latest deals on tech gifts\", \"affordable holiday party supplies\", \n", " \"new releases in fitness trackers\", \"top-rated baby gear\", \"most popular e-books\", \n", " \"best trending Bluetooth speakers\", \"popular luxury gift items\", \n", " \"trending electric shavers\", \"best-selling skincare kits\", \"trending fitness bands\", \n", " \"top-rated baby monitors\", \"affordable fashion accessories\", \"must-have holiday tech items\", \n", " \"new kitchen essentials on Amazon\", \"top trending sneakers\", \"popular office supplies\",\n", " \"affordable wireless earbuds\", \"latest electric shavers\", \"top-rated water purifiers\",\n", " \"portable air conditioners on sale\", \"discounted robot vacuums\", \n", " \"eco-friendly reusable bags\", \"best protein powders\", \"budget smartphones on Amazon\",\n", " \"affordable ergonomic chairs\", \"trending video editing software\", \"best-selling backpacks\",\n", " \"kids' learning tablets\", \"affordable noise-canceling headphones\", \"best gaming routers\",\n", " \"affordable juicers\", \"best deals on blenders\", \"home theater systems sale\",\n", " \"discounted adjustable dumbbells\", \"affordable yoga mats\", \"reliable air fryers\", \n", " \"best-selling essential oils\", \"new arrivals in winter jackets\", \"top-rated bed sheets\",\n", " \"discounted skincare gift sets\", \"outdoor patio furniture deals\", \"holiday sales on cameras\",\n", " \"affordable garden tools\", \"popular craft supplies\", \"trending LED lights for rooms\",\n", " \"best handheld vacuums\", \"discounted pressure cookers\", \"high-rated cat furniture\",\n", " \"affordable baby monitors\", \"budget kitchen knives\", \"new skincare serums\", \n", " \"trending graphic T-shirts\", \"best gaming headsets\", \"electric toothbrush deals\", \n", " \"discounts on wireless keyboards\", \"popular camping tents\", \"best air purifiers for homes\",\n", " \"affordable humidifiers\", \"smart light strips on sale\", \"home gym equipment deals\",\n", " \"top-rated inflatable pools\", \"affordable electric kettles\", \"best-selling printers\",\n", " \"trending wireless chargers\", \"new baking supplies\", \"best camping gear for families\",\n", " \"affordable pet strollers\", \"trending wall art\", \"best value office chairs\", \n", " \"kids' smartwatches on sale\", \"top-rated wine coolers\", \"affordable gaming chairs\", \n", " \"best deals on projectors\", \"popular hand sanitizers\", \"budget-friendly kitchen scales\",\n", " \"reliable electric blankets\", \"affordable air mattresses\", \"popular reusable water bottles\",\n", " \"best-selling patio heaters\", \"discounted storage bins\", \"top-rated computer desks\",\n", " \"affordable photo frames\", \"popular exercise bikes\", \"best portable power banks\", \n", " \"new smartwatch models\", \"affordable resistance bands\", \"best robot mop deals\", \n", " \"popular outdoor string lights\", \"affordable garden planters\", \"trending weighted blankets\",\n", " \"best-selling makeup brushes\", \"kids' electric cars on sale\", \"top-rated laundry baskets\",\n", " \"best infrared thermometers\", \"budget-friendly ceiling fans\", \"affordable spice racks\",\n", " \"top-rated portable generators\", \"popular home security cameras\", \"affordable phone stands\",\n", " \"best sewing machines for beginners\", \"affordable heated jackets\", \"best-selling dish racks\",\n", " \"top-rated water bottles for kids\", \"discounts on slow cookers\", \"popular home tool sets\",\n", " \"affordable coffee tables\", \"best LED makeup mirrors\", \"top-rated cycling helmets\",\n", " \"trending travel backpacks\", \"affordable baby high chairs\", \"new security camera models\",\n", " \"best holiday gift baskets\", \"affordable 3D printers\", \"popular mini fridges\",\n", " \"best luxury watches on sale\", \"affordable drones for beginners\", \"reliable floor steamers\",\n", " \"best-selling kitchen tongs\", \"popular dehumidifiers\", \"discounts on storage shelves\",\n", " \"trending patio umbrellas\", \"best-rated comforters\", \"affordable electric griddles\",\n", " # Electronics and Gadgets\n", " \"Smartphones\", \"Laptops\", \"Tablets\", \"Smartwatches\", \"Wireless earbuds\", \n", " \"Bluetooth speakers\", \"4K TVs\", \"Gaming consoles\", \"VR headsets\", \"Gaming monitors\", \n", " \"External hard drives\", \"Portable chargers\", \"Smart home devices\", \"Streaming devices\", \n", " \"Digital cameras\", \"Action cameras\", \"Drone cameras\", \"Smart thermostats\", \n", " \"Wireless keyboards\", \"Noise-canceling headphones\", \"Fitness trackers\", \n", " \"Gaming mice\", \"Wi-Fi routers\", \"Dash cams\", \"Projectors\", \n", " \"USB hubs\", \"Smart plugs\", \"Car phone holders\", \"Webcams\", \"Video doorbells\",\n", "\n", " # Home and Kitchen Products\n", " \"Air fryers\", \"Instant Pots\", \"Blenders\", \"Coffee makers\", \"Vacuum cleaners\", \n", " \"Robot vacuums\", \"Water purifiers\", \"Electric kettles\", \"Non-stick cookware sets\", \n", " \"Cast iron skillets\", \"Cutting boards\", \"Knife sets\", \"Storage containers\", \n", " \"Dish racks\", \"Food processors\", \"Baking tools\", \"Microwave ovens\", \n", " \"Toaster ovens\", \"Bread makers\", \"Portable heaters\", \"Ceiling fans\", \n", " \"Air purifiers\", \"Humidifiers\", \"Essential oil diffusers\", \"Mattresses\", \n", " \"Weighted blankets\", \"Comforter sets\", \"Bed sheets\", \"Throw pillows\", \n", " \"Electric blankets\", \"Area rugs\", \"Curtains\", \"Laundry hampers\", \n", " \"Bookshelves\", \"Standing desks\", \"Office chairs\", \"Storage bins\", \n", " \"Couches\", \"Bar stools\", \"Ottomans\", \"Patio furniture\", \"Outdoor grills\",\n", "\n", " # Fashion and Accessories\n", " \"Sneakers\", \"Running shoes\", \"Winter boots\", \"Sandals\", \"High heels\", \n", " \"Handbags\", \"Backpacks\", \"Luggage sets\", \"Sunglasses\", \"Watches\", \n", " \"Earrings\", \"Necklaces\", \"Bracelets\", \"Rings\", \"Hats\", \n", " \"Scarves\", \"Gloves\", \"Belts\", \"Swimwear\", \"Activewear\", \n", " \"Jeans\", \"T-shirts\", \"Sweaters\", \"Jackets\", \"Coats\", \n", " \"Dresses\", \"Suits\", \"Pajamas\", \"Socks\", \"Underwear\", \n", " \"Raincoats\", \"Yoga pants\", \"Leggings\", \"Shirts\", \"Blouses\",\n", "\n", " # Beauty and Personal Care\n", " \"Skincare products\", \"Facial cleansers\", \"Moisturizers\", \"Serums\", \"Face masks\", \n", " \"Makeup palettes\", \"Lipsticks\", \"Mascaras\", \"Eyeliners\", \"Foundations\", \n", " \"Hair dryers\", \"Flat irons\", \"Curling wands\", \"Shampoos\", \"Conditioners\", \n", " \"Hair oils\", \"Body lotions\", \"Perfumes\", \"Sunscreens\", \"Electric toothbrushes\", \n", " \"Men’s razors\", \"Beard trimmers\", \"Epilators\", \"Hair removal kits\", \n", " \"Deodorants\", \"Nail polish sets\", \"Press-on nails\", \"Bath bombs\", \"Lip balms\",\n", "\n", " # Health and Fitness Products\n", " \"Yoga mats\", \"Dumbbells\", \"Resistance bands\", \"Treadmills\", \"Ellipticals\", \n", " \"Stationary bikes\", \"Foam rollers\", \"Protein powders\", \"Pre-workout supplements\", \n", " \"Fitness trackers\", \"Massage guns\", \"Water bottles\", \"First aid kits\", \n", " \"Pulse oximeters\", \"Blood pressure monitors\", \"Thermometers\", \n", " \"Multivitamins\", \"Probiotics\", \"Essential oils\", \"Knee braces\", \n", " \"Compression socks\", \"Hand grips\", \"Pull-up bars\", \"Ab rollers\", \"Jump ropes\",\n", "\n", " # Baby and Kids Products\n", " \"Diapers\", \"Baby wipes\", \"Strollers\", \"Car seats\", \"Baby monitors\", \n", " \"Cribs\", \"High chairs\", \"Baby bottles\", \"Pacifiers\", \"Teething toys\", \n", " \"Baby carriers\", \"Play mats\", \"Activity gyms\", \"Toddler beds\", \n", " \"Children’s books\", \"Educational toys\", \"Ride-on toys\", \"Kids' backpacks\", \n", " \"School supplies\", \"Lunch boxes\", \"Kids’ scooters\", \"Bikes\", \"LEGO sets\", \n", " \"Action figures\", \"Dolls\", \"Board games\", \"Art supplies\", \"Plush toys\",\n", "\n", " # Pet Products\n", " \"Dog food\", \"Cat food\", \"Pet collars\", \"Leashes\", \"Pet carriers\", \n", " \"Pet beds\", \"Pet toys\", \"Litter boxes\", \"Dog crates\", \"Aquariums\", \n", " \"Cat trees\", \"Pet grooming kits\", \"Pet shampoo\", \"Pet clothing\", \n", " \"Automatic pet feeders\", \"Pet fountains\", \"Pet training pads\", \n", " \"Dog harnesses\", \"Scratching posts\", \"Bird cages\",\n", "\n", " # Outdoor and Sports Products\n", " \"Camping tents\", \"Sleeping bags\", \"Hiking boots\", \"Backpacking gear\", \n", " \"Fishing rods\", \"Kayaks\", \"Paddleboards\", \"Bicycles\", \"Trekking poles\", \n", " \"Binoculars\", \"Coolers\", \"Portable grills\", \"Portable generators\", \n", " \"Outdoor chairs\", \"Hammocks\", \"Picnic blankets\", \"Golf clubs\", \n", " \"Tennis rackets\", \"Soccer balls\", \"Basketballs\", \"Football gear\", \n", " \"Baseball gloves\", \"Skateboards\", \"Rollerblades\", \"Snowboards\", \n", " \"Ski equipment\", \"Hunting gear\", \"Archery kits\", \"Air mattresses\",\n", "\n", " # Home Improvement and Tools\n", " \"Power drills\", \"Cordless screwdrivers\", \"Tool sets\", \"Ladders\", \n", " \"Paint sprayers\", \"Gardening tools\", \"Lawn mowers\", \"Chainsaws\", \n", " \"Pressure washers\", \"Solar lights\", \"Smart locks\", \"Security cameras\", \n", " \"Doorbell cameras\", \"Thermostats\", \"Wall mounts\", \"Curtain rods\", \n", " \"Faucets\", \"Showerheads\", \"Screwdrivers\", \"Pliers\",\n", "\n", " # Miscellaneous\n", " \"Books\", \"eBooks\", \"Gift cards\", \"Board games\", \"Puzzle sets\", \n", " \"Calendars\", \"Planners\", \"Notebooks\", \"Pens and markers\", \n", " \"Phone cases\", \"Laptop sleeves\", \"Portable coffee mugs\", \n", " \"Reusable water bottles\", \"Eco-friendly straws\", \"Bike helmets\", \n", " \"Electric scooters\", \"Camera lenses\", \"Tripods\", \"Greenhouse kits\", \n", " \"Seed starter kits\", \"Fitness apps\", \"Streaming subscriptions\",\n", "\n", " # common nouns\n", " \"car\", \"bicycle\", \"phone\", \"computer\", \"dress\", \"shoe\",\n", " \"watch\", \"jewelry\", \"bread\", \"rice\", \"chocolate\", \n", " \"pizza\", \"burger\", \"cake\", \"milk\", \"cheese\", \"butter\",\n", " \"knife\", \"spoon\", \"fork\", \"glass\", \"bottle\",\n", " \n", "]\n", "\n", "translation_examples_partial = [\n", " \"translate to\", \"how to say in\", \"meaning of word\", \"translate phrase\", \n", " \"language translation\", \"definition in\", \"translate from\", \"dictionary for\", \n", " \"how to pronounce\", \"spell in\", \"word meaning\", \"basic phrases\", \n", " \"translation for\", \"translate app\", \"how to write\", \"pronunciation guide\", \n", " \"vocabulary\", \"common phrases\", \"phrasebook\", \"translate sentence\",\n", " \"dictionary lookup\", \"phrase meaning\", \"find synonyms\", \"language converter\",\n", " \"grammar check\", \"English to\", \"how to read\", \"how to spell\", \"pronunciation of\",\n", " \"definition lookup\", \"language helper\", \"correct spelling\", \"translation options\",\n", " \"language tutor\", \"vocabulary booster\", \"common questions\", \"phrases in\", \n", " \"meaning finder\", \"language app\", \"multi-language support\", \"phrase examples\",\n", " \"learn expressions\", \"phrase structure\", \"language guide\", \"convert to\"\n", "]\n", "\n", "unknown_examples_partial = [\n", " 'snoozlegrip', 'shenanigans', 'kerplunk', 'clip', 'snappyy', 'spindlywhack', 'crinkly', 'pressed enter too soon', \n", " 'try this', 'query here', 'mistyped selection', 'smorgasbord', 'crumplify', 'snooze', 'twonkle', 'bamboozlemate', \n", " 'this doesn’t matter', 'zap', 'mind blank', 'hiss', 'snagged', 'splurgy', 'snagglebash', 'guess', 'zapz', 'frap', \n", " 'blotter', \"don't even know\", 'don’t know answer', 'spindletastic', 'zizzlesplat', 'jinkled', 'placeholder search', \n", " 'uncertain search', 'splode', 'abcxyz', 'twangleblop', 'shifty', 'bumfuzzle', 'plunge', 'thingy', \n", " 'swooshenator', 'quark', 'tatterblast', 'frizzlefry', 'something random', 'puff', 'blobby', 'placeholder attempt', \n", " 'weird example', 'wiggle', 'snortleboo', 'bouncy', 'qwerty', 'whirl', 'nix', 'idk what', 'random search', \n", " 'glimmering', 'guzzle', 'strange text', 'accidental hit', 'forgot keypress', 'dazzleplunk', 'snurply', \n", " 'confused', 'weird gibberish', 'idc either', 'test123', 'huff', 'supercalifragilistic', 'clap', 'whoopsie', 'nump', \n", " 'lorem ipsum', 'snuffle', 'unknown phrase', 'whizz', 'bloop', 'glitch', 'zomp', 'clappy', 'gush', 'zappletastic', \n", " 'hooey', 'bing', 'slap', 'ting', 'miscellaneous', 'jingle', 'idk just looking', 'twangy', 'dinglefrizzle', \n", " 'just clicking', 'quizzical', 'splatterdash', 'kerplunkitude', 'fizzlematic', 'piff', 'jazz', 'jib', 'random phrase', \n", " 'flapper', 'uhmm', 'nothing much', 'sdf', 'snub', 'confusing example', 'keyboard smash', 'randomized words', \n", " 'nothing useful', 'random sentence', 'placeholder input', 'splattergrip', 'zorp', 'fluffernutter', 'splopp', \n", " 'incomplete search', 'check this out', 'woozle', 'bananarama', 'quiz', 'spiffy', 'undefined', 'confusing term', 'sploom', \n", " 'randomized example', 'spliffy', 'ooze', 'blazing', 'uncertain input', 'unknown search', 'random guesses', \n", " 'unknown', 'concept unclear', 'accidental input', 'sporkinator', 'whats this', 'maybe', 'ignore this', 'twinkle', \n", " 'whatchamacallit', 'splank', 'weird thing', 'huh', 'into the unknown', 'chaos', 'wigglie', 'twistamatic', 'kerflapify', \n", " 'twizzletude', 'mock', 'thud', 'shrug', 'grizzed', 'jibberjabber', 'weirdness', 'anything', 'plop', 'dazzlicious', \n", " 'random selection', 'splatt', 'abracadabra', 'whooshenator', 'random mouse click', 'sparklefish', 'banal', \n", " \"what's the word\", 'mistyped search', 'twinklebash', 'splush', 'splazz', 'forgot search term', 'crumplamatic', 'glee', \n", " 'whizzy', 'whizzlemate', 'jumpy', 'dork', 'randomxyz', 'gobsmacktastic', 'no clue what', 'zazz', 'beyond the void', \n", " 'weird try', 'drift', 'yank', 'yodelsnap', 'biff', 'forgot randomness', 'splatterblast', 'no idea', 'smooshify', \n", " 'peep', 'rick', 'splendiferous', 'squishy', 'muff', 'flabbergizmo', 'confuzzled', 'I think so', 'zing', \n", " 'meaningless typing', 'shush', 'zany', 'don’t need help', 'randomly chosen', 'warpydash', 'forgot words', \n", " 'placeholder typing', 'spunky', 'spindleplop', 'crash', 'flabbergast', 'snaggleplop', 'hootnanny', 'blurp', \n", " 'miff', 'snarkle', 'snookie', 'gleamitude', 'hello world', 'zag', 'accidental gibberish', 'nothing in mind', \n", " 'bash', 'spiv', 'rift', 'don’t know what to search', 'splong', 'no point', 'forgot attempt', 'fluttermate', \n", " 'flub', 'guff', 'dazzled', 'doodad', 'forgot term', 'blotchy', 'odd', 'kerplazzle', 'grubby', 'try to see', 'glop', \n", " 'whooshify', 'snicker', 'snuffly', 'random thought', 'mixed up stuff', 'zapper', 'sort of searching', 'slushy', \n", " 'blurification', 'mop', 'smit', 'splurge', 'meaningless input', 'quix', 'zapplarific', 'splang', 'zoinkalicious', \n", " 'unclear selection', 'splushy', 'guesstimate', 'snazzie', 'what about this', 'input fail', 'codswallop', 'dink', 'splunk', \n", " 'unclear', 'strange example', 'jitter', 'sploff', 'blip', 'unknown meaning', 'nope', 'gadzooks', 'odd example', \n", " 'zappomatic', 'janglystorm', 'ink', 'wobbled', 'wigglyy', 'typed by mistake', 'twirly', 'lurk', 'kerplottify', \n", " 'twizzlefang', 'muck', 'clunky', 'splatterific', 'clippy', 'oops input', 'what am I doing', 'qazwsxedc', 'does it matter', \n", " 'nonsensical', 'swooshinator', 'poiuuy', 'splish', 'mistyped query', 'squizzlewhack', 'what now', 'spluzz', 'glim', \n", " 'placeholder keypress', 'mistyped randomness', 'what is it', 'don’t know why', 'quibbleplop', 'guess what', 'snizzlezap', \n", " 'meaning of nothing', 'wiggles', 'zxcvbn', 'spur', 'uncertain term', 'what am I typing', 'zoodleblorp', 'floppy', 'asdfasdf', \n", " 'confused input', 'unclear sentence', 'snortlematic', 'smooshinator', 'random term', 'searching something', \n", " 'snorflemate', 'twinkly', 'skip', 'quib', 'forgotten term', 'oops', 'splodge', 'meaningless words', 'unclear input', \n", " 'unclear phrase', 'zoom', 'sneeze', 'cat on keyboard', 'nincompoop', 'zappification', 'warpington', 'splurty', \n", " 'do I know', 'splott', 'splurb', 'plink', 'dazzlematic', 'could be anything', 'lost thoughts', 'what', 'pizz', \n", " 'jiggles', 'splodgy', 'twang', 'i forgot', 'meaningless term', 'unclear search', 'thunderplunk', 'just pressing keys', \n", " 'splodgify', 'flit', 'snazzify', 'zoop', 'totally confused', 'quip', 'womp', 'wham', 'wigglyz', 'fuzzyy', 'why is this here', \n", " 'malarkey', 'widget', 'don’t care', 'scoff', 'randomized search', 'unclear example', 'pop', 'quash', 'uh oh', \n", " 'placeholder randomness', 'splatification', 'snickerplunk', 'nutterbutter', 'whisk', 'nibs', 'help', 'strange attempt', \n", " 'blurptacular', 'gizmo', 'forgotten query', 'spazzy', 'ding', 'lost search', 'buzzing', 'hum', 'nonsensicality', \n", " 'gloop', 'globby', 'lost meaning', 'plopperific', 'hard to say', 'snappy', 'don’t type this', 'blunderous', 'twizzlegrip', \n", " 'flappy', 'random keypress', 'zizzlewhack', 'forgot what I typed', 'zingerdoodle', 'randomized attempt', 'unsure words', \n", " 'strange sentence', 'asfjkl', 'frizz', 'idk', 'gobbledygook', 'flibbertigibbet', 'gadzookify', 'flabberzap', 'vroom', \n", " 'splitch', 'glimmerstorm', 'blurt', 'frizzle', 'meaningless search', 'thingamajig', 'murmur', 'not this', 'sploof', \n", " 'fiddlewhip', 'mumbojumbo', 'something strange', 'splurg', 'fake input', 'whiffle', 'forgot query', 'search mix', \n", " 'yapplify', 'zippy', 'splurpy', 'splat', 'zoinks', 'bizz', 'crumby', 'meaningless query', 'snickerdoodle', 'weird word', \n", " 'squidge', 'don’t know term', 'spangletude', 'spazzmatic', 'just testing', 'baffled', 'splurt', 'gaze', 'frizzy', \n", " 'bamboozling', 'slurp', 'zappertude', 'splorch', 'swooshtastic', 'dunk', 'honk', 'smudgy', 'flimmerstorm', 'tizz', \n", " 'uncertain randomness', 'jangletude', 'perhaps this', 'placeholder search term', 'whoosh', 'spike', 'glitterbop', \n", " 'idiosyncratic', 'odd typing', 'blob', 'bazzlemate', 'crumpleton', 'clutterbomb', 'whatever', 'kerfuffle', 'test input', \n", " 'randomized keypress', 'meaningless randomness', 'why not', 'snizzleblap', 'bonk', 'forgot search', 'zonk', 'whatsisname', \n", " 'doesn’t matter', 'splurgz', 'twig', 'ramblethorp', 'fake query', 'ping', 'smack', 'buzz', 'tingly', 'warpydoodle', \n", " 'filler words', 'buzzed', 'unclear thought', 'weird input', 'blap', 'snazzy', 'look for this', 'snorkelwhip', 'spoon', \n", " 'just guessing', 'glitche', 'swirl', 'snooker', 'search fail', 'random gibberish', 'abstract thought', 'spindelicious', \n", " 'snorple', 'fell asleep typing', 'splunge', 'twit', 'grippy', 'flip', 'whatsisface', 'maybe something', 'bamboozle', \n", " 'zinger', 'drizzleblip', 'splonky', 'what do I search', 'blat', 'another try', 'odd randomness', 'yarn', 'squib', \n", " 'confused term', 'flabbergasted', 'testing input', 'don’t know', 'thunderbop', 'blurpsational', 'janglydash', 'brouhaha', \n", " 'find out about', 'strange randomness', 'kerplizzle', 'meaningless attempt', 'spud', 'placeholder term', 'woof', 'splaff', \n", " 'jigglez', 'fuzzed', 'blahblah', 'grizzle', 'something here', 'blink', 'snuggly', 'yelp', 'chop', 'eternal question', 'splift', \n", " 'what do you mean', 'hullabazoo', 'cloggy', 'wrong key pressed', 'test again', 'don’t ask me', 'blur', 'twisty', 'flapperdash', \n", " 'crinklewhip', 'plinky', 'gobbleplop', 'I don’t understand', 'random', 'dummy text', 'blurblenator', 'try something', 'input here', \n", " 'thing', 'fringe', 'no answer', 'placeholder selection', 'test', 'spangleplop', 'splash', 'lost in thought', 'zest', \n", " 'fiddleplop', 'bunk', 'snag', 'vex', 'placeholder randomness example', 'spat', 'placeholder phrase', 'random search term', \n", " 'squigg', 'tinge', 'random words', 'unknown query', 'not useful', 'snuzzlefrump', 'type here', 'snuzzle', 'drip', 'gibberish', \n", " 'hodgepodge', 'forgot the term', 'completely random', 'doesn’t make sense', 'lost', 'splatterstorm', 'meaningless text', \n", " 'twizzle', 'find something', 'twinkletude', 'zine', 'spunked', 'crikey', 'mistaken input', 'no idea what this is', 'spork', \n", " 'glimmertastic', 'sloppy', 'twirky', 'abstract query', 'fluffytude', 'randomized selection', 'randomized randomness', \n", " 'nudge', 'gawk', 'buzzer', 'nonsensical search', 'i was curious', 'zapplify', 'cloppy', 'doohickey', 'snickly', 'doodle', \n", " 'placeholder example', 'placeholder text', 'nonsense search', 'why search this', \"this doesn't work\", 'splendiferific', \n", " 'crappy', 'what are words', 'clop', 'randomized term', 'weird', 'snazztastic', 'whizzbang', 'blaze', 'twangaloo', \n", " 'strange keypress', 'placeholder query', 'skew', 'splink', 'lkjhgfd', 'unclear meaning', 'flummoxify', 'lollygag', \n", " 'odd gibberish', 'clunk', 'snap', 'zapf', 'flummoxed', 'yawn', 'random input', 'strange word', 'zapplomatic', \n", " 'does this work', 'gasp', 'typing nothing', 'idk anymore', 'empty thoughts', 'pluck', 'randomized test', \n", " 'brain fog', 'squibbletude', 'fizzle', 'jinglyy', 'mistyped term', 'confused mind', 'random typing', 'asdfgh', \n", " 'infinity', 'twist', 'something typed', 'kerplunktastic', 'just trying this', 'mistaken search', 'sparklematic', \n", " 'woop', 'jittery', 'oopsie', 'snippy', 'splinky', 'splint', 'swooshification', 'spit', 'zinged', 'blop', 'lost words',\n", " 'crux', 'blurbleplop', 'balderdash', 'perhaps not', 'flibber', 'snickerwhack', 'try later', 'zork', 'void', \n", " 'accidental query', 'fumble', 'snarked', 'don’t care search', 'just looking', 'spindling', 'snip', 'squish', \n", " 'blazer', 'splo', 'splunky', 'unclear randomness', 'spliff', 'not this either', 'nonsensical words', \n", " 'testing random', 'snigglewhap', 'odd input', 'whizzlegrip', 'dazzlegrip', 'fling', 'meaning of gibberish', \n", " 'weird thoughts', 'gunk', 'does this help', 'flux', 'wink', 'wonky', 'wisp', 'drizzlematic', 'another test', \n", " 'test search', 'just wondering', 'crumblewhack', 'spaz', 'splung', 'skid', 'quirky', 'odd search', 'accidental term', \n", " 'dunno', 'quizzicality', 'gleam', 'glimmer', 'don’t press enter', 'gadget', 'whizzleplop', 'don’t know exactly', \n", " 'odd words', 'blotty', 'thunderblop', 'maybe not', 'spludge', 'discombobulated', 'stuff', 'halfway done', \n", " 'sparklenator', 'zang', 'jolt', 'accidental search', 'what is going on', 'wiggler', 'mnbvcxz', 'yip', 'wriggle', \n", " 'hullaballoo', 'janglenut', 'zapplesmash', 'janglitude', 'what is this', 'whip', 'tiddlywinks', 'wiggly', 'weird randomness', \n", " 'sporkalicious', 'wriggy', 'meaningless selection', 'crumble', 'weird thought', 'splurch', 'don’t understand', \n", " 'sploosh', 'yap', 'nonsense', 'wobble', 'question of life', 'randomly typed', 'snuggle', 'snizzlegrip', 'oops I typed', \n", " 'zappy', 'twinkleplop', 'uncertain example', 'idc', 'mash', 'not sure', 'pandemonium', 'perhaps later', 'quirked', \n", " 'smug', 'warp', 'dash', 'could be nothing', 'unsure search', 'jumbled phrases', 'hush', 'wibble', 'weird search', \n", " 'quibberish', 'flop', 'discombobulate', 'this makes no sense', 'fizz', 'quirkitude', 'zingzang', 'dank', 'limitless', \n", " 'this is random', 'crunch', 'vibe', 'nothing specific', 'forgot', 'not important', 'slosh', 'question mark', 'zoopendous', \n", " 'flummify', 'splosh', 'splorp', 'splishy', 'snurkle', 'blah', 'guess answer', 'twitch', 'flap', 'snooperdoodle', \n", " 'janglybits', 'snizzleflap', 'slush', 'snortlemate', 'quirk', 'void query', 'fizzled', 'lollygagging', 'wonkifying', \n", " 'nothing', 'splunch', 'hullabaloo', 'thingamabob', 'dazzlebash', 'whizzie', 'this and that', 'shard', 'twix',\n", " \"crumpled\", \"splizzle\", \"gargle\", \"mangled\", \"shamble\", \"wobblish\", \"drizzlepop\",\n", " \"splinker\", \"fiddlest\", \"twizzlepop\", \"blurzzle\", \"snizzlewick\", \"wozzle\", \n", " \"cracklepop\", \"glibbish\", \"twezzle\", \"boondock\", \"sizzleflip\", \"snigglemash\",\n", " \"zazzle\", \"fizzlepot\", \"scramble\", \"tinglish\", \"sprozzle\", \"blimble\", \"zibble\",\n", " \"slapdash\", \"gobstork\", \"ziggler\", \"flingle\", \"wrangly\", \"twizzlebit\", \"brambly\",\n", " \"snubble\", \"splintery\", \"fizznack\", \"tibber\", \"quaggly\", \"whooshpop\", \"snibble\",\n", " \"plunkish\", \"glimflash\", \"wobbert\", \"squidgy\", \"kerplonk\", \"fobble\", \"blurzy\",\n", " \"scriggly\", \"smudgify\", \"tassler\", \"whipple\", \"snuzzify\", \"zaggle\", \"plonker\",\n", " \"smizzle\", \"quiggle\", \"spongle\", \"shizzle\", \"drippity\", \"bogglepop\", \"twiddly\",\n", " \"puzzleth\", \"flummish\", \"sniggleflop\", \"crumplish\", \"twiggle\", \"nubbish\", \n", " \"splurkle\", \"whibber\", \"jibblish\", \"twonker\", \"fizzlewhip\", \"spazzle\", \"splorpish\",\n", " \"snuffler\", \"hubble\", \"twinkler\", \"crumpler\", \"wimbley\", \"twazzle\", \"blurbonic\",\n", " \"zapplepop\", \"flippery\", \"snuzle\", \"quizzwhip\", \"clatter\", \"garglunk\", \"splingle\",\n", " \"drabbler\", \"spunkly\", \"jumbler\", \"snappish\", \"zingify\", \"buzzpop\", \"snizzlehop\",\n", " \"plobber\", \"scribble\", \"twongle\", \"scrabbly\", \"sniggler\", \"bimblepop\", \"snorplebop\",\n", " \"wizzle\", \"blimpy\", \"splinglepop\", \"frizzlepop\", \"grizzleton\", \"whizbang\", \n", " \"tinklish\", \"blopple\", \"blurbit\", \"wozzly\", \"zingpong\", \"splimble\", \"twinklypop\",\n", " \"spinkly\", \"snubbleton\", \"glozzle\", \"splonkle\", \"quizzle\", \"drizzlebot\", \"snarbly\",\n", " \"twizzleth\", \"whizzleton\", \"crumblish\", \"snapple\", \"splozzle\", \"glimmish\", \n", " \"plimbish\", \"snuzzleblop\", \"twinklish\", \"fizzywhip\", \"snorblish\", \"drizzler\", \n", " \"flopplish\", \"smizzlepop\", \"crumpledash\", \"twizzlefizz\", \"plumbly\", \"smuzzle\",\n", " \"tizzler\", \"gobblish\", \"splunkton\", \"jibberdash\", \"sproingly\", \"snizzler\", \n", " \"glabble\", \"twinkleflip\", \"flobble\", \"twonklepop\", \"splittish\", \"grumblepop\",\n", " \"whimblish\", \"splingledash\", \"snarpish\", \"twinklybit\", \"spindlish\", \"grubble\",\n", " \"smarple\", \"twonkerish\", \"sniffly\", \"snibbleton\", \"grizzlepop\", \"tazzler\", \n", " \"splinsh\", \"snazzler\", \"twinklepuff\", \"zopple\", \"glunkish\", \"crizzlepop\", \n", " \"snarklebot\", \"whibblish\", \"flimmerdash\", \"splurpyton\", \"snuzzlepop\", \"wigglerish\",\n", " \"sniggleplop\", \"jigglish\", \"splurble\", \"buzzsnip\", \"plomble\", \"splattypop\", \n", " \"twinklepip\", \"twonglish\", \"flobber\", \"grimpish\", \"quaggler\", \"sporkish\", \n", " \"drizzleth\", \"squiggler\", \"splobber\", \"ploppish\", \"snigglerish\", \"splingleth\",\n", " \"grizzleblop\", \"sploblish\", \"snarbler\", \"smarvish\", \"quizzlet\", \"snapplish\",\n", " \"snuzleflip\", \"plongish\", \"crizzlebot\", \"grimpish\", \"twinklebot\", \"blurpish\",\n", " \"splopple\", \"gizzleth\", \"drizzlepuff\", \"twonklish\", \"snubbler\", \"blurblebot\",\n", " \"splizzy\", \"twinkleton\", \"jibbler\", \"splizzlepop\", \"splurbit\", \"plobblish\", \n", " \"crumplish\", \"snizzlebit\", \"twinklishbot\", \"spinkler\", \"snibbleflip\", \"wigglebot\",\n", " \"twonglishbot\", \"snizzleton\", \"splongle\", \"blonker\", \"glimmerbit\", \"snarvish\",\n", " \"love\", \"anger\", \"hope\", \"dream\", \"thought\", \"courage\", \n", " \"strength\", \"patience\", \"birthday\", \"anniversary\", \n", " \"vacation\", \"weekend\", \"holiday\", \"winter\", \"summer\", \n", " \"autumn\", \"spring\", \"success\", \"failure\", \"freedom\", \"peace\", \"wisdom\", \n", " \"kindness\", \"respect\", \"free\", \"freedom\", \"great\", \"best\", \"worst\", \"last\", \"first\", \"second\", \n", " \"next\", \"there\", \"proposal\",\n", " \"proposa\", \"big city\", \"banana\", \"mango\", \"pineapple\", \"apple\", \"grapes\", \"orange\",\n", " \"Big City\", \"Silver City\", \"Golden City\", \"Mystic City\",\n", " \"Sunset City\", \"Iron City\", \"Emerald City\", \"Shadow City\", \"Crystal City\",\n", " \"Harmony City\", \"Aurora City\", \"Dream City\", \"Thorn City\", \"Lunar City\", \"Twilight City\", \n", " \"Velvet City\", \"Willow City\", \"Ivory City\", \"Eclipse City\",\n", " \"Storm City\", \"Bliss City\", \"Shimmer City\", \"Echo City\", \"Frost City\",\n", " \"Sapphire City\", \"Obsidian City\", \"Tranquil City\", \"Starlight City\",\n", " \"Drift City\", \"Amber City\", \"Hollow City\", \"Gilded City\", \"Quartz City\",\n", " \"Meadow City\", \"Rosewood City\", \"Timber City\", \"Bright City\", \"Fox City\",\n", " \"Dusk City\", \"Goldenleaf City\", \"Wind City\", \"Harbor City\", \"Cedar City\",\n", " \"Azure City\", \"Elder City\", \"Crescent City\", \"Pine City\", \"Summit City\",\n", " \"Cobalt City\", \"Bluff City\", \"Stone City\",\n", "\n", "]\n", "\n", "\n" ] }, { "cell_type": "code", "execution_count": null, "id": "25f87d44-bc1b-4a13-8b68-e089946127c9", "metadata": {}, "outputs": [], "source": [ "print(f\"#information_examples_partial examples = {len(information_examples_partial)}\")\n", "print(f\"#yelp_examples_partial examples = {len(yelp_examples_partial)}\")\n", "print(f\"#weather_examples_partial examples = {len(weather_examples_partial)}\")\n", "print(f\"#navigation_examples_partial examples = {len(navigation_examples_partial)}\")\n", "print(f\"#travel_examples_partial examples = {len(travel_examples_partial)}\")\n", "print(f\"#purchase_examples_partial examples = {len(purchase_examples_partial)}\")\n", "print(f\"#translation_examples_partial examples = {len(translation_examples_partial)}\")\n", "print(f\"#unknown_examples_partial examples = {len(unknown_examples_partial)}\")\n" ] }, { "cell_type": "code", "execution_count": null, "id": "5875eada-c145-4a8d-9885-b887c987d81e", "metadata": {}, "outputs": [], "source": [ "# Add noise to simulate partial, incomplete, or typo-filled queries\n", "def generate_partial_variations(base_phrase, num_partial_variations=3):\n", " variations = []\n", " for _ in range(num_partial_variations): # Create more variations per base phrase\n", " # Truncate phrase\n", " # trunc_index = random.randint(len(base_phrase) // 2, len(base_phrase) - 1)\n", " trunc_index = random.randint(len(base_phrase) - 2, len(base_phrase) - 1)\n", " truncated = base_phrase[:trunc_index].strip()\n", " \n", " # Add typos\n", " typo_index = random.randint(0, len(truncated) - 1)\n", " typo_variation = truncated[:typo_index] + random.choice(\"abcdefghijklmnopqrstuvwxyz\") + truncated[typo_index + 1:]\n", " \n", " # Add random prefix/suffix\n", " prefix = random.choice([\"how\", \"find\", \"get\", \"best\", \"near\"]) if random.random() > 0.99 else \"\"\n", " suffix = random.choice([\"info\", \"details\", \"nearby\", \"today\", \"now\"]) if random.random() > 0.99 else \"\"\n", " \n", " # Combine\n", " combined_variation = f\"{prefix} {typo_variation} {suffix}\".strip()\n", " variations.append(combined_variation)\n", " \n", " return variations\n", "\n", "preModifiers = [\"best\", \"cheap\", \"good\", \"affordable\", \"budget\", \"top quality\", \"absolutely best\", \"cheapest\", \n", " \"best rated\", \"best local\", \"the best\", \"local\", \"find local\", \"small local\", \"list of\"]\n", "# Generate a large dictionary of entries by combining base phrases with variations\n", "def generate_large_entry_dict(base_examples, target_intent, num_variations):\n", " entries = {}\n", " \n", " for example in base_examples:\n", " entries[example] = target_intent\n", " if target_intent == 'yelp_intent':\n", " for prefix in random.choices(preModifiers, k=5):\n", " entries[prefix + \" \" + example] = target_intent\n", " num_partial_variations = 2\n", " elif target_intent == 'purchase_intent':\n", " for prefix in random.choices(preModifiers, k=1):\n", " entries[prefix + \" \" + example] = target_intent\n", " num_partial_variations = 1\n", " elif target_intent == 'unknown':\n", " num_partial_variations = 1\n", " elif target_intent == 'navigation_intent':\n", " num_partial_variations = 1\n", " elif target_intent == 'information_intent':\n", " num_partial_variations = 0\n", " else:\n", " num_partial_variations = 2\n", " variations = generate_partial_variations(example, num_partial_variations)\n", " for variation in variations:\n", " if variation not in entries and len(entries) < num_variations and len(variation) > 3:\n", " entries[variation] = target_intent\n", " return entries\n", "\n", "# Compile all intents with increased variation\n", "partial_queries_with_intents = {}\n", "partial_queries_with_intents.update(generate_large_entry_dict(information_examples_partial, \"information_intent\", 5000))\n", "partial_queries_with_intents.update(generate_large_entry_dict(yelp_examples_partial, \"yelp_intent\", 12000))\n", "partial_queries_with_intents.update(generate_large_entry_dict(weather_examples_partial, \"weather_intent\", 3000))\n", "partial_queries_with_intents.update(generate_large_entry_dict(navigation_examples_partial, \"navigation_intent\", 3000))\n", "partial_queries_with_intents.update(generate_large_entry_dict(travel_examples_partial, \"travel_intent\", 3000))\n", "partial_queries_with_intents.update(generate_large_entry_dict(purchase_examples_partial, \"purchase_intent\", 3000))\n", "partial_queries_with_intents.update(generate_large_entry_dict(translation_examples_partial, \"translation_intent\", 500))\n", "partial_queries_with_intents.update(generate_large_entry_dict(unknown_examples_partial, \"unknown\", 3000))\n", "\n", "# Verify the total count\n", "print(f\"Total entries generated: {len(partial_queries_with_intents)}\")" ] }, { "cell_type": "code", "execution_count": null, "id": "ec2069a6-12d3-4e5e-94d0-5e7b8a1ecaeb", "metadata": {}, "outputs": [], "source": [ "len(purchase_examples_partial), len(information_examples_partial)" ] }, { "cell_type": "code", "execution_count": null, "id": "84e9a7e5-0f58-4be3-bf9d-61068b560ba9", "metadata": {}, "outputs": [], "source": [ "# purchase_examples_partial" ] }, { "cell_type": "code", "execution_count": null, "id": "5ad6c02c-8e33-408e-8606-009067edf179", "metadata": { "scrolled": true }, "outputs": [], "source": [ "partial_queries_with_intents" ] }, { "cell_type": "code", "execution_count": null, "id": "3b74d494-f4a0-4962-bbeb-ec719787693e", "metadata": {}, "outputs": [], "source": [ "partial_queries = []\n", "for query,target in partial_queries_with_intents.items():\n", " partial_queries.append({'sequence': query, \n", " 'target': target})\n", "partial_queries_df = pd.DataFrame(partial_queries)\n", "print(len(partial_queries_df))\n", "partial_queries_df" ] }, { "cell_type": "code", "execution_count": null, "id": "79f5ecab-660c-41f5-a99e-2d352f75d186", "metadata": {}, "outputs": [], "source": [ "partial_queries_df['target'].value_counts()" ] }, { "cell_type": "code", "execution_count": null, "id": "6d115a19-4aba-4959-9b45-0d8bb6536d98", "metadata": {}, "outputs": [], "source": [ "partial_queries_df.loc[partial_queries_df['target'] == 'navigation_intent']" ] }, { "cell_type": "code", "execution_count": null, "id": "2baf1b76-e63b-4eff-ae9b-0b6e5969f39f", "metadata": {}, "outputs": [], "source": [] }, { "cell_type": "code", "execution_count": null, "id": "5101385f-496e-4ee8-89fe-bc2517eb3578", "metadata": {}, "outputs": [], "source": [ "# def apply_target_mapping(df, target_mapping):\n", "# mapped_text_set = set()\n", "# for ngram in target_mapping.keys():\n", "# # mask = df['sequence'].apply(lambda text: ngram in text)\n", "# mask = df['sequence'].apply(lambda text: ngram in text and text not in mapped_text_set)\n", "# print(f'Number of matches found for \"{ngram}\" = {mask.sum()}')\n", "# print(f'size of mapped_text_set = {len(mapped_text_set)}')\n", "# df.loc[mask, 'target'] = target_mapping[ngram]\n", "# mapped_text_set.update(df.loc[mask, 'sequence'].values.tolist())\n", "# print()" ] }, { "cell_type": "code", "execution_count": null, "id": "0b5880c0-ca6d-4394-b482-5704adf52fa0", "metadata": {}, "outputs": [], "source": [ "def apply_target_mapping(df, target_mapping, ngram, mapped_text_set):\n", " # mapped_text_set = set()\n", " # for ngram in target_mapping.keys():\n", " # mask = df['sequence'].apply(lambda text: ngram in text)\n", " mask = df['sequence'].apply(lambda text: ngram in text and text not in mapped_text_set)\n", " print(f'Number of matches found for \"{ngram}\" = {mask.sum()}')\n", " print(f'size of mapped_text_set = {len(mapped_text_set)}')\n", " df.loc[mask, 'target'] = target_mapping[ngram]\n", " mapped_text_set.update(df.loc[mask, 'sequence'].values.tolist())\n", " print()" ] }, { "cell_type": "code", "execution_count": null, "id": "f6322201-5190-42c5-9040-33df3c6f43a9", "metadata": {}, "outputs": [], "source": [ "to_be_labelled = marco_df.loc[marco_df['target'].isna()].copy()\n", "labelled = marco_df.loc[~marco_df['target'].isna()].copy()" ] }, { "cell_type": "code", "execution_count": null, "id": "6ec67bea-6489-4d14-83b0-13a34f25c04b", "metadata": {}, "outputs": [], "source": [ "len(to_be_labelled), len(labelled)" ] }, { "cell_type": "code", "execution_count": null, "id": "ae058794-cf68-49ce-9eb4-cf3f97ee1fe9", "metadata": {}, "outputs": [], "source": [ "manual_labelled = pd.read_csv(\"../data/manual_labels_v2.csv\")\n", "manual_labelled = manual_labelled.loc[~manual_labelled['target'].isna()]\n", "print(len(manual_labelled))\n", "print(manual_labelled['target'].value_counts())\n", "manual_labelled_lkp = manual_labelled[['sequence','target']].set_index('sequence').to_dict()['target']\n", "manual_labelled.head()" ] }, { "cell_type": "code", "execution_count": null, "id": "e415ba5f-f845-4944-a560-cede49ab3516", "metadata": {}, "outputs": [], "source": [ "def apply_manual_mapping(df, manual_labelled_lkp):\n", " mask = df['sequence'].apply(lambda text: text in manual_labelled_lkp)\n", " print(f'Number of matches found in manual labels = {mask.sum()}')\n", " df.loc[mask, 'target'] = df.loc[mask, 'sequence'].map(manual_labelled_lkp)\n", " print()" ] }, { "cell_type": "code", "execution_count": null, "id": "6077b1a2-47aa-4541-aa4c-3bc15865ccb8", "metadata": {}, "outputs": [], "source": [ "apply_manual_mapping(to_be_labelled, manual_labelled_lkp)\n", "labelled = pd.concat([labelled, to_be_labelled.loc[~to_be_labelled['target'].isna()]], axis=0).sample(frac=1.0)\n", "to_be_labelled = to_be_labelled.loc[to_be_labelled['target'].isna()]\n", "print(f\"to_be_labelled: {len(to_be_labelled)}, labelled: {len(labelled)}\")" ] }, { "cell_type": "code", "execution_count": null, "id": "32d57274-d2f3-4a31-8dae-62afa458bc02", "metadata": { "scrolled": true }, "outputs": [], "source": [ "\n", "print(f\"Number of examples labeled = {len(labelled)}\")\n", "print(f\"Number of examples to be labeled = {len(to_be_labelled)}\")\n", "print(f\"Label stats \\n{labelled['target'].value_counts()}\\n\")\n", "\n", "# Step 3: Get most common n-grams for a given n\n", "n = 2 # Change this to any n (e.g., 1 for unigrams, 3 for trigrams)\n", "to_be_labelled_sequence_list = to_be_labelled['sequence'].values.tolist()\n", "ngram_counter = count_ngrams(to_be_labelled_sequence_list, n)\n", "most_common_ngrams = ngram_counter.most_common(100)\n", "\n", "# Display the most common n-grams\n", "print(most_common_ngrams)\n", "\n", "# Example usage with a limit on the number of results\n", "cnt = 0\n", "for query in search_queries_by_words(\"5 star\", to_be_labelled_sequence_list):\n", " if cnt >= 100: # Stop after 20 results\n", " break\n", " print(cnt + 1, query)\n", " cnt += 1\n", "\n" ] }, { "cell_type": "code", "execution_count": null, "id": "5f004548-de86-4d95-bf68-366010ccfb3d", "metadata": {}, "outputs": [], "source": [ "translate_intent_additional_queries_df" ] }, { "cell_type": "code", "execution_count": null, "id": "3843c4cd-a774-40b9-b636-378a4c613af0", "metadata": {}, "outputs": [], "source": [ "weather_examples" ] }, { "cell_type": "code", "execution_count": null, "id": "9f7e14bb-6033-460e-9bbd-7f50329ba49c", "metadata": {}, "outputs": [], "source": [ "general_yelp_keyword[:10]" ] }, { "cell_type": "code", "execution_count": null, "id": "8087250e-67dc-44b9-8687-fcca4ddae15e", "metadata": {}, "outputs": [], "source": [ "one_word_yelp_examples = [kw for kw in general_yelp_keyword if len(kw.split(\" \")) <= 2]\n", "len(one_word_yelp_examples)" ] }, { "cell_type": "code", "execution_count": null, "id": "d10df987-ceef-4630-bbba-ae396547eb34", "metadata": {}, "outputs": [], "source": [ "one_word_yelp_examples_df = pd.DataFrame({\"sequence\": one_word_yelp_examples * 3}) \n", "one_word_yelp_examples_df['target'] = 'yelp_intent'\n", "one_word_yelp_examples_df" ] }, { "cell_type": "code", "execution_count": null, "id": "752c7482-c37b-44d9-8de3-b8751bd1d48f", "metadata": { "scrolled": true }, "outputs": [], "source": [ "labelled = pd.concat([labelled, \n", " weather_examples, \n", " yelp_examples, \n", " purchase_intent_examples, \n", " yelp_intent_additional_queries_df,\n", " navigation_intent_additional_queries_df,\n", " travel_intent_additional_queries_df,\n", " translate_intent_additional_queries_df,\n", " unknown_intent_additional_queries_df,\n", " # information_intent_additional_queries_df,\n", " partial_queries_df,\n", " one_word_yelp_examples_df,\n", " ], axis=0)\n", "mapped_text_set = set()\n", "for i, ngram in enumerate(target_mapping.keys()):\n", " print()\n", " print(f\"iteration {i+1}: to_be_labelled: {len(to_be_labelled)}, labelled: {len(labelled)}\")\n", " apply_target_mapping(to_be_labelled, target_mapping, ngram, mapped_text_set)\n", " labelled = pd.concat([labelled, to_be_labelled.loc[~to_be_labelled['target'].isna()]], axis=0)\n", " to_be_labelled = to_be_labelled.loc[to_be_labelled['target'].isna()]" ] }, { "cell_type": "code", "execution_count": null, "id": "1a0e1c09-2776-487d-b5eb-3c2e4952c2a0", "metadata": {}, "outputs": [], "source": [ "labelled = labelled.sample(frac=1.0, replace=False)" ] }, { "cell_type": "code", "execution_count": null, "id": "e5d08bd7-623c-4831-9496-1f31e6f5b36c", "metadata": {}, "outputs": [], "source": [ "labelled[:60]" ] }, { "cell_type": "markdown", "id": "ecd6c05a-df86-46a6-98f4-37f794e7e8a2", "metadata": {}, "source": [ "#### Skip this for manual labeling" ] }, { "cell_type": "code", "execution_count": null, "id": "92ea96db-4112-4492-99c9-5232eb9900c4", "metadata": {}, "outputs": [], "source": [ "## Only if special list for manual process needed else skip this \n", "\n", "SKIP_MANUAL_LABEL_PREP = True\n", "if not SKIP_MANUAL_LABEL_PREP:\n", " special_list = set()\n", " \n", " cnt = 0\n", " \n", " for query in search_queries_by_words(\"how much\", to_be_labelled_sequence_list):\n", " if cnt >= 10000: # Stop after 20 results\n", " break\n", " # print(cnt + 1, query)\n", " cnt += 1\n", " special_list.add(query)\n", " \n", " pd.DataFrame(special_list, columns=['sequence']).to_csv('special_list_manual_label.csv', index=False)" ] }, { "cell_type": "code", "execution_count": null, "id": "1ada08c3-7167-4680-abc1-fc7018798fcb", "metadata": {}, "outputs": [], "source": [ "to_be_labelled" ] }, { "cell_type": "code", "execution_count": null, "id": "5ddf19be-438d-444d-8c46-313670da0a3b", "metadata": {}, "outputs": [], "source": [ "labelled['target'].value_counts()" ] }, { "cell_type": "code", "execution_count": null, "id": "f930caa1-69b6-40a8-8e00-609a1b6e6f11", "metadata": {}, "outputs": [], "source": [ "plt.figure(figsize=(6,3))\n", "plt.title(\"training data distribution\")\n", "labelled['target'].value_counts().sort_values().plot.barh();" ] }, { "cell_type": "code", "execution_count": null, "id": "124d2cd5-6d6c-4732-9186-3525e244fec7", "metadata": {}, "outputs": [], "source": [ "# labelled.loc[labelled['target'] == 'translation_intent']['sequence'].sample(100).values" ] }, { "cell_type": "code", "execution_count": null, "id": "ded73e0b-a74f-4763-bd3d-320274b2236e", "metadata": { "scrolled": true }, "outputs": [], "source": [ "# labelled.loc[labelled['sequence'].apply(lambda q: \"sf \" in q)]['sequence'].values" ] }, { "cell_type": "code", "execution_count": null, "id": "88b28463-32da-43f0-a123-780bca3786ff", "metadata": {}, "outputs": [], "source": [ "combined = pd.concat([labelled, to_be_labelled], axis=0).reset_index(drop=True)\n", "print(len(combined))\n", "combined" ] }, { "cell_type": "code", "execution_count": null, "id": "66f460b9-76df-4290-84d1-c962f9ac0826", "metadata": {}, "outputs": [], "source": [ "labelled['target'].value_counts()" ] }, { "cell_type": "code", "execution_count": null, "id": "42cae81d-4caf-46d1-b3d4-3c1df799e736", "metadata": {}, "outputs": [], "source": [ "labelled.sample(frac=1.0,replace=False).to_csv(\"../data/marco_train_v7.csv\", index=False)" ] }, { "cell_type": "code", "execution_count": null, "id": "173c29d3-9f04-48e0-b2d9-b9bc89cb4d67", "metadata": {}, "outputs": [], "source": [ "import pandas as pd\n", "from umap import UMAP\n", "from sklearn.pipeline import make_pipeline \n", "from embetter.text import SentenceEncoder\n", "\n", "\n", "SKIP_ENCODING = False\n", "if not SKIP_ENCODING:\n", " # Build a sentence encoder pipeline with UMAP at the end.\n", " enc = SentenceEncoder('all-MiniLM-L6-v2')\n", " umap = UMAP()\n", " \n", " text_emb_pipeline = make_pipeline(\n", " enc, umap\n", " )\n", " \n", " # Load sentences\n", " X = combined['sequence'].values.tolist()\n", " \n", " # Calculate embeddings \n", " X_tfm = text_emb_pipeline.fit_transform(X)\n", " \n", " # Write to disk. Note! Text column must be named \"text\"\n", " df = pd.DataFrame({\"text\": X})\n", " df['x'] = X_tfm[:, 0]\n", " df['y'] = X_tfm[:, 1]\n", " df.to_csv(\"marco_ready.csv\", index=False)\n", " df['target'] = combined['target'].fillna('unknown')\n", "else:\n", " df = pd.read_csv(\"marco_ready.csv\")\n", " df['target'] = combined['target'].fillna('unknown')" ] }, { "cell_type": "code", "execution_count": null, "id": "077564f3-bfd0-4df1-b113-6beefb047cbf", "metadata": {}, "outputs": [], "source": [ "combined" ] }, { "cell_type": "code", "execution_count": null, "id": "cea4591a-868e-4060-8fe4-140c6f056b34", "metadata": { "scrolled": true }, "outputs": [], "source": [ "df" ] }, { "cell_type": "code", "execution_count": null, "id": "55e55825-e5fd-4f51-ad6f-7af163997410", "metadata": {}, "outputs": [], "source": [ "import plotly.express as px" ] }, { "cell_type": "code", "execution_count": null, "id": "747c92b0-a4f5-478a-ac7f-da882d2850c8", "metadata": {}, "outputs": [], "source": [ "fig_2d = px.scatter(\n", " df, x='x', y='y',\n", " color=df['target'], labels={'color': 'target'},\n", " hover_name=\"text\",\n", " opacity=0.3,\n", " title=\"marcos web search queries intents map\"\n", ")\n", "\n" ] }, { "cell_type": "code", "execution_count": null, "id": "664aa35b-d264-4c40-bcf4-1649fe3993bf", "metadata": {}, "outputs": [], "source": [ "fig_2d" ] }, { "cell_type": "code", "execution_count": null, "id": "a00e78ee-abed-4fa8-bc71-29544e9d5f01", "metadata": {}, "outputs": [], "source": [ "fig_2d.write_html(\"../reports/web_search_intents.html\")" ] }, { "cell_type": "code", "execution_count": null, "id": "30619067-30d4-470e-acbb-81d286863c56", "metadata": {}, "outputs": [], "source": [ "# [query for query in labelled.loc[labelled['target'] == 'yelp_intent']['sequence'].values.tolist() if 'medication' in query]" ] }, { "cell_type": "code", "execution_count": null, "id": "25935e6b-eba7-4be3-ad41-2395685e8355", "metadata": {}, "outputs": [], "source": [ "labelled.loc[labelled['target'] == 'yelp_intent']" ] }, { "cell_type": "code", "execution_count": null, "id": "3985017c-35d0-4122-b722-07dc4e9aee79", "metadata": {}, "outputs": [], "source": [ "len(to_be_labelled)" ] }, { "cell_type": "code", "execution_count": null, "id": "b791b17d-67db-40b9-9c23-415d3b177a17", "metadata": {}, "outputs": [], "source": [ "to_be_labelled" ] }, { "cell_type": "code", "execution_count": null, "id": "ac246c35-60bd-4c0f-b428-17e18727d39d", "metadata": {}, "outputs": [], "source": [ "to_be_labelled.to_csv('../data/to_be_labelled.csv', index=False)" ] }, { "cell_type": "code", "execution_count": null, "id": "924c0a57-976b-4b32-8fb4-b08fc989a0fd", "metadata": {}, "outputs": [], "source": [] } ], "metadata": { "kernelspec": { "display_name": "Python 3 (ipykernel)", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.11.0" } }, "nbformat": 4, "nbformat_minor": 5 }

notebooks/suggest_intent_data_prep_v2.ipynb (7,374 lines of code) (raw):