AI Movies Recommendation System with Clustering Based K-Means Algorithm.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "oDBo1ptFrus2"
   },
   "source": [
    "<h1 style = \"\">AI Movies Recommendation System Based on K-Means Clustering Algorithm"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Overview of Article"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In this article, we'll build an artificial intelligence movies recommendation system by using k-means algorithm which is a clustering algorithm. We'll recommend movies to users which are more relevant to them based on their previeous history. We'll only import those data, where users has rated movies 4+ as we want to recommend only those movies which users like most. In this whole article, we have used Python programming language with their associated liabraries i.e. NumPy, Pandas, Matplotlib and Scikit-Learn. Moreover, we have supposed that the reader has familiarity with Python and the aforementioned liabraries."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Introduction to AI Movies Recommendation System"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In this busy life as people don't have time to search for their desired item and even they want it on their table or even in a little effort. So, the recommendation system has become an important part to help them to make a right choice for their desired thing and to grow our product. Since data is increasing day by day and in this era with such a large database, it has even become a difficult task to find a more relevant item of our interest, because often we can't search an item of our interest with just a title and even sometime it is harder. So, recommendation system help us to provide a most relevant item to individual available in our database. \n",
    "\n",
    "In this article, we'll build a movies recommendation system. Movies recommendation system has become an essential part to movies website because an individual don't know which movies are more interested to him with just a title or genre. Sometime an individual likes action movies but he/she will not always like every action movie. To handle this problem, many authors has provided a better way to recommend a movie to user 1 from the watchlist or favourit movies of another user 2 whose movies database is more relevant to the user 1. That is, if the tast of two people is same, then both of them will like each other favourit food. Many tech giants has been using these recommendation system in their applications like YouTube, Netflix, etc.\n",
    "\n",
    "In this task, machine learning (ML) models has helped us a lot to build such recommendation system based on users previous watch history. ML models learns from users watch history and categorize them into groups which contain users of same taste. Different types of ML models has been used like clustering algorithms, deep learning models etc."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## K-Means Clustering Algorithm"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "K-Means is an unsupervised machine learning algorithm which can be used to categroize data into different groups. In this article we'll use this algorithm to categorize users based on their 4+ ratings on movies. I'll not describe the background mathematics of this algorithm but I'll describe little intuition of this algorithm. If you want to understand the mathematical background of this algorithm, then I'll suggest you to search it on Google, many authors has written articles on its mathematical background. Since, the complete mathematics behind this algorithm has been done by **Scikit-Learn** liabrary so, we will only understand and implement it."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<p style=\"color: red\">Note: Plots of data in this section are designed randomly and only for intitution of K-means algorithm.</p>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<div style='width: 50%; float:left;'>\n",
    "    Suppose that we have 2-dimensional data in the form of $(x_1, x_2)$. Let, we have plotted our data in <b>Figure (1)</b>. Next we want to divide this data into groups. If we take a look at data, then we can observe that this data can be divided into three groups. In this plot which is only designed for intuition, a common man can observe that we can divide into three groups. But some times we have very complex and big data or some time we have 3-dimensional or 4-dimensional or more generally we can have 100 dimensions or 1000 or even more than this. Then, it is not possible for human to categorize such type of data and even we can't plot such a higher dimensional data. Also, sometimes we don't know theoptimal number of clusters we should have for our data. So, we use some clustering algorithms which can work for such big data which can even of thousands of dimensions and their are methods which can be used to know the optimal of clusters.\n",
    "</div>\n",
    "<div style='width: 50%; float:right; text-align: center;'>\n",
    "    <figure>\n",
    "        <img src=\"./Article Data/Figures/Scatter Plot Before K-Means.jpg\" width = \"300px\">\n",
    "        <figcaption> Figure 1 - Scatter Plot Before K-Means Clustering</figcaption>\n",
    "    </figure>\n",
    "</div>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<div style='width: 50%; float:left; text-align: center;'>\n",
    "    <figure>\n",
    "        <img src=\"./Article Data/Figures/Scatter Plot After K-Means.jpg\" width = \"300px\">\n",
    "        <figcaption> Figure 2 - Scatter Plot After K-Means Clustering</figcaption>\n",
    "    </figure>\n",
    "</div>\n",
    "<div style='width: 50%; float:right; position: relative; top: 100px'>\n",
    "    In <b>Figure (2)</b>, a demonstration of k-means clustering is shown. The data of Figure (1) has categorized into three groups and presented in the Figure (2) with a unique color for each group.\n",
    "</div>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**One can arise a question, how actually k-means worked to categorize the data?**"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "To categorize data into groups which contain same type of items/data, there are 6 steps which k-means algorithm follow. <b>Figure (3)</b> is presenting the steps which k-means algorithm follow to categorize data."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<div style='float:left; width: 50%; margin-top: 50px; padding-right: 10px'>\n",
    "    Figure (3) is describing the following steps of k-means algorithm. \n",
    "    <ol>\n",
    "        <li>Firstly, we have to select the numbers of clusters which we want for our dataset. Later, an <b>elbow method</b> will be explained for selection of optimal number of clusters.</li>\n",
    "        <li>Then, we have to select k random points called centroid which are not necessary from our dataset. Because to avoid random initialization trap which can stuck us to bad clusters, we'll use <b>k-means++</b> to initalize k centroids and it is provided by Scikit-Learn in k-means algorithm.</li>\n",
    "        <li>K-means algorithm will assign each data point to its closest centroid which will finally gives us k clusters.</li>\n",
    "        <li>The centroid will be re-center to a position which is now actually the centroid of its own cluster and will be new centroid.</li>\n",
    "        <li>It will reset all clusters and again assign each dataset point to its new closest centroid.</li>\n",
    "        <li>If, the new clusters are same as the previous cluster was OR total iterations has completed then it will be stop and gives us the final clusters of our dataset. Else, It will move again to step 4.</li>\n",
    "    </ol> \n",
    "</div>\n",
    "<div style='float:right; width: 50%; text-align: center;'>\n",
    "    <figure>\n",
    "        <img src=\"./Article Data/Figures/Graphical Abstract Of K-Means Algorithm.jpg\">\n",
    "        <figcaption> Figure 3 - Graphical Abstract of K-Means Algorithm</figcaption>\n",
    "    </figure>\n",
    "</div>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Elbow Method"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The elbow method is the best way to find optimal number of clusters. For this, we need to find **within clusters sum of squares (WCSS)**. WCSS is the sum of squares of each point distance from its centroid and its mathematical formula is following\n",
    "$$\n",
    "    WCSS = \\sum^K_{i=1} \\sum_{j=1}^{N_i} \\text{distance}(P_{\\{i,j\\}}, C_i)^2\n",
    "$$\n",
    "Where $K$ is total number of clusters, $N_i$ is the size of $i$'th cluster or we can also say that data points in $i$'th cluster, $C_i$ is the centroid of $i$'th cluster and $P_{\\{i,j\\}}$ is the $j$'th data point of $i$'th cluster."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**So, what we'll do with WCSS?**\n",
    "\n",
    "WCSS will tells us how far are centroid from its data points. As we increase number of clusters, WCSS will become small and after some value of $K$ the WCSS will reduce slowly we will stop there and choose optimal number of clusters. I'll suggest to Google for elbow method and take a look at more clear examples of elbow method. Here we have figure for intuition of elbow method."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<div style='float:left; width: 40%; margin-top: 50px; padding-right: 10px'>\n",
    "A demonstration of elbow method is show in <b>Figure (4)</b>. As we can observe that, when number of clusters $K$ moves from $1$ to $5$ then WCSS value decreases rapidly from $2500$ to $400$ approx. But, for clusters number $6$ to onward it is decreasing slowly. So, here we can make a judgment that it is good for our dataset if we have $5$ cluster. Further, as we can see its look like an elbow, the joint elbow will be the optimal number of clusters which is in this case is $5$. Later we'll see that we don't have always such a smooth curve so in this work I have described another way to observe changes in WCSS and to know optimal clusters.\n",
    "</div>\n",
    "<div style='float:right; width: 60%; text-align: center;'>\n",
    "    <figure>\n",
    "        <img src=\"./Article Data/Figures/Elbow Method Plot.png\">\n",
    "        <figcaption> Figure 4 - Elbow Method Plot</figcaption>\n",
    "    </figure>\n",
    "</div>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Methodology Used in this Article"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    " In this article, we'll build a clustering based algorithm to categorize users into groups of same interest by using **k-means** algorithm. We will use data, where users has rated movies with 4+ rating on the supposition of that, if a user is rating a movie 4+ then he/she may like it. We have downloaded database <a href=\"https://www.kaggle.com/rounakbanik/the-movies-dataset?select=ratings.csv\" target='_blank'>The Movies Dataset</a> from Kaggle.com which is a MovieLens Dataset. In the following sections, we have completely described the whole project, from **Importing Dataset -> Data Engineering -> Building K-Means Clustering Model -> Analyzing Optimal Number of Clusters -> Trainig Model and Predicting -> Fixing Clusters -> Saving Trainings -> Finally, Making Recommendations for Users**. A complete project of movies recommendation system can be downloaded from my GitHub Liabrary <a href=\"https://github.com/asdkazmi/AI-Movies-Recommendation-System-K-Means-Clustering\" style=\"font-weight: bold\" target='_blank'>AI Movies Recommendation System Based on K-means Clustering Algorithm</a>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## This Cell is used for Styling of Notebook"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<style>\n",
       ".output_subarea {\n",
       "    background: #fafafa;\n",
       "    border: 1px solid #eeeeee;\n",
       "    border-radius: 3px;\n",
       "}\n",
       "table.dataframe {\n",
       "    margin-right: auto !important;             \n",
       "    margin-left: auto !important;\n",
       "    border: 1px solid #747474;\n",
       "    box-shadow: 0px 0px 2px 1px #9d9d9d;}\n",
       "\n",
       "table.dataframe tr {\n",
       "    height: 30px !important;\n",
       "    background: #dfdfdf !IMPORTANT;\n",
       "}\n",
       "\n",
       "table.dataframe td {\n",
       "    text-align: center;\n",
       "}\n",
       "\n",
       "table.dataframe tr:nth-child(even) {\n",
       "    background: #cbcaca !IMPORTANT;\n",
       "}\n",
       "\n",
       "table.dataframe thead tr {\n",
       "    text-align: center !important;\n",
       "    background: #686868 !important;\n",
       "    color: white;\n",
       "}\n",
       "</style>\n"
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "%%html\n",
    "<style>\n",
    ".output_subarea {\n",
    "    background: #fafafa;\n",
    "    border: 1px solid #eeeeee;\n",
    "    border-radius: 3px;\n",
    "}\n",
    "table.dataframe {\n",
    "    margin-right: auto !important;             \n",
    "    margin-left: auto !important;\n",
    "    border: 1px solid #747474;\n",
    "    box-shadow: 0px 0px 2px 1px #9d9d9d;}\n",
    "\n",
    "table.dataframe tr {\n",
    "    height: 30px !important;\n",
    "    background: #dfdfdf !IMPORTANT;\n",
    "}\n",
    "\n",
    "table.dataframe td {\n",
    "    text-align: center;\n",
    "}\n",
    "\n",
    "table.dataframe tr:nth-child(even) {\n",
    "    background: #cbcaca !IMPORTANT;\n",
    "}\n",
    "\n",
    "table.dataframe thead tr {\n",
    "    text-align: center !important;\n",
    "    background: #686868 !important;\n",
    "    color: white;\n",
    "}\n",
    "</style>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "jCfqaJIJrutF"
   },
   "source": [
    "## Importing All Required Liabraries"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "executionInfo": {
     "elapsed": 3745,
     "status": "ok",
     "timestamp": 1597420628587,
     "user": {
      "displayName": "Syed Muhammad Asad",
      "photoUrl": "https://lh3.googleusercontent.com/-fB2ssjtxx5A/AAAAAAAAAAI/AAAAAAAABn4/leYKxTW8Cqs/s64/photo.jpg",
      "userId": "01049030658086144010"
     },
     "user_tz": -300
    },
    "id": "eucyGUOMrutO"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Pandas version:  0.25.1\n",
      "NumPy version:  1.16.5\n",
      "Matplotlib version:  3.1.1\n",
      "Scikit-Learn version:  0.21.3\n",
      "Pickle version:  4.0\n",
      "Sys version:  3.7.4\n"
     ]
    }
   ],
   "source": [
    "import pandas as pd\n",
    "print('Pandas version: ', pd.__version__)\n",
    "\n",
    "import numpy as np\n",
    "print('NumPy version: ', np.__version__)\n",
    "\n",
    "import matplotlib\n",
    "print('Matplotlib version: ', matplotlib.__version__)\n",
    "\n",
    "from matplotlib import pyplot as plt\n",
    "\n",
    "import sklearn\n",
    "print('Scikit-Learn version: ', sklearn.__version__)\n",
    "\n",
    "from sklearn.feature_extraction.text import CountVectorizer\n",
    "\n",
    "from sklearn.cluster import KMeans\n",
    "\n",
    "\n",
    "import pickle\n",
    "print('Pickle version: ', pickle.format_version)\n",
    "\n",
    "import sys\n",
    "print('Sys version: ', sys.version[0:5])\n",
    "\n",
    "from sys import exc_info\n",
    "\n",
    "import ast"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "K31ulquLruv_"
   },
   "source": [
    "<h4 style=\"color:red\">Only for testing"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "executionInfo": {
     "elapsed": 3319,
     "status": "ok",
     "timestamp": 1597420638604,
     "user": {
      "displayName": "Syed Muhammad Asad",
      "photoUrl": "https://lh3.googleusercontent.com/-fB2ssjtxx5A/AAAAAAAAAAI/AAAAAAAABn4/leYKxTW8Cqs/s64/photo.jpg",
      "userId": "01049030658086144010"
     },
     "user_tz": -300
    },
    "id": "ffPnLJs4ruwD"
   },
   "outputs": [],
   "source": [
    "import time"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Data Engineering"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "This section is divided into two subsections. Firstly, we will import data and reduce it into a sub dataframe, so that we can focus more on our model and can look what type users has rated movies and what type of recommendation for him based on that. Secondly, we'll perform feature engineering so that we have data in the form which is valid for machine learning algorithm."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "mSXrFgGzruwg"
   },
   "source": [
    "### Prepairing Data for Model"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We have downloaded MovieLens Dataset from Kaggle.com. Here first we'll import rating dataset, because we want users rating on movies and further we'll filter data where users has gives 4+ ratings"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "scrolled": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Shape of ratings dataset is:  (26024289, 3) \n",
      "\n",
      "Max values in dataset are \n",
      " userId     270896.0\n",
      "movieId    176275.0\n",
      "rating          5.0\n",
      "dtype: float64 \n",
      "\n",
      "Min values in dataset are \n",
      " userId     1.0\n",
      "movieId    1.0\n",
      "rating     0.5\n",
      "dtype: float64 \n",
      "\n"
     ]
    }
   ],
   "source": [
    "ratings = pd.read_csv('./Prepairing Data/From Data/ratings.csv', usecols = ['userId', 'movieId','rating'])\n",
    "print('Shape of ratings dataset is: ',ratings.shape, '\\n')\n",
    "print('Max values in dataset are \\n',ratings.max(), '\\n')\n",
    "print('Min values in dataset are \\n',ratings.min(), '\\n')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Next we'll filter this dataset for only 4+ ratings"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Shape of ratings dataset is:  (12981742, 3) \n",
      "\n",
      "Max values in dataset are \n",
      " userId     270896.0\n",
      "movieId    176271.0\n",
      "rating          5.0\n",
      "dtype: float64 \n",
      "\n",
      "Min values in dataset are \n",
      " userId     1.0\n",
      "movieId    1.0\n",
      "rating     4.0\n",
      "dtype: float64 \n",
      "\n"
     ]
    }
   ],
   "source": [
    "# Filtering data for only 4+ ratings\n",
    "ratings = ratings[ratings['rating'] >= 4.0]\n",
    "print('Shape of ratings dataset is: ',ratings.shape, '\\n')\n",
    "print('Max values in dataset are \\n',ratings.max(), '\\n')\n",
    "print('Min values in dataset are \\n',ratings.min(), '\\n')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "So, now minimum rating given by users is 4.0 and also data set has reduced from $2.6e^7$ to $1.2e^7$ which is less than half of the original dataset. But dataset is still large and we want to reduce it more."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "For the intution of this article, I want to work on a small dataset. So, now we will get a subset of this dataset for only first 200 movies. Later when we will reduce it further for first 100 users, then we'll may have less than 200 movies which has been rated by users and we want to work around 100 movies."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Shape of ratings dataset is:  (776269, 3) \n",
      "\n",
      "Max values in dataset are \n",
      " userId     270896.0\n",
      "movieId       201.0\n",
      "rating          5.0\n",
      "dtype: float64 \n",
      "\n",
      "Min values in dataset are \n",
      " userId     1.0\n",
      "movieId    1.0\n",
      "rating     4.0\n",
      "dtype: float64 \n",
      "\n"
     ]
    }
   ],
   "source": [
    "movies_list = np.unique(ratings['movieId'])[:200]\n",
    "ratings = ratings.loc[ratings['movieId'].isin(movies_list)]\n",
    "print('Shape of ratings dataset is: ',ratings.shape, '\\n')\n",
    "print('Max values in dataset are \\n',ratings.max(), '\\n')\n",
    "print('Min values in dataset are \\n',ratings.min(), '\\n')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Still the dataset is large, so we again get another subset of ratings by extracting it for not all users but some users i.e. for 100 users."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Shape of ratings dataset is:  (447, 3) \n",
      "\n",
      "Max values in dataset are \n",
      " userId     157.0\n",
      "movieId    198.0\n",
      "rating       5.0\n",
      "dtype: float64 \n",
      "\n",
      "Min values in dataset are \n",
      " userId     1.0\n",
      "movieId    1.0\n",
      "rating     4.0\n",
      "dtype: float64 \n",
      "\n",
      "Total Users:  100\n",
      "Total Movies which are rated by 100 users:  83\n"
     ]
    }
   ],
   "source": [
    "users_list = np.unique(ratings['userId'])[:100]\n",
    "ratings = ratings.loc[ratings['userId'].isin(users_list)]\n",
    "print('Shape of ratings dataset is: ',ratings.shape, '\\n')\n",
    "print('Max values in dataset are \\n',ratings.max(), '\\n')\n",
    "print('Min values in dataset are \\n',ratings.min(), '\\n')\n",
    "print('Total Users: ', np.unique(ratings['userId']).shape[0])\n",
    "print('Total Movies which are rated by 100 users: ', np.unique(ratings['movieId']).shape[0])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "And finally, its done. We have a dataset of shape (447,3) which inlcudes 4+ ratings of 83 movies by 100 users. As we were started with 100 movies but when we extracted it for only first 100 users, it looks like that the movies from 84-200 were not rated by first 100 users."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "As, now we are not worried for ratings column and further we have supposed that each movie which is rated 4+ by user is of his/her interest. So, if a movie is an interest of user 1 then that movie will also be interest of another user 2 of same taste. Now, we can drop this column as each movie is a fovourite for every user."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [],
   "source": [
    "users_fav_movies = ratings.loc[:, ['userId', 'movieId']]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Since we were sorted dataframe by columns, so index may not be in proper order. Now, we want to reset the index."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [],
   "source": [
    "users_fav_movies = ratings.reset_index(drop = True)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "And finally, here is our final dataframe of first 100 users favourite movies from the list of first 200 movies. The below dataframe is printed with transpose"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>0</th>\n",
       "      <th>1</th>\n",
       "      <th>2</th>\n",
       "      <th>3</th>\n",
       "      <th>4</th>\n",
       "      <th>5</th>\n",
       "      <th>6</th>\n",
       "      <th>7</th>\n",
       "      <th>8</th>\n",
       "      <th>9</th>\n",
       "      <th>...</th>\n",
       "      <th>437</th>\n",
       "      <th>438</th>\n",
       "      <th>439</th>\n",
       "      <th>440</th>\n",
       "      <th>441</th>\n",
       "      <th>442</th>\n",
       "      <th>443</th>\n",
       "      <th>444</th>\n",
       "      <th>445</th>\n",
       "      <th>446</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <td>userId</td>\n",
       "      <td>1.0</td>\n",
       "      <td>2.0</td>\n",
       "      <td>2.0</td>\n",
       "      <td>8.0</td>\n",
       "      <td>8.0</td>\n",
       "      <td>9.0</td>\n",
       "      <td>9.0</td>\n",
       "      <td>10.0</td>\n",
       "      <td>10.0</td>\n",
       "      <td>11.0</td>\n",
       "      <td>...</td>\n",
       "      <td>153.0</td>\n",
       "      <td>153.0</td>\n",
       "      <td>155.0</td>\n",
       "      <td>155.0</td>\n",
       "      <td>156.0</td>\n",
       "      <td>156.0</td>\n",
       "      <td>156.0</td>\n",
       "      <td>156.0</td>\n",
       "      <td>156.0</td>\n",
       "      <td>157.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>movieId</td>\n",
       "      <td>147.0</td>\n",
       "      <td>64.0</td>\n",
       "      <td>79.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>47.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>150.0</td>\n",
       "      <td>150.0</td>\n",
       "      <td>165.0</td>\n",
       "      <td>34.0</td>\n",
       "      <td>...</td>\n",
       "      <td>175.0</td>\n",
       "      <td>198.0</td>\n",
       "      <td>32.0</td>\n",
       "      <td>107.0</td>\n",
       "      <td>17.0</td>\n",
       "      <td>25.0</td>\n",
       "      <td>36.0</td>\n",
       "      <td>58.0</td>\n",
       "      <td>80.0</td>\n",
       "      <td>111.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>rating</td>\n",
       "      <td>4.5</td>\n",
       "      <td>4.0</td>\n",
       "      <td>4.0</td>\n",
       "      <td>4.0</td>\n",
       "      <td>4.0</td>\n",
       "      <td>4.5</td>\n",
       "      <td>4.0</td>\n",
       "      <td>4.0</td>\n",
       "      <td>4.0</td>\n",
       "      <td>4.0</td>\n",
       "      <td>...</td>\n",
       "      <td>4.5</td>\n",
       "      <td>4.0</td>\n",
       "      <td>4.5</td>\n",
       "      <td>5.0</td>\n",
       "      <td>4.0</td>\n",
       "      <td>5.0</td>\n",
       "      <td>5.0</td>\n",
       "      <td>5.0</td>\n",
       "      <td>4.0</td>\n",
       "      <td>4.0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>3 rows × 447 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "           0     1     2    3     4    5      6      7      8     9    ...  \\\n",
       "userId     1.0   2.0   2.0  8.0   8.0  9.0    9.0   10.0   10.0  11.0  ...   \n",
       "movieId  147.0  64.0  79.0  1.0  47.0  1.0  150.0  150.0  165.0  34.0  ...   \n",
       "rating     4.5   4.0   4.0  4.0   4.0  4.5    4.0    4.0    4.0   4.0  ...   \n",
       "\n",
       "           437    438    439    440    441    442    443    444    445    446  \n",
       "userId   153.0  153.0  155.0  155.0  156.0  156.0  156.0  156.0  156.0  157.0  \n",
       "movieId  175.0  198.0   32.0  107.0   17.0   25.0   36.0   58.0   80.0  111.0  \n",
       "rating     4.5    4.0    4.5    5.0    4.0    5.0    5.0    5.0    4.0    4.0  \n",
       "\n",
       "[3 rows x 447 columns]"
      ]
     },
     "execution_count": 10,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "users_fav_movies.T"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now, let save this dataframe to csv file on our local"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [],
   "source": [
    "users_fav_movies.to_csv('./Prepairing Data/From Data/filtered_ratings.csv')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "sd5PoLV3ruxk"
   },
   "source": [
    "# Data Featuring"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "Tzjd-yVMruyM"
   },
   "source": [
    "In this section, we will create a sparse matrix which we'll use in k-means. For this, let define a function which return us a movies list for each user from dataset"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "yff42q1ZruyV"
   },
   "outputs": [],
   "source": [
    "def moviesListForUsers(users, users_data):\n",
    "    # users = a list of users IDs\n",
    "    # users_data = a dataframe of users favourite movies or users watched movies\n",
    "    users_movies_list = []\n",
    "    for user in users:\n",
    "        users_movies_list.append(str(list(users_data[users_data['userId'] == user]['movieId'])).split('[')[1].split(']')[0])\n",
    "    return users_movies_list"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The method **moviesListForUsers** returns us a list which will contain strings for each users favourite movies list. Later we will use **CountVectorizer** to extract the features of strings which contains list of movies."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<p style='color:red'> Note: The method <b>moviesListForUsers</b> returns us list in the same order as users list. So to avoid trap, we will have users list in the descending order."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In above defined method, we need to have a list of users and users_data dataframe. As users_data is the dataframe we already have. Now, let prepair the users list"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "(100,)\n"
     ]
    }
   ],
   "source": [
    "users = np.unique(users_fav_movies['userId'])\n",
    "print(users.shape)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now, let prepair the list of movies list for each user."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "mCNqz-x1ruzY"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Movies list for 100  users\n",
      "A list of first 10 users favourite movies: \n",
      " ['147', '64, 79', '1, 47', '1, 150', '150, 165', '34', '1, 16, 17, 29, 34, 47, 50, 82, 97, 123, 125, 150, 162, 175, 176, 194', '6', '32, 50, 111, 198', '81']\n"
     ]
    }
   ],
   "source": [
    "users_movies_list = moviesListForUsers(users, users_fav_movies)\n",
    "print('Movies list for', len(users_movies_list), ' users')\n",
    "print('A list of first 10 users favourite movies: \\n', users_movies_list[:10])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Above is the list for first 10 users favourite movies list. First string contain first users favourite movies IDs, second for second users and so on. It looks that the list of 7th users favourite movies is larger than others."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "xnJI94Q0ru1r"
   },
   "source": [
    "<b>Now, we'll prepair a sparse matrix for each user against each movie</b>\n",
    "<p>If user has watched movie then 1, else 0</p>\n",
    "<table class='dataframe'>\n",
    "    <thead>\n",
    "        <td></td>\n",
    "        <td>Movie 1</td>\n",
    "        <td>Movie 2</td>\n",
    "        <td>Movie 3</td>\n",
    "        <td>...</td>\n",
    "        <td>Movie N</td>\n",
    "    </thead>\n",
    "    <tr>\n",
    "        <td>User 1</td>\n",
    "        <td>1</td>\n",
    "        <td>0</td>\n",
    "        <td>1</td>\n",
    "        <td>...</td>\n",
    "        <td>1</td>\n",
    "    </tr>\n",
    "    <tr>\n",
    "        <td>User 2</td>\n",
    "        <td>0</td>\n",
    "        <td>0</td>\n",
    "        <td>1</td>\n",
    "        <td>...</td>\n",
    "        <td>0</td>\n",
    "    </tr>\n",
    "    <tr>\n",
    "        <td>User 3</td>\n",
    "        <td>1</td>\n",
    "        <td>0</td>\n",
    "        <td>0</td>\n",
    "        <td>...</td>\n",
    "        <td>0</td>\n",
    "    </tr>\n",
    "</table>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "QAYYm3Ywru1y"
   },
   "source": [
    "Let us first define a function for sparse matrix"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "IHOh_IBAru11"
   },
   "outputs": [],
   "source": [
    "def prepSparseMatrix(list_of_str):\n",
    "    # list_of_str = A list, which contain strings of users favourite movies separate by comma \",\".\n",
    "    # It will return us sparse matrix and feature names on which sparse matrix is defined \n",
    "    # i.e. name of movies in the same order as the column of sparse matrix\n",
    "    cv = CountVectorizer(token_pattern = r'[^\\,\\ ]+', lowercase = False)\n",
    "    sparseMatrix = cv.fit_transform(list_of_str)\n",
    "    return sparseMatrix.toarray(), cv.get_feature_names()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now, let prepair the sparse matrix"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "Fw2LAvRXru3b"
   },
   "outputs": [],
   "source": [
    "sparseMatrix, feature_names = prepSparseMatrix(users_movies_list)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now let put it into dataframe to have a more clear presentation. The format will be as **columns** will presents each movie and **index** will presents users IDs"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>1</th>\n",
       "      <th>10</th>\n",
       "      <th>101</th>\n",
       "      <th>104</th>\n",
       "      <th>105</th>\n",
       "      <th>107</th>\n",
       "      <th>11</th>\n",
       "      <th>110</th>\n",
       "      <th>111</th>\n",
       "      <th>112</th>\n",
       "      <th>...</th>\n",
       "      <th>79</th>\n",
       "      <th>80</th>\n",
       "      <th>81</th>\n",
       "      <th>82</th>\n",
       "      <th>86</th>\n",
       "      <th>88</th>\n",
       "      <th>89</th>\n",
       "      <th>94</th>\n",
       "      <th>95</th>\n",
       "      <th>97</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>8</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>9</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>10</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>151</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>153</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>155</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>156</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>157</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>100 rows × 83 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "     1  10  101  104  105  107  11  110  111  112  ...  79  80  81  82  86  \\\n",
       "1    0   0    0    0    0    0   0    0    0    0  ...   0   0   0   0   0   \n",
       "2    0   0    0    0    0    0   0    0    0    0  ...   1   0   0   0   0   \n",
       "8    1   0    0    0    0    0   0    0    0    0  ...   0   0   0   0   0   \n",
       "9    1   0    0    0    0    0   0    0    0    0  ...   0   0   0   0   0   \n",
       "10   0   0    0    0    0    0   0    0    0    0  ...   0   0   0   0   0   \n",
       "..  ..  ..  ...  ...  ...  ...  ..  ...  ...  ...  ...  ..  ..  ..  ..  ..   \n",
       "151  0   0    0    0    0    0   0    1    0    0  ...   0   0   0   0   0   \n",
       "153  1   0    0    0    0    0   0    1    0    0  ...   0   0   0   0   0   \n",
       "155  0   0    0    0    0    1   0    0    0    0  ...   0   0   0   0   0   \n",
       "156  0   0    0    0    0    0   0    0    0    0  ...   0   1   0   0   0   \n",
       "157  0   0    0    0    0    0   0    0    1    0  ...   0   0   0   0   0   \n",
       "\n",
       "     88  89  94  95  97  \n",
       "1     0   0   0   0   0  \n",
       "2     0   0   0   0   0  \n",
       "8     0   0   0   0   0  \n",
       "9     0   0   0   0   0  \n",
       "10    0   0   0   0   0  \n",
       "..   ..  ..  ..  ..  ..  \n",
       "151   0   0   0   0   0  \n",
       "153   0   0   0   0   0  \n",
       "155   0   0   0   0   0  \n",
       "156   0   0   0   0   0  \n",
       "157   0   0   0   0   0  \n",
       "\n",
       "[100 rows x 83 columns]"
      ]
     },
     "execution_count": 17,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_sparseMatrix = pd.DataFrame(sparseMatrix, index = users, columns = feature_names)\n",
    "df_sparseMatrix"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now, let make it clear that the matrix we defined above is exactly as we want it? We'll check it for some users."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "EeM3j8u0ru3_"
   },
   "source": [
    "Let take a look at some users favourite movies lists"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "jZHWzMUZru4B",
    "outputId": "cf5c0862-d516-48e2-8ed4-9e1bb3de7f80"
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>0</th>\n",
       "      <th>1</th>\n",
       "      <th>2</th>\n",
       "      <th>3</th>\n",
       "      <th>4</th>\n",
       "      <th>5</th>\n",
       "      <th>6</th>\n",
       "      <th>7</th>\n",
       "      <th>8</th>\n",
       "      <th>9</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <td>userId</td>\n",
       "      <td>1.0</td>\n",
       "      <td>2.0</td>\n",
       "      <td>2.0</td>\n",
       "      <td>8.0</td>\n",
       "      <td>8.0</td>\n",
       "      <td>9.0</td>\n",
       "      <td>9.0</td>\n",
       "      <td>10.0</td>\n",
       "      <td>10.0</td>\n",
       "      <td>11.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>movieId</td>\n",
       "      <td>147.0</td>\n",
       "      <td>64.0</td>\n",
       "      <td>79.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>47.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>150.0</td>\n",
       "      <td>150.0</td>\n",
       "      <td>165.0</td>\n",
       "      <td>34.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>rating</td>\n",
       "      <td>4.5</td>\n",
       "      <td>4.0</td>\n",
       "      <td>4.0</td>\n",
       "      <td>4.0</td>\n",
       "      <td>4.0</td>\n",
       "      <td>4.5</td>\n",
       "      <td>4.0</td>\n",
       "      <td>4.0</td>\n",
       "      <td>4.0</td>\n",
       "      <td>4.0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "             0     1     2    3     4    5      6      7      8     9\n",
       "userId     1.0   2.0   2.0  8.0   8.0  9.0    9.0   10.0   10.0  11.0\n",
       "movieId  147.0  64.0  79.0  1.0  47.0  1.0  150.0  150.0  165.0  34.0\n",
       "rating     4.5   4.0   4.0  4.0   4.0  4.5    4.0    4.0    4.0   4.0"
      ]
     },
     "execution_count": 18,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "first_6_users_SM = users_fav_movies[users_fav_movies['userId'].isin(users[:6])].sort_values('userId')\n",
    "first_6_users_SM.T"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "7Jpw__I_ru4b"
   },
   "source": [
    "Now let check the that if the users with above IDs have value 1 in the column of their favourite movie and 0 otherwise. Remember that in the **sparseMatrix** dataframe **df_sparseMatrix** index are users IDs."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "IhjtEWpkru4e",
    "outputId": "0d0a12f1-f474-47dc-aed3-7333dee9ae4d"
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>1</th>\n",
       "      <th>34</th>\n",
       "      <th>47</th>\n",
       "      <th>64</th>\n",
       "      <th>79</th>\n",
       "      <th>147</th>\n",
       "      <th>150</th>\n",
       "      <th>165</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>8</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>9</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>10</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>11</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "    1  34  47  64  79  147  150  165\n",
       "1   0   0   0   0   0    1    0    0\n",
       "2   0   0   0   1   1    0    0    0\n",
       "8   1   0   1   0   0    0    0    0\n",
       "9   1   0   0   0   0    0    1    0\n",
       "10  0   0   0   0   0    0    1    1\n",
       "11  0   1   0   0   0    0    0    0"
      ]
     },
     "execution_count": 19,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_sparseMatrix.loc[np.unique(first_6_users_SM['userId']), list(map(str, np.unique(first_6_users_SM['movieId'])))]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We can observe from above two dataframes that our sparse matrix is correct and have values in proper place. As, we have done with data engineering, now let create our machine learning clustering model with k-means algorithm."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "W_zRqndnru44"
   },
   "source": [
    "## Clustering Model"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "zKoqXol8ru49"
   },
   "source": [
    "To clustering the data, first of all we need to find the optimal number of clusters. For this purpose, we will define an object for elbow method which will contain two functions for run k-means algorithm for different number of clusters and showing plot."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "RD3TE5arru5N"
   },
   "outputs": [],
   "source": [
    "class elbowMethod():\n",
    "    def __init__(self, sparseMatrix):\n",
    "        self.sparseMatrix = sparseMatrix\n",
    "        self.wcss = list()\n",
    "        self.differences = list()\n",
    "    def run(self, init, upto, max_iterations = 300):\n",
    "        for i in range(init, upto + 1):\n",
    "            kmeans = KMeans(n_clusters=i, init = 'k-means++', max_iter = max_iterations, n_init = 10, random_state = 0)\n",
    "            kmeans.fit(sparseMatrix)\n",
    "            self.wcss.append(kmeans.inertia_)\n",
    "        self.differences = list()\n",
    "        for i in range(len(self.wcss)-1):\n",
    "            self.differences.append(self.wcss[i] - self.wcss[i+1])\n",
    "    def showPlot(self, boundary = 500, upto_cluster = None):\n",
    "        if upto_cluster is None:\n",
    "            WCSS = self.wcss\n",
    "            DIFF = self.differences\n",
    "        else:\n",
    "            WCSS = self.wcss[:upto_cluster]\n",
    "            DIFF = self.differences[:upto_cluster - 1]\n",
    "        plt.figure(figsize=(15, 6))\n",
    "        plt.subplot(121).set_title('Elbow Method Graph')\n",
    "        plt.plot(range(1, len(WCSS) + 1), WCSS)\n",
    "        plt.grid(b = True)\n",
    "        plt.subplot(122).set_title('Differences in Each Two Consective Clusters')\n",
    "        len_differences = len(DIFF)\n",
    "        X_differences = range(1, len_differences + 1)\n",
    "        plt.plot(X_differences, DIFF)\n",
    "        plt.plot(X_differences, np.ones(len_differences)*boundary, 'r')\n",
    "        plt.plot(X_differences, np.ones(len_differences)*(-boundary), 'r')\n",
    "        plt.grid()\n",
    "        plt.show()\n",
    "        "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Why we write elbow method in object?**\n",
    "\n",
    "As we don't know where we will get elbow i.e. optimal number of clusters, so we write it in object in such a way that the values of WCSS will be in attribute of object and we'll not lost them. As, firstly we may run elbow method for cluster number of 1-10 and later when we plot it, we may find that we don't get joint of elbow yet and we need to run it for more. So, next time we can run the same instance of object from 11-20 and so on, until we'll get joint for elbow. And thus, we'll not lost data of previous run.\n",
    "\n",
    "You may observe that in the above class method **showPlot**, I have written two plots. Yeah, here I'm going to use another strategy when we can't observe an elbow. And this is the difference between each two WCSS values and we can set a boundary for more clear observations of changing in WCSS value. That is, when the changes in WCSS value will remain inside our required boundary then we will say that we have find elbow after which changes are small. See below the plots"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<h4 style = \"color: red\">Testing [Start]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {},
   "outputs": [],
   "source": [
    "# test1, test2 = elbow_method.wcss, elbow_method.differences\n",
    "# elbow_method = elbowMethod(sparseMatrix)\n",
    "# elbow_method.wcss, elbow_method.differences = test1, test2"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<h4 style = \"color: red\">Testing [End]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "Pvo2dx6gru5j"
   },
   "source": [
    "Now let, first we analyze for clusters 1-10 with the boundary of 10 i.e. when the changes in WCSS value will be remain inside the boundary, we'll say that now we have find an elbow after which change is small."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Remeber that the dataframe **df_sparseMatrix** was only for prsentation of **sparseMatrix**. For the algorithm, we always use only matrix **sparseMatrix** itself.\n",
    "\n",
    "Let first create an instance of elbow method on our defined **sparseMatrix**. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {},
   "outputs": [],
   "source": [
    "elbow_method = elbowMethod(sparseMatrix)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now, first we will run it for 1-10 number of cluster, i.e. first k-mean will run for no of clusters $k=1$, then for no. of clusters $k=2$ and so on upto no. of clusters $k=10$."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {},
   "outputs": [],
   "source": [
    "elbow_method.run(1, 10)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAA20AAAF1CAYAAAB76AIVAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4xLjEsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy8QZhcZAAAgAElEQVR4nOzdd3gVZfrG8e+TQkLvJKGXiJSEDiJNxEZRsXexg333p7vr7uo2t7nrru6qqCAW1l7BBrqohCId6R1C7x1CS3t/f8xkjTFAAjmZc5L7c125kjNnzsw9k2RmnnnfmTHnHCIiIiIiIhKeooIOICIiIiIiIsenok1ERERERCSMqWgTEREREREJYyraREREREREwpiKNhERERERkTCmok1ERERERCSMqWiTsGdmt5rZ1HyvnZklB5mppJTkspjZOjM7vySmVRLMrK+ZbQo6h4iUDWb2opn9Jt/re8xsu5llmFltM+tpZqv815cFmbWkmVlvM1sRdI78wm2fU9aY2Tdmdm0A833HzB4r7fnKyalok7Dgb/yP+DvbvK/ngs4F/ysanZk9VWD4Zf7w14o4nTQzuzMkIYs2/y5m9pmZ7TWzfWa21Mz+bGY1g8okIgI/2Acc9LdP08zsbjP733GKc+5u59wf/fFjgaeAC51zVZxzu4HHgef812ODWZLQcM5Ncc6deSqf9fdhOQX2rxlmVr+kcx5n/r/ON8+jBbIsCeF8o8zsYX9fd8jMNvoFSZtQzfNUmdkTZjYq/zDnXD/n3LshmFfI14uZ9Tez1SU1PfGoaJNwcom/s837uj/oQPmsAa41s5h8w4YAKwPKUyxm1gNIA74FWjnnagD9gWyg/XE+E1PYcBGRELnEOVcVaAI8ATwCvHyccROAeCD/QX+TAq+LrBxs76YX2L9Wcc5tKY0ZO+f+kjdP4O4CWdqGcNYvAsOAe4CaQCtgPDAwhPOMBGG/XsrB/+MpUdEmkWqgmaWb2S4zezLvbKx/BukxM1tvZjvM7D9mVt1/b7SZPez/3MBvJbvXf51sZnvMzI4zv23AIuAif/xaQA/gk/wjmVl3/wzxPjNbYGZ9/eF/BnoDzxXSini+36Vnr5kNz8twomXx37/Zf2+3mT16kvX1d+BV59xfnXPbAZxzG5xzv3POpfnTu9XMvjWzp81sD/B7M2vhd9HY7a/rN82sRr4M68zsV/4Zu71m9qqZxRdYJw/7+bea2W0nySki5Zxzbr9z7hPgWuAWM0sBMLPXzOxPZtYSyOsquM/fRq0BmgOf+tvYODOrbmYv+9uezf5no/1p/Wh75w+/3cyW+duzL82sSV4uf59xd2Hba//9u/zPHvS3iZ384fXN7EMz22lma83swXyf6WZmc8zsgHldPX/QoyPfeD/obu5ve39mZgvNbL+ZvVtw21tUZvZLM1uTL/flBd4vdLl8HU43g5n9zcye9H+uaGbHzOxx/3U181rnqvivr/Qz7DOzr8zsjONMMwW4A7jaOTfJOZfpnDvknBvtnPuHP04tM3sr3+/lF/n2v3eb2ddm9ow/rzWWryuov07W+esk3cyuzvfeMDNbYd4xxedm1iDfe+39v9e9ZrbN3z9eBjyE97eeYWaz/HFnmNlNZlbZH56cbzoNzGuZrum/vtz/Pewzsyl2nFazoqyXAuPfbWZf5Xsd7/8fNPRfDzaz5f562GhmD5pZbWAM0Ny+b1GtbWbRZvYb+/7Y7X/HE2bWysyy/fW6ERjnL/c7/nrcZ2YzrZz3DFLRJpHqcqAL0AkYDNzuD7/V/zoXbwdeBcgrkCYBff2fzwHS/e8AfYApzjl3gnn+B691DeA64GPgWN6b/ob5c+BPQC3gZ8CHZlbXOfcoMAW4v5BWxIuBrngtXtfgF4YnWhZ/g/wCcDNQH6gNNCwstJlVBs4GPjzBsuU5C2+91AP+DBjwV38erYFG+Ac3+dzoZ24BtATy94VPBKoDDfB2FMPL+0ZXRIrGOTcL2IR3wiv/8JVAXgtNDb8bWQtgA9/32DgGjMbrTZAMdAQuBPJ3Uf/B9s4/eP41cAVQF2+b/XaBWIVur/2D9t/j7SOqAZcCu807ofgpsABvO3ge8FMzy9vO/xv4t3OuGt429L1irKJr8HpMNAPa4e0vTsUavHVcHfgD8IaZJZ1ouUo4Q/5989l4v/O8fXMvYIFzLsMvOF4D7sX7nU0CPrHCW2XOB1Y75xacYL4vArF+9gvwWp5uyPd+H2AO3v71OWAUgL8PexI4z28Z7g0s9t+7DvgpcAlea/A84I18n/sK+Ahv39gSmOx35X0KGO3/7XbLH9I5dwjvBPH1+QZfB3zpnNtrZt2B54Hb/KyvA2NPY70UxyvAEH89dMA7jtqNd4yWnq9FdTfwc7z/wV54xytZwNP5phWN9z95Jt5x3Z1ADN7/TR3gfiCzhHJHJBVtEk7G+mdT8r7uOsG4f3PO7XHObQD+xfcbsxuBp5xz6c65DOBXwHX+xmsS0NvfifbBa33q6X/uHP/9ExkD9DWvtWsIXhGX303AOOfcOOdcrnNuAt4G/2RdDp5wzu3zl2Ui3obvZMtyFfCZc26yf3DyGyD3ONOvife/vi1vgJn93V/Hh+yHFxxvcc4965zLds4dcc6tds5NcM4dc87txNuxnFNg+s855zY65/bgFXr5dyxZwOPOuSzn3DggA2+DLCJSFFvwToIVi5klAAOAn/otCTvwDhCvyz/t/Ns7vC5jf3XOLXPOZQN/wWtJapLvM8fbXt8J/N05N9t5Vjvn1uMVeHWdc4/7rRrpwEv5cmQByWZWxzmX4ZybUYzFfMY5t8Xf9n6aL0thuhfYv67Je8M5974/nVz/GqpVQF7hcLzlOpUMxzMVaGdm1fD2zS8ALf1Wu/z75uuBMc65NOdcJt7vpw7eCdyCagNbjzdDM4sDrgQe8df7arxjiZvzjbbCOfcf51wO3gmAJpavpwmQYmbxzrnNzrll/rBhwJ+ccyudc1l4RXAv/+/xMryC6Tl/n3rAOTe7iOvoLX64b73BH5Y3z+ecc3OdcznOuZFAHNC5kOmccL2cgmygrZlVdc7tds7NO8G4w4Bf+n8vR/HWzbV5rZu+3zrnDvv/j1l4J09a+P+js/0CttxS0Sbh5DLnXI18Xy+dYNyN+X5ej9cShP99fYH3YoAE59wavKKhA96Zsc+ALWZ2JkUo2vyNyOd4LUl1nHPfFhilCXB1/h0j3hmlpBNNl3zFFHAYr0XthMviv/e/deBvyPKf/cxvL15Bl5Rv/F8477q2Mf408+Rfr5hZPb97wmYzO4B3xrBOgekf73cBsNs/+Cls+URETqYBsOcUPtcErxVla77t8Qi8Fpo8Gwv5zL/zjb8Hr7dBg3zjHG973QivxaqwHPUL7Bd+jbcdB68HQktguZnNNrOLi7GMx8tSmBkF9q8t8t4wsyFmNj9fvhS+384fb7lOJUOhnHMH8C4/6IVXtE0EZuO1uuTfN/9gn+gXU5v54e8nz25OvO9NxDsG3pBv2HpO/LsGqOKc24t3UvVBYJuZfZKv62IT4MV863InXmHTkJOvyxP5Ekjwu1e2BM7AK5Lz5vnrAn9jdTm19VJcl+EVvxv8bp+FFdD4hVkjvG6PeRnn4f0Oavuj5bofXmf5Mt7v/gMz22RmfzG/e3N5paJNIlWjfD83xjsbi/+9SYH3soHt/utJeK1UFZxzm/3XQ/Bao+YXYb7/AR7G635Q0Ebg9QI7xsrOuSf890/U9bIwJ1qWreRbB2ZWie83fD/gF3Qz8br8nEzBjH/1h7Xzu+/chHcQk9/xfhciIqfMzLriHXhOPdm4hdiI1329Tr7tcTX3wxtfFNzebQSGFdiGV3TOTSvi/FocZ/jaAtOs6pwbCOCcW+Wcux6vmPwb3gFq5eIu7KnyWxFfwut6Vts/mbeY77fzx1uukjYJr4tia7x98SRgEN5J1rzf/w/2if4BfAO8wq2gr/BaMNsdZ37b8E5mNs43rPFxpvUjzrnPnXPn4RWSG/BaB8FbX7cW8jc0lxOvyxMeH/itdh/gtbbdiNfieCTfPH9bYJ6VnHMfFTKpk62Xgg4BlfK9TiyQa7pz7mK8kxD/5fvuxK7AeA5v3fYrkDPeObfrOJ855pz7rXOuFV4xfzU/bCkvd1S0SaT6uZnVNLNGwE+AvNvivg38n5k1M+/C5b8A7+Zr7ZmEt3Oa7L9OAx4Apvpn7U4mb8fybCHvvQFcYmYX+Rfcxpt38XjetWbb8a5NK6oTLcsHwMVm1svMKuDd6vpE/8+/AG4374LzegB+rmYnyVAVr3Vyn3/N3s8LGec+M2to3s1Zfs33vwsRkWIz7+YTFwPvAG845xYVdxrOua14B5H/9KcXZd6NlQp2787vReBXZtbWz1Hd8t1g4iRGAT8zs87mSfYLolnAATN7xLybbESbWYpfkGLejSbqOudygX3+tIqyLyoplfEOlnf6eW7Da2nLc7zlKmmT8Fodv/P3xWl4d5pc4pzb74/zLnC5mfUx75EPv8RrOZpTcGLOucV411u9Z94z7ir46/9GM3vYeZcVjAH+Yt4NL1rgHUu8cbKg5t0EZJB/svQY3j4y73f2IvCY34MH/zjlSv+9sXgF0z1+nmp5fwd4xwfNCnQVLOgtvKLler7vGgkwEnjAvMf6mJlVMbNL/XzFWi+FzHM+0NHM2vrT+22+9VDZzK4zr1trFnAw33rYDtTzj13yvAg84R+35fXkueR4C2tm55tZG/MuaTmAd9K6NP83wo6KNgkneXf9yvsac4JxPwbm4m1QPuf720K/gtcKNhlYCxzFK8ryTMIrRPKKtql4Z5EmUwR+n/6v/f77Bd/biHfx7K/xdoAb8YqcvP+zfwNXmXfXqGeKMLvjLotzbglwH96GeyteF8jjPsjaOTcV6Id3tmql3zXhC7wdY2EFaJ4/4N3sZT/eei7szN1beAdH6f7Xn4qwbCIiBX1qZgfxtp2P4l1Dezp3nB0CVACW4m0jP+AEXcOcc2PwWrveMa87+GK86+JOyjn3Pt41vW/hHbyOBWr5BcgleC1Ga4FdeIVQ3p2A+wNLzCwDbx9xnX+9T0k72378nLauzrmlwD+B6XgH2ql4j4Y54XKFIN8UvAIyb188H68l7H/7ZufcQrzCbgTePvY8YHCBLvj5DcNrRRyJ9/tfhdd693m+98HrFvkN3u/lzSJkjca7xnwbXtHYle/3zW/j3bTkI/9vaD7eiV78bpUX4BVeO/DugNrLn+Y7eMcie8zseC27k/15V8drMcOf7rd4XTVH4BX+K/GueTte693J1sv/+CdM/o73+1mOd8yQ3+14628/3v/bLf7wBXg3T1lvXnfIWv50vgK+8f/Pp+EdXxxPA7xjvYN4/4vjKN6Nesoccye8WZ6IyPGZ2TrgTufcVycbV0REREROjVraREREREREwpiKNhERERERkTCm7pEiIiIiIiJhTC1tIiIiIiIiYUxFm4iIiIiISBiLCToAQJ06dVzTpk2DjhEyhw4donLlUntWZpmgdVZ8WmfFp3VWPCW1vubOnbvLOVe3BCKFPf8BwHOAzc65i82sGd7tvWsB3wE3O+cyTzSNkthHRtLfeiRlhcjKq6yhoayhE0l5SyLrifaPYVG0NW3alDlzfvRsxDIjLS2Nvn37Bh0jomidFZ/WWfFpnRVPSa0vM1t/+mkixk+AZUA1//XfgKedc++Y2Yt4z5164UQTKIl9ZCT9rUdSVoisvMoaGsoaOpGUtySynmj/qO6RIiIiIWBmDfEeWjvKf214D7n/wB9lNHBZMOlERCSShEVLm4iISBn0L+AXQFX/dW1gn3Mu23+9CWhQ2AfNbCgwFCAhIYG0tLTTCpKRkXHa0ygtkZQVIiuvsoaGsoZOJOUNdVYVbSIiIiXMzC4Gdjjn5ppZ37zBhYxa6HN3nHMjgZEAXbp0cafb5aa8dTEqTZGUV1lDQ1lDJ5LyhjqrijYREZGS1xO41MwGAvF417T9C6hhZjF+a1tDYEuAGUVEJELomjYREZES5pz7lXOuoXOuKXAd8I1z7kZgInCVP9otwMcBRRQRkQiiok1ERKT0PAI8ZGar8a5xezngPCIiEgHUPVJERCSEnHNpQJr/czrQLcg8IiISedTSJiIiIiIiEsZUtImIiIiIiIQxFW0iIiIiIiJhTEWbiIiIiIhIGCsTRVtWTi6fLthCdk5u0FFERETCSvrODFbsyQk6hoiInIaTFm1mFm9ms8xsgZktMbM/+MPPM7PvzGy+mU01s2R/eJyZvWtmq81sppk1De0iQNqKnTzw9jy+WLIt1LMSERGJKI+OWczoJceCjiEiIqehKC1tx4B+zrn2QAegv5l1B14AbnTOdQDeAh7zx78D2OucSwaeBv5W8rF/qF+rejSrU5kRk9JxzoV6diIiIhFjYLskthxyrNx+MOgoIiJyik5atDlPhv8y1v9y/lc1f3h1YIv/82BgtP/zB8B5ZmYllrgQ0VHGXb2bs2jzfqan7w7lrERERCLKRW0TMGDcoq1BRxERkVNUpIdrm1k0MBdIBoY752aa2Z3AODM7AhwAuvujNwA2Ajjnss1sP1Ab2FVgmkOBoQAJCQmkpaWd1oLUyXFUqwBPjJnDQ13iT2taJS0jI+O0l6+80TorPq2z4tM6Kx6tr8hUr2o8LWtGMX7RNn56fsug44iIyCkoUtHmnMsBOphZDWCMmaUA/wcM9Au4nwNPAXcChbWq/ajPonNuJDASoEuXLq5v376ntgT5DLVV/OO/K0k4sxOtk6qd/AOlJC0tjZJYvvJE66z4tM6KT+useLS+IlfXxBjeWHaQ1TsySK5XJeg4IiJSTMW6e6Rzbh+QBgwA2jvnZvpvvQv08H/eBDQCMLMYvK6Te0oi7Mnc1L0JlSpE89Lk9NKYnYiISETonBANwHh1kRQRiUhFuXtkXb+FDTOrCJwPLAOqm1leP4sL/GEAnwC3+D9fBXzjSunuIDUqVeDaro34ZMEWtuw7UhqzFBERCXs146Po0qQm4xbrLssiIpGoKC1tScBEM1sIzAYmOOc+A+4CPjSzBcDNwM/98V8GapvZauAh4JclH/v47ujVDAe8MnVtac5WREQkrA1ITWLZ1gOs3XUo6CgiIlJMRbl75ELnXEfnXDvnXIpz7nF/+BjnXKpzrr1zrq9zLt0fftQ5d7VzLtk51y1veGlpWLMSF7dL4u1ZG9h/JKs0Zy0iIhK2BqQkAjB+sbpIiohEmmJd0xYphvZpzqHMHN6cuT7oKCIiImGhfo2KdGxcQ7f+FxGJQGWyaGtbvzq9z6jDq9+u41h2TtBxREREwsLAlCQWbz7Aht2Hg44iIiLFUCaLNoBhfVqw8+Axxs7bHHQUERGRsNBfXSRFRCJSmS3aeibXpm39aoyYnE5ubqncvFJERCSsNapVifYNq6uLpIhIhCmzRZuZMbRPc9J3HuLr5TuCjiMiIhIWBqQmsWDTfjbtVRdJEZFIUWaLNoBBqUk0qFGREZPWBB1FREQkLOTdRfILPbNNRCRilOmiLSY6irt6N2PO+r3MXb8n6DgiIiKBa1K7Mm3rV1MXSRGRCFKmizaAa7o2okalWEZMKtXHxYmIiIStgalJfLdhH1v2HQk6ioiIFEGZL9oqVYhhSPcmTFi2nTU7M4KOIyIiEjh1kRQRiSxlvmgDGNKjKRWioxg1Ra1tIiIizetWoVViVd36X0QkQpSLoq1OlTiu6tyQD+duZsfBo0HHERERCdyg1CTmrN/L9gPaL4qIhLtyUbQB3NW7OVm5ubz27bqgo4iIiARuQGoSzqmLpIhIJCg3RVvTOpXp3zaRN2asJ+NYdtBxREREApVcrwotE6roLpIiIhGg3BRtAEP7NOfA0WzembUh6CgiIiKBG5CSxKx1e9h58FjQUURE5ATKVdHWsXFNujWrxStT15KVkxt0HBERkUANaud3kVyiLpIiIuGsXBVtAHef05wt+4/y2cItQUcREREJ1Bn1qtCibmXGq4ukiEhYK3dFW9+W9WiZUIURk9JxzgUdR0REJDBmxsDUJGak72Z3hrpIioiEq3JXtEVFGXf1bs7ybQeZvGpX0HFEREQCNSAliVwH/126PegoIiJyHOWuaAMY3KEBCdXiGDFpTdBRREREAtU6qSrN6lTWXSRFRMJYuSzaKsREcXvPZkxbs5tFm/YHHUdERCQwZsaAlESmrdnN3kOZQccREZFClMuiDeD6sxpTNS6GEZPV2iYiIuXbwNQkcnIdE9RFUkQkLJXboq1afCw3dG/MuEVb2bD7cNBxREREAtO2fjUa1arI5+oiKSISlspt0QZwe89mREcZL09NDzqKiIhIYPLuIvnt6l3sP5wVdBwRESmgXBdtCdXiuaxDA96ds5E96scvIiLl2MCUJLJzHROWqYukiEi4KddFG8DQPs05mpXL69PXBx1FREQkMO0aVqdBjYp60LaISBgq90XbGQlVOa9VPUZPX8eRzJyg44iIiATC6yKZyJRVuzhwVF0kRUTCSbkv2gCGndOCPYcy+WDuxqCjiIiIBGZAahKZObl8rS6SIiJhRUUb0LVpTTo0qsFLU9aSk+uCjiMiIhKIDg1rkFQ9nnGLtgUdRURE8lHRhtcl5O5zmrNhz2G+WKwdlYiIlE9RUUb/lEQmrdzJQXWRFBEJGyrafBe0SaRp7UqMnLwG59TaJiIi5dOg1CQys3P5ZvmOoKOIiIhPRZsvOsq4q09zFmzaz4z0PUHHERERCUSnxjWpVzWO8eoiKSISNlS05XNlp4bUqVKBEZPXBB1FREQkEFFRxoCURCau2MGhY9lBxxEREVS0/UB8bDS3nN2UtBU7Wb7tQNBxREREAjEgNYlj2blMXKEukiIi4UBFWwE3n92EirHRjJycHnQUERGRQHRtWos6VdRFUkQkXKhoK6BGpQpc27URn8zfwtb9R4KOIyIiUuqio4z+KQl8s3wHRzJzgo4jIlLunbRoM7N4M5tlZgvMbImZ/cEfbmb2ZzNbaWbLzOzBfMOfMbPVZrbQzDqFeiFK2h29muGAV6auDTqKiIhIIAamJHEkK4dJK9VFUkQkaEVpaTsG9HPOtQc6AP3NrDtwK9AIaOWcaw28448/ADjD/xoKvFDSoUOtUa1KXNwuibdmbmD/ET2nRkREyp9uzWpRq3IFPlcXSRGRwJ20aHOeDP9lrP/lgHuAx51zuf54eafiBgP/8T83A6hhZkklHz20hvZpzqHMHN6auSHoKCIiIqUuJjqKi9om8s2y7RzNUhdJEZEgxRRlJDOLBuYCycBw59xMM2sBXGtmlwM7gQedc6uABsDGfB/f5A/bWmCaQ/Fa4khISCAtLe00F6Xkta0dxYsTV5Ccu4HYKDvl6WRkZITl8oUzrbPi0zorPq2z4tH6KjoziwcmA3F4+9oPnHO/M7NmeD1TagHfATc75zKDS3piA1MTeXvWBiav3MmFbRODjiMiUm4VqWhzzuUAHcysBjDGzFLwdkRHnXNdzOwK4BWgN1BYdeMKmeZIYCRAly5dXN++fU9tCUIousFObn55FnurJnNN10anPJ20tDTCcfnCmdZZ8WmdFZ/WWfFofRVL3qUFGWYWC0w1s/HAQ8DTzrl3zOxF4A7C+DKC7s1rU6NSLOMWbVXRJiISoGLdPdI5tw9IA/rjtaB96L81Bmjn/7wJ71q3PA2BLaeVMiC9kuvQJqkaIyavITf3R3WniIhIoU5waUE/4AN/+GjgsgDiFVlsdBQXtkngq2U7OJatLpIiIkEpyt0j6/otbJhZReB8YDkwFm/nA3AOsNL/+RNgiH8Xye7AfufcViKQmTHsnOas2XmIr5fr7lkiIlJ0ZhZtZvOBHcAEYA2wzzmX7Y+Sd/lAWBuYmkTGsWymrtoVdBQRkXKrKN0jk4DR/nVtUcB7zrnPzGwq8KaZ/R+QAdzpjz8OGAisBg4Dt5V87NIzKDWJv3+xgpGT13BBm4Sg44iISIQoeGkB0Lqw0Qr7bElf93061yNm5zoqxcArE+YTvT3utHIURaRdOxlJeZU1NJQ1dCIpb6iznrRoc84tBDoWMnwfMKiQ4Q64r0TShYGY6Cju7N2MP3y6lLnr99K5Sc2gI4mISARxzu0zszSgO94dlWP81rbjXj5Q0td9n+71iAN2LWDC0m306NWHCjHFurKi2CLt2slIyqusoaGsoRNJeUOdNbRb3jLimi6NqF4xlpGT1wQdRUREIsBxLi1YBkwErvJHuwX4OJiExTOoXSIHjmbz7Rp1kRQRCYKKtiKoHBfDkLOb8N+l21mzM+PkHxARkfIuCZhoZguB2cAE59xnwCPAQ2a2GqgNvBxgxiLrmVyHqnExjF8UkZeoi4hEPBVtRXRLj6bERkcxakp60FFERCTMOecWOuc6OufaOedSnHOP+8PTnXPdnHPJzrmrnXPHgs5aFHEx0ZzfJoH/Lt1OVk5u0HFERModFW1FVKdKHFd1bsiH321mx8GjQccREREpVQNSEtl3OIvpa3YHHUVEpNxR0VYMd/VuTlZOLqOnrQs6ioiISKnq07IulStEM36xukiKiJQ2FW3F0KxOZS5qk8jr09dz6Fj2yT8gIiJSRsTHRnNe6wS+XLKdbHWRFBEpVSraimnYOc05cDSbd2ZvDDqKiIhIqRqYmsieQ5nMXLsn6CgiIuWKirZi6ti4Jt2a1eLlKem6GFtERMqVc1rWo2JsNON0F0kRkVKlou0UDOvTnC37j/L5Qu20RESk/KhYIZp+revx5ZJt5OS6oOOIiJQbKtpOwbln1uOMelV4cdIanNNOS0REyo+BKUnsyshk9jp1kRQRKS0q2k5BVJRxV5/mLN92kMmrdgUdR0REpNT0PbMu8bFR6iIpIlKKVLSdosEd6pNQLY6Rk9cEHUVERKTUVI6LoW/LeoxfvI1cdZEUESkVKtpOUVxMNLf3bMa3q3ezePP+oOOIiIiUmoHtkth58BhzN+wNOoqISLmgou00XH9WY6rExTBicnrQUUREREpNv1b1qBATpRtyiYiUEhVtp6FafCw3ntWYzxduYeOew0HHERERKRVV4mI4p2VdvlAXSRGRUqGi7TTd1rMZ0VHGqClqbRMRkfJjUGoS2w4cZd7GfUFHET6Y8AIAACAASURBVBEp81S0nabE6vEM7tCAd+dsZM+hzKDjiIiIlIp+retRITqK8bqLpIhIyKloKwFD+zTnaFYur09fH3QUERGRUlEtPpbeZ9Rh/OJtemapiEiIqWgrAS0TqtKvVT1GT1/H0aycoOOIiIiUigGpSWzed4QFm3QXZRGRUFLRVkKG9WnOnkOZvD93U9BRRERESsUFrROIjTZ1kRQRCTEVbSWkW7NatG9Ug1FT0snRnbRERKQcqF4plp7Jdfh80VZ1kRQRCSEVbSXEzLi7T3PW7z7Ml0u2BR1HRESkVAxMSWLT3iMs3nwg6CgiImWWirYSdGHbRJrWrsSISWt0xlFERMqFC9okEB1ljFusLpIiIqGioq0ERUcZd/ZuzoJN+5m5dk/QcUREREKuZuUK9GhRm/HqIikiEjIq2krYVZ0bUrtyBUZMWhN0FBERkVIxMDWJdbsPs3SrukiKiISCirYSFh8bza09mjJxxU5WbDsYdBwREZGQu7BNAlEG4xfpmm4RkVBQ0RYCN3VvQsXYaEZOTg86ioiISMjVrhJH9+a1GacukiIiIaGiLQRqVq7AtV0b8fH8zWzdfyToOCIiIiE3MDWJ9F2HWLFdvUxEREqairYQuaNXMxzw6rfrgo4iIiISche1TcQMxqmLpIhIiVPRFiKNalViUGoSb83cwKEsdRUREZGyrW7VOLo1rcX4Rbr1v4hISVPRFkJD+zQn41g2E9ZnBR1FREQk5Aa1S2LVjgxWqYukiEiJUtEWQikNqjMgJZGxq7N4fcb6oOOIiIiElLpIioiEhoq2EHv62g50qBvNb8YuZtQU3U1SRETKroRq8XRpUpPxi9VFUkSkJKloC7H42Gju7xjHoNQk/vT5Mp79epVuhywiImXWgJQklm87yJqdGUFHEREpM1S0lYKYKOPf13Xgik4N+OeElfz9yxUq3EREpEwakJoIwBeL1UVSRKSknLRoM7N4M5tlZgvMbImZ/aHA+8+aWUa+13Fm9q6ZrTazmWbWtORjR56Y6Cj+cVV7bjirMS+kreEPny5V4SYiImVOUvWKdGpcg88XqoukiEhJKUpL2zGgn3OuPdAB6G9m3QHMrAtQo8D4dwB7nXPJwNPA30owb0SLijL+fFkKd/RqxmvT1vHrMYvIyVXhJiIiZcvA1CSWbj3Aul2Hgo4iIlImnLRoc568lrRY/8uZWTTwJPCLAh8ZDIz2f/4AOM/MrITyRjwz47FBrbn/3GTenrWRh9+bT3ZObtCxRERESkz/FK+L5Hh1kRQRKRExRRnJL9DmAsnAcOfcTDP7CfCJc25rgZqsAbARwDmXbWb7gdrArgLTHAoMBUhISCAtLe00FyV8ZWRk/Gj5usTBlWfE8uH8LWzaup2728cRE6XaNk9h60xOTOus+LTOikfrS4qqYc1KtG9Ug3GLtnJP3xZBxxERiXhFKtqcczlABzOrAYwxsz7A1UDfQkYvrPL4UR9A59xIYCRAly5dXN++hU2qbEhLS6Ow5evbF9pMXcsfP1vKWxuq8PyNnYiPjS71fOHoeOtMjk/rrPi0zopH60uKY2BKIn8dv5yNew7TqFaloOOIiES0Yt090jm3D0gDzsVrdVttZuuASma22h9tE9AIwMxigOrAnhLKW+bc0asZf7k8lYkrdnDH6NkczswOOpKIiMhpG5CSBKBntomIlICi3D2yrt/ChplVBM4H5jrnEp1zTZ1zTYHD/o1HAD4BbvF/vgr4xuk2iSd0w1mN+efV7Zm+ZjdDXp7FwaNZQUcSERE5LY1rVyKlQTXGLdJ1bSIip6soLW1JwEQzWwjMBiY45z47wfgvA7X9lreHgF+efsyy74pODXn2+k7M37iPG0fNZN/hzKAjiYiInJaBqUnM37iPzfuOBB1FRCSiFeXukQudcx2dc+2ccynOuccLGadKvp+POueuds4lO+e6OefSSzp0WTWoXRIjbu7M8m0HuW7kDHZlHAs6koiIyCn7XxfJReoiKSJyOop1TZuE3nmtE3jllq6s232Ia0ZMZ9v+o0FHEhEROSXN6lSmdVI13fpfROQ0qWgLQ73OqMN/bj+LHQeOcc2I6WzcczjoSCIiIqdkUGoic9fvZet+dZEUETlVKtrCVLdmtXjjzrPYdziTa0dMZ+2uQ0FHEhERKbYBqV4XyS/U2iYicspUtIWxDo1q8M7Qszmancs1I6azcvvBoCOJiIgUS4u6VTgzoSrjdRdJEZFTpqItzLWpX433hnXHgGtHTGfx5v1BRxIRESmWAamJzF6/hx0HdJ22iMipUNEWAZLrVeW9YWdTqUIM1780g+827A06koiISJENSk3COfhiiVrbREROhYq2CNG0TmXeu/tsalWuwM2jZjIjfXfQkURERIrkjISqJNerwjjd+l9E5JSoaIsgDWpU5L1hZ5NUoyK3vDKLSSt3Bh1JRESkSAamJDJr7R52HtQzSEVEiktFW4RJqBbPu0O706JuFe4aPYf/qquJiIhEgAGpSeQ6+O9S7bdERIpLRVsEql0ljrfv6k6b+tW4583v+HTBlqAjiYiInFCrxKo0r1NZXSRFRE6BirYIVb1SLG/ceRadm9TkJ+/M4/05G4OOJCIiclxmxoDURGak72F3hrpIiogUh4q2CFYlLobRt3WjZ3Idfv7BQl6fsT7oSCIiIsc1ICWJnFzHhKXbg44iIhJRVLRFuIoVonlpSBfOb12P34xdzEuT04OOJCJS7plZIzObaGbLzGyJmf3EH17LzCaY2Sr/e82gs5amtvWr0bhWJT5XF0kRkWJR0VYGxMdG88JNnRmUmsSfxy3jma9X4ZwLOpaISHmWDTzsnGsNdAfuM7M2wC+Br51zZwBf+6/LDTNjYGoS09bsZu+hzKDjiIhEDBVtZURsdBT/vq4DV3RqwFMTVvL3L1eocBMRCYhzbqtz7jv/54PAMqABMBgY7Y82GrgsmITBGZia6HWRXKYukiIiRRUTdAApOTHRUfzjqvZUjI3mhbQ1HMnM4bcXtyEqyoKOJiJSbplZU6AjMBNIcM5tBa+wM7N6x/nMUGAoQEJCAmlpaaeVISMj47SnUVKcc9SON96YtIR6GWt+9H44ZS2KSMqrrKGhrKETSXlDnVVFWxkTFWX86bIU4mOjeXnqWo5m5fDny1OJVuEmIlLqzKwK8CHwU+fcAbOibYudcyOBkQBdunRxffv2Pa0caWlpnO40StIVh5fy2rR1dDyrJ9Urxv7gvXDLejKRlFdZQ0NZQyeS8oY6q7pHlkFmxmODWvNAv2Temb2Rh9+bT3ZObtCxRETKFTOLxSvY3nTOfeQP3m5mSf77ScCOoPIFaWBqElk5jq90F8lSsfdQJo9/upR1+3OCjiIip0hFWxllZjx84Zn8/KIzGTt/Cw+8PY/MbBVuIiKlwbwmtZeBZc65p/K99Qlwi//zLcDHpZ0tHHRoVIP61eMZv1h3kQy12ev2MPCZKbzy7Vr+szRT17uLRCgVbWXcfecm89uL2zB+8TaGvT6Ho1k6yyYiUgp6AjcD/cxsvv81EHgCuMDMVgEX+K/LHTOjf0oSk1fu4sDRrKDjlEm5uY7hE1dz3cgZVIiJ4raeTUnfn8u0NbuDjiYip0BFWzlwe69m/OXyVNJW7uT212ZzODM76EgiImWac26qc86cc+2ccx38r3HOud3OufOcc2f43/cEnTUog9olkpmTyzfLymUP0ZDaefAYt7w6iye/XMHA1CQ+e6AXj/RvRY0447lvVgcdT0ROgYq2cuKGsxrz1DXtmZG+myEvz9KZTRERCVTHRjVJqBbHOD1ou0R9u3oXA5+Zwqy1e3jiilSeua4DVeNjiY+Npn/TWKan72bu+r1BxxSRYlLRVo5c3rEhz93Qifkb93HTqJnsO6wHm4qISDCioowBKUmkrdxJxjH1ADld2Tm5PPXfFdz08kyqV4zl4/t7cl23xuS/Y+m5jWKoWSmW5yeqtU0k0qhoK2cGpiYxckhnlm87yHUjZ7Bl35GgI4mISDk1ICWRzOxcvlmuLpKnY9v+o9wwaibPfLOaqzo15JP7e9IqsdqPxouLMW7v2Yyvl+9g6ZYDASQVkVOloq0c6tcqgVdv7crmvUe49LmpzFlXbi+pEBGRAHVpWou6VeMYry6Sp2zi8h0MfGYKizfv56lr2vPk1e2pVOH4j+Ed0qMpVeNiGJ6m1jaRSKKirZzqmVyHMff1oEpcDNe/NIN3Z28IOpKIiJQz0VFG/7aJTFyxQzfJKqasnFz+Om4Zt702m3pV4/j0gV5c0anhST9XvWIsN5/dhHGLtrJmZ0YpJBWRkqCirRxLrleVj+/rRffmtXnkw0X8/pMlegi3iIiUqgGpiRzNyiVtxc6go0SMjXsOc/WL0xkxOZ2bujdm7H09aVG3SpE/f3uvZsTFRPFC2poQphSRkqSirZyrXimWV2/typ29mvHatHXc8uos9h7SDUpERKR0dGtai9qVK/C5ukgWyReLtzLomSms2ZHB8Bs68afLUomPjS7WNOpUieO6ro0ZO28zm/YeDlFSESlJKtqEmOgoHru4Df+4uj2z1+5l8PBvWbn9YNCxRESkHIiJjuKilEQmLt/BkcycoOOEraNZOfzu48Xc/cZ3NK1Tmc8f7M2gdkmnPL1h5zTHDEZOTi/BlCISKira5H+u6tyQd4Z150hWDpcP/5YJS7cHHUlERMqBgSlJHM7MYdJKdZEszNpdh7jyhWmMnr6eO3o144O7e9C4dqXTmmZS9Ypc2akh78zeyI6DR0soqYiEioo2+YFOjWvy6f29aFGvCkNfn8Nz36zCORd0LBERKcPOal6LmpVi9aDtQnw8fzMXPzOFTXuP8NKQLvzm4jZUiCmZw7e7z2lBdk4uL09ZWyLTE5HQUdEmP5JYPZ73hp3N4Pb1+cd/V/LA2/PUZUVEREImNjqKC9sk8vWy7WTm6EQhwJHMHH754UJ+8s58WidVY9xPenNBm4QSnUfTOpW5pH193pixnn2HdT27SDhT0SaFio+N5ulrO/DLAa34fNFWrnpxGpv1IG4REQmRge2SOJSZw5LdOkm4avtBBg+fyrtzNnLfuS14Z2h3GtSoGJJ53ds3mUOZObz67bqQTF9ESoaKNjkuM+Puc1rwyi1d2bD7MIOfm8psPYhbRERCoEeL2lSvGMvsbeW3aHPO8d6cjVzy3FT2HMpk9G3d+PlFrYiJDt3h2pmJVbmgTQKvTVtHxjE9K08kXKlok5M6t1U9xtzXk6rxsdzw0gzenqUHcYuISMmKjY7igjYJzN6Wze8/WcL8jfvK1TXVGceyeei9Bfzig4V0alyTcQ/2pk/LuqUy7/vPTWb/kSzenLG+VOYnIsV30qLNzOLNbJaZLTCzJWb2B3/4m2a2wswWm9krZhbrDzcze8bMVpvZQjPrFOqFkNBLrleFsff25OwWdfjVR4v43ceLydKDuEVEpAT93wUtaVc3mrdmbuCy4d/S75+TeHrCStbuOhR0tJBasmU/lz47lY/nb+ahC1ry+h1nUa9afKnNv32jGvQ+ow4vTVnL0azy29IpEs6K0tJ2DOjnnGsPdAD6m1l34E2gFZAKVATu9McfAJzhfw0FXijp0BKM6pVieeWWLtzVuxmjp69nyMt6ELeIiJScBjUq8kDHeGY/dj5/uzKVxGrxPPPNKs79RxqXPjeVl6euLVO3p3fO8fqM9Vz+/DQOZWbz1l3defC8M4iOslLPct+5yezKOMZ7czaW+rxF5OROWrQ5T4b/Mtb/cs65cf57DpgFNPTHGQz8x39rBlDDzE796Y8SVmKio3h0UBv+eXV75q7fy6XDp7Jimx7ELSIiJad6xViu7dqYt4d2Z/ovz+PRga3JyXX88bOldP/L19z88kw+mLuJg0ezgo56yvYfyeLeN7/jN2MX06NFbcY92JvuzWsHluesZrXo0qQmIyalqyeNSBiKKcpIZhYNzAWSgeHOuZn53osFbgZ+4g9qAOQ/TbPJH/aDh6+Y2VC8ljgSEhJIS0s7tSWIABkZGWVu+WoDv+hagWfnHWXws5MZ2i6OTglF+nMqkrK4zkJN66z4tM6KR+tLgpBYPZ67+jTnrj7NWb3jIGPnbeHjBZv52fsLeHRMFOe3TmBwh/r0PbNeiT2/LNTmb9zH/W99x7b9R/nVgFbc1bs5UQG0ruVnZtx3bjK3vTabMfM2c02XRoHmEZEfKtJRtnMuB+hgZjWAMWaW4pxb7L/9PDDZOTfFf13YVudHVxI750YCIwG6dOni+vbtW9zsESMtLY2yuHx9gYvPPcqw1+fwzLz9PHxBE+7vl4zZ6e94yuo6CyWts+LTOiserS8JWnK9qvzsojN5+MKWfLdhHx/P38xnC7fy+aKtVK8Yy8DUJAZ3qE+3prUCL4IK45zj5alreWL8chKqxfPusLPp3KRm0LH+p++ZdWlbvxovpK3hyk4NA+mmKSKFK1bTiHNun5mlAf2BxWb2O6AuMCzfaJuA/KdnGgJbTjOnhKnE6t5O51cfLeKfE1ayfNtBnry6HZUqlFyrm4iISH5mRucmNencpCa/ubgNU1ft4uP5mxk7bzNvz9pA/erxXNKhPpd1aEDrpGpBxwVg76FMfvb+Ar5evoML2yTw5FXtqV4pNuhYP5DX2nbvm98xfvFWLm5XP+hIIuI76ZG1mdUFsvyCrSJwPvA3M7sTuAg4zzmXv/PzJ8D9ZvYOcBaw3zm39UcTljIjPjaap65pT6vEqjzxxXLW7jrEyCGdaVizUtDRRESkjIuNjuLcVvU4t1U9DmdmM2HpdsbO28yoKWsZMSmdMxOqMrhjfS5tXz+w/dLsdXt48O157M7I5PeXtOGWHk1LpFdKKPRvm0iLupUZPnENg1KTwjanSHlTlM7fScBEM1sIzAYmOOc+A14EEoDpZjbfzH7rjz8OSAdWAy8B95Z8bAk3ZsYw/0HcG/ccZvBz3zJrrR7ELSIipadShRgGd2jAq7d1Y9avz+OPg9tSJT6Gv3+xgl5/m8jVL07jjRnrS+3Ox7m5juETV3PdyBlUiIniw3t6cGvPZmFdCEVFGff2TWbZ1gN8s3xH0HFExHfSljbn3EKgYyHDC/2sfzfJ+04/mkSivAdxD/3PHG4cNYPHB6dwfbfGQccSEZFypnaVOG4+uyk3n92UjXsOe90n52/hsbGL+f0nSzinZV0Gd2zABa0TqFghusTnv/PgMR56bz5TVu3ikvb1+cvlKVSND6/ukMdzaYf6PP3VSp6buJp+reqFdZEpUl7owiMpccn1qjDmvp488PY8fvXRIpZtPcBvLm5DbHRk3NVLRETKlka1KnF/vzO479xklm49wMfzt/DJ/C18vXwHlStEc1HbRAZ3bEDPFrWJKYF91berd/GTd+Zz8GgWT1yRyrVdG0VU4RMbHcWwc1rwm7GLmb5mNz2S6wQdSaTcU9EmIVG9Yiyv3tqVJ8Yv46Upa1m1PYPhN3aiVuUKQUcTEZFyysxoW786betX55H+rZi5djcfz9vCuMVb+WjeZupUqcDF7eozuEN9OjSqUexCKzsnl2e+XsWzE1fTom4V3rzzLM5MrBqipQmtqzs35NmvV/HcxNUq2kTCgIo2CZnoKOPRQW1olViNX41ZxODhU3lpSBdaJYbHnbxERKT8io4yerSoQ48WdXj8srZMXL6Tj+dv5q1ZG3ht2jqa1q7EpR0acFmH+jSvW+Wk09u2/ygPvjOPWWv3cHXnhvxhcNuIvpNyfGw0d/Vuzp/HLeO7DXvp1Dh8Hk0g5cOOA0fJdT96ali5pf5qEnJXdm7Iu0O7cywrlyuen8aXS7YFHUlEROR/4mKi6Z+SyAs3dWbOY+fz96va0aBmRZ79ZhX9/jmJS56dyqgp6ew4cLTQz09cvoMB/57M4s37efra9jx5dfuILtjy3HBWY2pUiuX5iauDjiLlzJh5m+j+16/519xjZBzLDjpOWFDRJqWiY+OafPpAL86oV4Vhr8/lma9X4XT2REREwky1+Fiu6dKIN+/szoxfncdjg1rjcPzp82V0/+vX3DRqJu/P2cjBo1lk5eTyzvJMbnttNonVK/LpA724vGPDoBehxFSOi+H2ns34atkOlm09EHQcKSfen7ORh95bQMuEqizencM1L05n2/7CT5iUJyrapNQkVPMexH15xwY8NWEl9731HYczdfZERETCU0K1eO7s3ZzPHujNVw+dw/3nJrNhz2F+/sFCOv/pK85/ahJfrMvi5u5NGHNvD1oUoRtlpLnl7KZUiYthuFrbpBS8M2sDv/hwIb2S6zD2vp78tFMc63cf4vLnvy33Jw5UtEmpynsQ968HtuKLxdu48oXpbNp7OOhYIiIiJ5RcrwoPXXgmk37el4/u7cEN3RpTo2Is93aI44+XpRAfW/KPDQgH1SvFclP3Jny+aCvpOzOCjiNl2Bsz1vPLjxZxTsu6vDSkC/Gx0bSrG8P7d/fAObj6xelMXrkz6JiBUdEmpc7MGNqnBa/c2pVNew9z6XPfMjN9d9CxRERETsrM6NS4Jr+/tC0f39+LbomRf+3aydzRqxkVoqN4IW1N0FGkjBo9bR2PjV3M+a3rMeLmzj84CdKmfjXG3NeDhjUrcttrs3l39oYAkwZHRZsEpu+Z9Rh7X09qVIrlxlEzeXPm+qAjiYiISAF1q8ZxfbfGjJm3Wb1jpMS9PHUtv/tkCRe2SeD5GzsTF/PjVuuk6hV5/+6z6Zlch0c+XMQ/vlxR7u6NoKJNAtWibhXG3NuTnsl1eHTMYh4bu4isnNygY4mIiEg+Q/s0xwxempwedBQpQ0ZOXsMfP1vKgJREht/YiQoxxy9NqsbH8vItXbiuayOem7ian747n2PZOaWYNlgq2iRw1SvG8sqtXRnWpzlvzNjAzS/P5GBm+Tp7IiIiEs7q16jIFR0b8s7sjew8eCzoOFIGDJ+4mr+MW87F7ZJ45vqOxEafvCyJjY7ir1ek8ov+Z/Lx/C3cPGoW+w5nlkLa4Klok7AQHWX8amBrnr62Pd9t2Mc/5xzlkJ7LISIiEjbu7tuCrJxcRk1Va5ucnme+XsWTX67gsg71+de1HYpUsOUxM+7tm8wz13dk/sZ9XPHCNDbsLvvddlW0SVi5vGNDXrypExsO5nL3G3PJzFZXSRERkXDQrE5lBrWrzxvT15eb1g0pWc45npqwkqcmrOSKTg345zUdiClGwZbfpe3r88adZ7HnUCaXP/8t323YW8Jpw4uKNgk7/VolcFvbCkxZtYtHPlxIbq66SoqIiISD+85twaHMHF6bti7oKBJhnHP8478reObrVVzTpSFPXtWe6Cg7rWl2a1aLD+/pQeW4GK4fOYMvFm8tobThR0WbhKXeDWP52YUtGTNvM3/7cnnQcURERARolViN81sn8Oq368jQZQxSRM45nvhiOcMnruH6bo154op2p12w5fFuateDNvWrcc+b3zFqSnqZvLOkijYJW/edm8zN3ZswYlI6r0xdG3QcERERAe7vl8z+I1m8pUf1SBE45/jz58sYMSmdm7s34c+XpRBVQgVbntpV4nj7ru70b5vInz5fxu8/WUJOGeuppaJNwpaZ8ftL29K/bSJ//Hwpny3cEnQkERGRcq9Doxr0Sq7DS1PWcjSr/NxyXYrPOccfPl3KqKlrua1nUx4f3LbEC7Y88bHRDL+hE0P7NGf09PUMe30OhzPLTmuwijYJa9FRxr+u60CXJjV56N0FTFuzK+hIIiIi5d6957Zg58FjvD9nY9BRJEzl5jp+8/FiXpu2jjt7NeO3F7fBLDQFW56oKOPXA1vzx8Ft+Wb5Dq4dMYMdB46GdJ6lRUWbhL342GhGDelK0zqVGPafuSzdciDoSCIiIuXa2c1r06lxDV6clE5Wju70LD+Um+t4dOwi3pixgbvPacGjg1qHvGDL7+azm/LSkC6s3pHB5c9PY+X2g6U271BR0SYRoXqlWF67rRtV4mO49dVZbNxT9p/HISIiEq7MjPv7JbN53xHGztscdBwJIzm5jkc+XMjbszZy/7nJPNL/zFIt2PKc1zqB94adTWZOLle+MI1pqyO7t5aKNokY9WtUZPTt3TialcMtr85i7yE9I0ZERCQo555ZjzZJ1XghbU2Zu+mDnJqcXMfPP1jA+3M38ZPzzuDhC1sGUrDlSW1YnbH39SSpejxDXpnFB3M3BZbldKlok4jSMqEqo27pyqa9R7h99GyOZOoCaBERkSCYGfedm0z6rkOML8PPx5Kiyc7J5aH35vPRd5t5+IKW/N8FwRZseRrUqMgH9/TgrOa1+Nn7C3h6wsqIfCSAijaJON2a1eKZ6zowf+M+Hnj7O7LVl15ERCQQ/VMSaV63MsMnronIA2EpGVk5ufzk3fl8PH8Lv+h/Jg+cd0bQkX6gWnwsr97ajas6N+TfX6/i4fcWkJkdWcePKtokIvVPSeLxwSl8tWwHj41drB2FiIhIAKKjjHvOacGyrQeYuGJH0HEkAJnZuTz49jw+X7iVRwe25t6+yUFHKlSFmCievKodD13Qko/mbeaWV2ax/3BW0LGKTEWbRKybuzfhgX7JvDN7I09/tSroOCIiIuXSZR0b0KBGRZ77ZrVOopYzmdm53PfWd4xfvI3fXtyGu/o0DzrSCZkZD553Bk9f25456/dw5YvTIubmdiraJKI9dEFLrunSkGe+XsWbM9cHHUdERKTciY2O4u5zmvPdhn1MT98ddBwpJceyc7jnjblMWLqdxwe35fZezYKOVGSXd2zIf24/ix0HjnL589NYuGlf0JFOSkWbRDQz4y+Xp9KvVT1+M3YxXy7ZFnQkERGRcufqLo2oWzWO4RNXBx1FSsHRrByGvT6Xr5fv4M+XpzDk7KZBRyq2s1vU5v/bu+/4qKr8/+OvTxoJCSRAIIQQagLSWyhSQ1OxYacsiBVdsWBZy667uvtzd9VV12VXUZpdsCsrropK6EWa9F4jFYa9HQAAIABJREFUvQQILSQ5vz8y65dVSgKZ3Jnk/Xw88sjMnTv3vudkkpPP3HPP/fiujkSGh9Dv1TlMXrHT60hnpKJNgl5YaAj/GtiKZjXjuHf8IuZv2ud1JBERkTIlMjyU27vUZea6vSzast/rOOJHx07kcfub85m6ZjfPXNuMX7Wv7XWkc5ZSrQKf3NWJBgkxDH1rPq/P3Oh1pNNS0SalQvmIMF67qS1JcVHc+sZ81paCK9+LiIgEk1+1r01sVDgvTVnvdRTxk6M5edzy+vfMWLeHZ69tTr+2tbyOdN6qVijHhKEX0qtRAk/+ewV/+veKgLzuoIo2KTUqR0fwxi3tiAgLYci4eWw/cNTrSCJSRpnZODPbZWbLTlpW2cwmm9la3/dKXmYUKW7R5cK4uVMdvlm5k1U7DnodR4rZ4eO53PTaPOZs2MsLN7Tg+rRkryMVm6iIUF4Z1IabO9Vh3MyN/PrtBQF3LWAVbVKqJFcuz2s3teXgsVxuGvc9B44Gz1SuIlKqvA5c8rNljwLfOudSgW9990VKlZs61iE6IrTMHG07kZfPgeOBd1SmuGX7Crb5m/fzYv9WXN2qpteRil1oiPHEFU34w+WNmbxyJ/1Hz2H3oeNex/qJijYpdZomxfLq4DZs2JPN7W/O59iJwPqkRERKP+fcNODnJ9j2Bd7w3X4DuKpEQ4mUgLjyEQy6sDaTlmxj457DXsfxqw27s7ninzO4b8oRLv/ndEZmrGfL3uCYPr4oDh47wY1j57JoSxYj+rfiyhY1vI7kV7d0rsurg9qwesdBrhk5k3W7sr2OBECY1wFE/KFTSjzP39CSe8cv4oH3F/PPAa0JDTGvY4lI2ZbgnNsO4JzbbmbVSmSvw4fTMiMD4uJKZHfnq2VWVtBkheDKW1JZH8zLp8eWLPInRkDVmHPaRqC3657sHPbsyeYpM2Ij4Hh+CNnHc9kGHCgXRpXoCCrHlCMyLLCOjxS1XXPzHZu3H+SRnDxSq8VQeVaEH9P9klfvg4uA+cdzWb3jEPtfdhysXoGKkeFnfE5KfDykp/stk4o2KbWubFGDXQeP8dSklcTHLOePVzbBTIWbiAQ+MxsKDAVISEggIyPjnLeVkplJVF4eWVmBfx0igLwgygrBlbcks8aWg92HjlMxNJfwc6hbArVd8x3sOpJP1nFHVJhRI8YIcXmEhho5UaEcynEcysljy74jbNl3hMgwo0KEUTHCzqkdiltR2jXPwdZD+RzLdSRVCCHkxBGyskr2SKLX74PkCkbmIceKbQdJjAkhNuL0/0fmxMae19/qszlr0WZmkcA0oJxv/Q+dc0+YWV1gAlAZWAgMds7lmFk54E2gDbAX6Oec2+Sn/CJndFuXeuw8eIzR0zeSUDGSYd1TvI4kImXXTjNL9B1lSwR2nW5F59woYBRAWlqaSz+fT2/T08nIyOC8tlGCgikrBFfeksx6OOsolz87hUEdavPklU2K/PxAbNdNew4z7N2FLN92kDu61uOhixsSHhryP1n/e/h8674jfLF0O5OWbmdJ5gEAWibHcXnzRPo0SyQpLsqT11DYdt1/OIfBY+ayblc2rwxuTfIFCf4PdwqB8D4od+QEd7w9nzkb9vFg7wbc3SPllAcBFvs5a2Fq/uNAD+dcC6AlcImZdQCeAf7uO6F6P3Crb/1bgf3OuRTg7771RDzzWJ9G9G1Zg799tZoP5m/1Oo6IlF0TgSG+20OAzzzMIuJXSXFRXN0qifHztgTUZA7n6oul27n8nzPI3H+UsUPSeOzSRoSHnv7f6OTK5bmjW30m3t2Zab/pziOXXEBufj5PTVpJp6e/4+qXZzJm+ga2ZQXeTNd7s48zYPQc1u3OZvSQNHp4VLAFitjy4bxxSzuubpXE85PX8MhHSziRl1/iOc5atLkC/z0DL9z35YAewIe+5SefUH3yidYfAj1NY9LEQyEhxt+ua0HnlHge/XgpU1af9sNtEZFiYWbjgdlAQzPLNLNbgaeB3ma2Fujtuy9Sav06vT4n8vIZOyNwL1h8Nsdz83jis2Xc9c5CUqrFMOnezvRsVLQiplaV8vw6vT6f39OFjIfS+c3FDcnJLSjgOj79HdeOnMW4GRvZceCYn15F4e0+VFCwbdp7mHFD2tKtQVWvIwWEcmGhvHBDC+7tmcr78zO5+bXvOXisZGcoL9ToWjMLNbPFFAzlmAysB7Kcc7m+VTKBJN/tJGArgO/xA0CV4gwtUlQRYSGMHNSaC6pX4K63F7J4a+CNkxeR0sM5N8A5l+icC3fO1XTOjXXO7XXO9XTOpfq+/3x2SZFSpV7VGC5tlsjbczZz4EjwXYJn674jXP/KbN6YvZlbO9fl/TsupGal8ue1zTrx0QzrnsKke7swxVfAHcnJ40+fr6DDX7/lupGzeG3mRnYeLPkCbtfBY/QfNZut+44y7qa2dE6NL/EMgczMeKB3A/52XXPmbNjL9SNn82MJHikt1EQkzrk8oKWZxQGfAI1OtZrv+6mOqv3iAhbFeZJ1oMvOzi7Vr88f/NVmtzfM58/78xk8aia/6xBF9egAOCu4mOh9VnRqs6JRe4lIUQ3rnsLnS7bz+qxN3Ncr1es4hfbV8h089MEPALw6uA0XN6le7Puo6yvghnVPYf3ubL5YUnAO3B//vYI/fb6CtrUrc1nzRPo0rU61ipHFvv+T7ThwjIGj57Dj4DFev7kt7evpeMvpXJ+WTI24KO58awFXvzSTcTe1pWlSrN/3W6TZI51zWWaWAXQA4swszHc0rSawzbdaJpAMZJpZGBDLL69VU7wnWQe4QDiJMtj4s81atDnMtSNn8dJy+OjXHahWwb9/CEuK3mdFpzYrGrWXiBRVo8SK9GpUjddmbeS2LnWJLhfYE5fn5ObzzJerGDtjI81rxvLSwNYkVz6/o2uFUb9qDPf0TOWenqms25VdMInJku08MXE5T/57Oe3qFBRwlzStXuz/t2zLOsrA0XPYk53Dm7e0I61O5WLdfmnUKSWeD3/dkVte/54bXp3Nvwa28vvFr8+6fTOr6jvChplFAb2AlcAU4DrfaiefUH3yidbXAd8550r/peIlaNSNj2bcTW3ZcyiHm1/7nuzjuWd/koiIiJyTu7qnkHXkBO/M3ex1lDPK3H+EG16dzdgZG7mpYx0+uPPCEinYfi6lWgz39kzlq/u7Mvn+rtzXM5V9h3P4w2fLaf+Xb+k/ajZvzdlcLBO8ZO4/Qr9Rs9mbncObt6pgK4qG1SvwyV0dqVc1mtvemM93W/w7BLgwRWEiMMXMlgDfA5Odc58DjwAPmNk6Cs5ZG+tbfyxQxbf8AeDR4o8tcn5aJsfx8qDWrNpxiDvfWkBObsnPAiQiIlIWtK5ViY71qzB6+kaOncjzOs4pfbtyJ5eNmMH6Xdm8/KvWPHllE8qFhXodi9SECgzv1YDJD3Tj6/u7cm+PVHYfOs7vP11G+798w8DRc3h7zmb2ZBe9gNu67wj9Xp3DgSMnePu29rSuVckPr6B0q1YxkveGXkh6w2rsPerfY1RnPUbtnFsCtDrF8g1Au1MsPwZcXyzpRPyoe8NqPH1NM37z4RIe/vAHXrihJSEhmuhURESkuN3dPYWBY+bywYJMBneo7XWcn5zIy+e5r1bz6rQNNKlRkZcGtqZOfLTXsU6pQUIFGvSuwPBeqazZmc2kJdv4fMl2Hv90GX/4bBkX1q/CZc1qcHGTBKrElDvjtjbvPcyAUXM4nJPHu7d3KJFzskqr6HJhjBrchmnTpvp1P4E9sFjEz65PS2bXoeP87avVVKsYyW8vPdUcOyIiInI+LqxfhVa14nglYz392yaf8RpnJWVb1lHuGb+IBZv3M6hDLR6/rDGR4d4fXTsbM6Nh9Qo0rN6Q+3s3YNWOQ0zyTWLy20+W8vvPltGxfhUubZbIxU2qUzk64n+ev3FPQcF2PDePd29vT5MaKtjOV1hoCCF+vsKZijYp8+5Kr8/Og8cYNW0D1SqU47Yu9byOJCIiUqqYGXd3T+HWN+bz2eJtXNempqd5pqzexQPvLSYnN58RA1pxZYsanuY5V2ZGo8SKNEqsyIMXNWDl9kNMWrqNSUu289jHS3n804IC7vLmiVzUuDrbsvN5+NXZ5OU7xg/twAXVK3r9EqSQVLRJmWdmPHFFE3YfOs5Tk1ZSrWJk0P7xFhERCVQ9LqhGo8SKvJyxjqtbJRHqwSkJuXn5vDB5DS9nrOeC6hV46VetqV81psRz+IOZ0bhGRRrXqMhDFzVk+baDTPLNQvnIR0v53SfLCDNHTFQ5JgztQGpCBa8jSxGoaBMBQkOMv/dryd7D83jw/cVUiY6gU4ouKikiIlJczIxh3etz97uL+HLZDi5rnlii+9958Bj3jF/EvI376N82mSevbBIUwyHPhZnRNCmWpkmxPHxxQ5b9WFDATVu2kRFDOpBSrXQUqmWJ9wOKRQJEZHgoo29Mo158DHe8tYDl2w54HUlERKRU6dM0kXrx0bw0ZR0leUWo6Wt3c+k/prM08wB/79eCp69tXmoLtp8zM5rVjOXRPhfwcNsoFWxBSkWbyElio8J5/Za2VIgM46bXvmfrviNeRxIRESk1QkOMO9Prs2L7QTJW7/b7/vLyHS98vZobx82jSkwE/76nE1e38vZ8OpFzoaJN5GcSY6N485Z25OTmc+O4eew7nON1JBERkVLj6lZJJMVF8S8/H23bdegYg8bMZcR367i2dU0+HdaJlGo6j0uCk4o2kVNITajA2CFpbMs6yi2vf8+RnFyvI4mIiJQK4aEh3NGtHgs272fOhn1+2cesdXu49B8zWLR1P3+7rjnPXd+C8hGaykGCl4o2kdNIq1OZEQNasSQzi7vfXURuXr7XkUREREqFG9KSiY8px0tT1hXrdvPyHSO+XcugsXOJjQrjs2GduT4tuVj3IeIFFW0iZ3Bxk+r8qW9Tvlu1i99+srRET5oWEREprSLDQ7m9S11mrNvD4q1ZxbLNPdnHuem1ebwweQ19WyYx8e7ONKyu4ZBSOqhoEzmLQR1qc2+PFN6fn8mTE5ezZa8mJxERETlfv+pQm9io8GI52jZ3w14u/cd05m7cx9PXNOOFG1oQXU7DIaX00LtZpBDu792AvYdzeGP2Zt6YvZm68dF0a1CVrg3i6VCvisbJi4iIFFFMuTBu6liHf3y7llU7DnJB9YpF3kZ+vmPk1PU8//VqaleJ5vWb29G4RtG3IxLo9J+mSCGYGX++uhm3danHtDW7mbpmN+99v5XXZ20iIjSEdnUr+4q4qjRIiMHMvI4sIiIS8G7uVIcx0zfw8pT1jBjQqkjP3Xc4h/vfW8zUNbu5okUN/npNM2J0dE1KKb2zRYqgbnw0deOjGdKxDsdO5DF/036mrd3N1NW7+fMXK/nzFyupXjHypwKuc0o8seXDvY4tIiISkOLKRzCoQ21GT9/AA70bUCc+ulDPm79pH/eMX8Te7Bz+31VNGdS+lj4wlVJNRZvIOYoMD6VzajydU+P57aWN2H7gKNPW7Gbamj38Z9l23pu/lRCDVrUq/VTENUuKJTREnYqIiMh/3dqlLq/N2sTIjPU8c13zM66bn+8YPX0Dz361mqS4KD6+qyNNk2JLKKmId1S0iRSTxNgo+rWtRb+2tcjNy+eHzCymrt7N1LV7+Ps3a3hh8hoqlQ+nS2pVujWoSpcG8VSrEOl1bBEREU9VqxBJ/7bJjJ+3hft6pVIjLuqU62UdyeHB93/g21W76NO0Os9c15yKkRrNImWDijYRPwgLDaFN7cq0qV2ZBy5qyL7DOUxfW3Au3LQ1e5j4wzYAGidWpFvDqnRNrUqb2pWICNOEriIiUvYM7VqPd+duYdS0DTx5ZZNfPL5wy37ueXcRuw4d48krGjOkYx0Nh5QyRUWbSAmoHB1B35ZJ9G2ZRH6+Y+WOg0xdU3Au3OhpGxiZsZ7oiFA6psTTtUFV0htUJblyea9ji4iIlIialcpzVaskxs/bwt09Un5a7pxj7IyNPP2fVVSPjeTDOzvSIjnOw6Qi3lDRJlLCQkKMJjViaVIjlrvSUzh07ASz1+8tKOLW7Gbyip0A1IuPpmuDgqGUHepVISoi1OPkIiIi/vPr9Pp8tDCTsTM20j4SDhw5wW8+/IGvV+ykd+MEnruuhSb3kjJLRZuIxypEhnNRk+pc1KQ6zjk27jn8UwE34fstBZcVCAuh/UmXFUitpssKiIhI6VK/agyXNkvkrdmbiW4WxuP/nM6OA8d4/LJG3Nq5rvo9KdNUtIkEEDOjXtUY6lWN4eZOdTl2Io/vN+0rmNBkzW6emrQSJq0kMfb/LivQKSWe2Ch98igiIsFvWHoKk5Zs57n5uSTFRfH+nRfSulYlr2OJeE5Fm0gAiwwPpUtqVbqkVuVxYFvW0Z8u7j1p6XYmfL+V0BCjVXIcF1bOpZtz+iRSRESCVuMaFRncoTarN2Uyamhn4spHeB1JJCCoaBMJIjXioujfrhb92xVcVmDx1qyfCrh/bj7OwkNzeeKKJjRIqOB1VBERkXPy/65qSkbGHhVsIifR/OIiQSosNIS0OpV58KKGfD28K4MaRbDsx4P0+cd0npy4nANHTngdUURERESKgYo2kVIgLDSEXrXDmfJQOgPaJfPm7E2kPzeFt+dsJi/feR1PRERERM6DijaRUqRydARPXdWMz+/pQoOECjz+6TIu/+cM5m7Y63U0ERERETlHKtpESqHGNSoyYWgHXhrYmoNHT9Bv1ByGvbuQH7OOeh1NRERERIpIRZtIKWVmXNY8kW8e6MbwXql8s2InPZ/P4MVv1nDsRJ7X8URERESkkFS0iZRyURGhDO/VgO8eSqdnowRe/GYtPZ+fyqQl23FO57uJiIiIBDoVbSJlRFJcFC8NbM2EoR2oGBXOsHcXMmD0HFZuP+h1NBERERE5AxVtImVMh3pV+Pyezjx1VVNW7TjEZSOm8/inS9l/OMfraCIiIiJyCiraRMqg0BBjUIfaZDyUzuAOtRk/byvpz2Xw5uxN5Oblex1PRERERE6iok2kDIsrH8Ef+zbli3u70KRGRf7w2XIuGzGDWev2eB1NRERERHxUtIkIDatX4J3b2vPKoDYczsll4Ji53PnWArbuO+J1NBEREZEyL8zrACISGMyMS5pWJ71hVcZM38BLU9bz3epd3Nm1Hnem16d8hP5ciIiIiHjhrEfazCzZzKaY2UozW25m9/mWtzSzOWa22Mzmm1k733IzsxFmts7MlphZa3+/CBEpPpHhodzdI5XvHurGJU2qM+K7dfR8fioTf9imSwSIiIiIeKAwwyNzgQedc42ADsAwM2sMPAv80TnXEviD7z5AHyDV9zUUGFnsqUXE7xJjoxgxoBUf3HkhlaMjuHf8Ivq9OodlPx7wOpqIiIhImXLWos05t905t9B3+xCwEkgCHFDRt1ossM13uy/wpiswB4gzs8RiTy4iJaJtncpMvLszf72mGet2Z3PFv2bw2MdL2Zt93OtoIiIiImVCkU5SMbM6QCtgLjAc+MrMnqOg+OvoWy0J2HrS0zJ9y7afZ1YR8UhoiDGgXS0ubZbIP75Zy5uzN/H5km3c36sBgy+sTXio5jQSERER8ZdCF21mFgN8BAx3zh00s6eA+51zH5nZDcBYoBdgp3j6L06EMbOhFAyfJCEhgYyMjHOIHxyys7NL9evzB7VZ0ZVUm3WtACkdI3l3ZQ5/+nwFYzJWMvCCcjSND/X7voub3mdFo/YSERHxRqGKNjMLp6Bge8c597Fv8RDgPt/tD4AxvtuZQPJJT6/J/w2d/IlzbhQwCiAtLc2lp6cXNXvQyMjIoDS/Pn9QmxVdSbfZgMsc36zcxVOTVvDc/CP0bpzA45c1onaV6BLLcL70PisatZeIiIg3CjN7pFFwFG2lc+6Fkx7aBnTz3e4BrPXdngjc6JtFsgNwwDmnoZEipYyZ0btxAl/f35WHL2nIzHV76P3CNJ79chWHj+d6HU9ERESk1CjMkbZOwGBgqZkt9i37LXA78A8zCwOO4RvqCHwBXAqsA44ANxdrYhEJKOXCQrkrPYVrW9fkmf+s4uWM9Xy0MJNH+1zAVS2TKPjcR0RERETO1VmLNufcDE59nhpAm1Os74Bh55lLRIJMQsVIXujXkl91qM0f/72c+9/7gbdmb+bxyxvTulYlr+OJiIiIBC1N+SYixapN7Up8elcnnr2uOVv2HeWal2dxwyuz+Xr5DvLydXFuERERkaIq0pT/IiKFERJi3JCWzKXNEpkwbwuvzdzE0LcWUKdKeW7tXJdr29SkfIT+/IiIiIgUho60iYjfxJQL47Yu9Zj6m3T+OaAVsVHh/P6z5XR8+jv+9tUqdh085nVEERERkYCnj7pFxO/CQkO4okUNLm+eyPzN+xkzfQMvZ6xn9LSNXNmyBrd2rkujxIpexxQREREJSCraRKTEmBlt61SmbZ3KbNpzmHEzN/LB/Ew+XJBJl9R4butSj66p8ZpxUko1M7sE+AcQCoxxzj3tcSQREQlwGh4pIp6oEx/Nn/o2ZfZjPfjNxQ1ZveMQQ8bN4+IXp/H+91s5npvndUSRYmdmocBLQB+gMTDAzBp7m0pERAKdijYR8VRc+QiGdU9hxiM9eP76FoSY8fBHS+j09BRGfLuWfYdzvI4oUpzaAeuccxuccznABKCvx5lERCTAaXikiASEiLAQrm1Tk2taJzFz3V7GzNjAC5PX8HLGOq5tXZNbOtelftUYr2OKnK8kYOtJ9zOB9j9fycyGAkMBEhISyMjIOK+dZmdnn/c2SkowZYXgyqus/qGs/hNMef2dVUWbiAQUM6NzajydU+NZs/MQY6cXnPf2ztwt9GpUjdu61KN93co6702C1aneuL+4gKFzbhQwCiAtLc2lp6ef104zMjI4322UlGDKCsGVV1n9Q1n9J5jy+jurhkeKSMBqkFCBZ65rzsxHe3Bvz1QWbsmi/6g5XPmvmXy2+EdO5OV7HVGkqDKB5JPu1wS2eZRFRESChIo2EQl4VSuU44HeDZj1aA/+cnUzDufkct+ExXR9dgqvTl3PwWMnvI4oUljfA6lmVtfMIoD+wESPM4mISIDT8EgRCRqR4aEMbF+L/m2TmbJ6F2Omb+Sv/1nFiG/X0q9tLW7uVIfkyuW9jilyWs65XDO7G/iKgin/xznnlnscS0REApyKNhEJOiEhRs9GCfRslMCyHw8wZvoG3py9iddnbaRP00Ru61KXVrUqeR1T5JScc18AX3idQ0REgoeKNhEJak2TYnmxfyse6XMBr8/axLtztzBp6XbSalfiti516d24OqEhmrREREREgpfOaRORUiExNorH+jRi9mM9eeKKxuw8dIw7315Ij+czeGPWJg4fz/U6ooiIiMg5UdEmIqVKTLkwbu5Ul4yHujPyV62pEh3BExOX0/Hp73jmy1XsPHjM64giIiIiRaLhkSJSKoWGGH2aJdKnWSILNu9nzPQNvDp1PWOmb+CK5jW4rUs9ryOKiIiIFIqKNhEp9drUrkSb2m3YsvcI42Zu5P35W/l40Y/0rR9Ot25OF+oWERGRgKbhkSJSZtSqUp4nr2zC7Md6cm3rmny2/gT3jF/EsRN5XkcTEREROS0daRORMic2Kpznrm9OaPZOPli6na37jzL6xjZUqxDpdTQRERGRX9CRNhEpk8yMS+tFMPJXbViz4xBX/WsmK7Yd9DqWiIiIyC+oaBORMu2SptX54M4LyXdw3Suz+GbFTq8jiYiIiPwPFW0iUuY1TYrls7s7kVIthtvfms/oaRtwznkdS0RERARQ0SYiAkBCxUjeG3ohfZpW589frOTRj5aSk5vvdSwRERERFW0iIv8VFRHKvwa05p4eKbw3fys3jptL1pEcr2OJiIhIGaeiTUTkJCEhxoMXNeTv/VqwcHMWV788iw27s72OJSIiImWYijYRkVO4ulVN3r29PQePnuCql2Yyc90eryOJiIhIGaWiTUTkNNLqVObTYZ2oHhvJjePm8c7czV5HEhERkTJIRZuIyBkkVy7PR7/uSJfUeH73yTL+9O8V5OVrZkkREREpOSraRETOokJkOGNuTOPmTnUYN3Mjt785n0PHTngdS0RERMoIFW0iIoUQFhrCE1c04amrmjJ1zW6uGzmbrfuOeB1LREREygAVbSIiRTCoQ23euLkd2w4c5eqXZ7Jg836vI4mIiEgpp6JNRKSIOqfG88ldnYguF8aA0XP4bPGPXkcSERGRUkxFm4jIOUipFsOnd3WiZXIc901YzAtfryZfE5SIiIiIH6hoExE5R5WiI3j71vbckFaTEd+t454Jiziak+d1LBERESllzlq0mVmymU0xs5VmttzM7jvpsXvMbLVv+bMnLX/MzNb5HrvYX+FFRLwWERbCM9c257E+F/DF0u30HzWbXQePeR1LRERESpGwQqyTCzzonFtoZhWABWY2GUgA+gLNnXPHzawagJk1BvoDTYAawDdm1sA5p4+fRaRUMjPu6FafuvHRDH9vMX1fmsmYIWk0qRHrdTQREREpBc56pM05t905t9B3+xCwEkgCfg087Zw77ntsl+8pfYEJzrnjzrmNwDqgnT/Ci4gEkouaVOeDOy8E4PpXZvP18h0eJxIREZHSoEjntJlZHaAVMBdoAHQxs7lmNtXM2vpWSwK2nvS0TN8yEZFSr0mNWD4b1onUajHc8fYCXp26Huc0QYmIiIicu8IMjwTAzGKAj4DhzrmDZhYGVAI6AG2B982sHmCnePov/mMxs6HAUICEhAQyMjKKnj5IZGdnl+rX5w9qs6JTmxWdP9tsWCPHmNxQ/vqfVcxYso4hTSIICznVn8fgofeYiIiINwpVtJlZOAUF2zvOuY99izOBj13BR8jzzCwfiPctTz7p6TWBbT/fpnNuFDAKIC0tzaWnp5/rawh4GRkZlObX5w9qs6JTmxWdv9usV3fHi9+uZcS3a8mJqMgrg9rfV5zMAAANyklEQVRQKTrCb/vzN73HREREvFGY2SMNGAusdM69cNJDnwI9fOs0ACKAPcBEoL+ZlTOzukAqMK+4g4uIBLqQEOOB3g14sV9LFm3N4qqXZ7JuV7bXsURERCTIFOactk7AYKCHmS32fV0KjAPqmdkyYAIwxBVYDrwPrAC+BIZp5kgRKcuuapXE+Ns7cPh4Lle/PJMZa/d4HUlERESCSGFmj5zhnDPnXHPnXEvf1xfOuRzn3CDnXFPnXGvn3HcnPefPzrn6zrmGzrn/+PcliIgEvja1K/HpsE7UiI1iyGvzeHvOZq8jiYiISJAo0uyRIiJy7mpWKs9Hd3WkW4OqPP7pMp6cuJzcvHyvY4mIiEiAU9EmIlKCYsqFMfrGNG7tXJfXZ23itjfnc+jYCa9jiYiISABT0SYiUsJCQ4zfX96Yv1zdjBlr93DtyFls3XfE61giIiISoFS0iYh4ZGD7WrxxSzt2HDjGVS/NZMHmfV5HEhERkQCkok1ExEOdUuL5ZFgnKkSGMWDUXD5d9KPXkURERCTAqGgTEfFY/aoxfHJXJ1rXjmP4e4v53SdL2XHgmNexREREJECoaBMRCQCVoiN485b23NSxDu99v5Wuz07h958uY1vWUa+jiYiIiMdUtImIBIiIsBCevLIJUx5K59o2NZnw/Ra6/W0Kv/1kKZn7NVGJiIhIWaWiTUQkwCRXLs9fr2nGlIfS6dc2mQ/nZ5L+twwe/WiJZpkUEREpg1S0iYgEqJqVyvPUVc3I+E06A9vX4uOFP5L+XAa/+eAHNu897HU8ERERKSEq2kREAlyNuCj+1Lcp0x7uzuAOtZn4wzZ6PD+VB95fzIbd2V7HExERET9T0SYiEiSqx0by5JVNmP5wd27qWIcvlm6n1wtTGT5hEet2HfI6noiIiPiJijYRkSBTrWIkv7+8MdMf7sHtXerx1fKd9P77NO4Zv4g1O1W8iYiIlDYq2kREglTVCuV47NJGzHikO3d2q893K3dy8YvTGPbOQlbtOOh1PBERESkmKtpERIJclZhyPHLJBcx4pAfD0lOYumY3l7w4nTvfWsDybQe8jiciIiLnKczrACIiUjwqRUfw0MUNua1LXcbN3MRrMzfy5fId9GqUwH09U2lWM9briCIiInIOdKRNRKSUiSsfwQO9GzDjkR7c36sB8zbu5Yp/zeCW179n8dYsr+OJiIhIEaloExEppWKjwrmvVyozHu3BQxc1YOGW/Vz10kyGjJvHwi37vY4nIiIihaSiTUSklKsYGc7dPVKZ8UgPHr6kIUsys7jm5VkMHjuX+Zv2eR1PREREzkJFm4hIGRFTLoy70lOY8UgPHutzASu2HeS6V2YzcPQc5m7Y63U8EREROQ0VbSIiZUx0uTDu6Faf6Y905/HLGrFmZzb9Rs2h36uzmbV+D845ryOKiIjISVS0iYiUUeUjwritSz1mPNKdP1zemI17DjNw9FxueHU2M9aqeBMREQkUKtpERMq4yPBQbulcl2kPd+ePVzZh676jDBo7l2tHzmLqmt0q3orIzK43s+Vmlm9maT977DEzW2dmq83sYq8yiohIcNF12kREBCgo3oZ0rEP/dsm8Pz+TkVPWMWTcPFokx3FfzxRMxVthLQOuAV49eaGZNQb6A02AGsA3ZtbAOZdX8hFFRCSYqGgTEZH/US4slMEdanNDWk0+WvAjL01Zxy2vz6dOxRDqNT9M7SrRXkcMaM65lQBm9vOH+gITnHPHgY1mtg5oB8z2a6Dhw2mZkQFxcX7dTXFpmZUVNFkhuPIqq38oq/8EU96U+HhIT/fb9lW0iYjIKZULC2Vg+1pcn1aTjxdmMvrb5SRUjPQ6VjBLAuacdD/Tt+wXzGwoMBQgISGBjIyMc95pSmYmUXl5ZGUFx4XV84IoKwRXXmX1D2X1n2DKmxMbe15/q89GRZuIiJxReGgI/drWIuHwBiLDQ72OExDM7Bug+ike+p1z7rPTPe0Uy0455tQ5NwoYBZCWlubSz+fT2/R0MjIyOK9tlKBgygrBlVdZ/UNZ/SeY8i72c1YVbSIiIkXknOt1Dk/LBJJPul8T2FY8iUREpDTT7JEiIiIlYyLQ38zKmVldIBWY53EmEREJAiraREREipGZXW1mmcCFwCQz+wrAObcceB9YAXwJDNPMkSIiUhgaHikiIlKMnHOfAJ+c5rE/A38u2UQiIhLsdKRNREREREQkgKloExERERERCWAq2kRERERERAKYijYREREREZEAdtaizcySzWyKma00s+Vmdt/PHn/IzJyZxfvum5mNMLN1ZrbEzFr7K7yIiIiIiEhpV5jZI3OBB51zC82sArDAzCY751aYWTLQG9hy0vp9KLj2TCrQHhjp+y4iIiIiIiJFdNYjbc657c65hb7bh4CVQJLv4b8DDwPupKf0Bd50BeYAcWaWWLyxRUREREREyoYiXafNzOoArYC5ZnYl8KNz7gczO3m1JGDrSfczfcu2/2xbQ4GhAAkJCWRkZBQxevDIzs4u1a/PH9RmRac2Kzq1WdGovURERLxR6KLNzGKAj4DhFAyZ/B1w0alWPcUy94sFzo0CRgGkpaW59PT0wkYJOhkZGZTm1+cParOiU5sVndqsaNReIiIi3ihU0WZm4RQUbO845z42s2ZAXeC/R9lqAgvNrB0FR9aST3p6TWDbmba/YMGCPWa2+RzyB4t4YI/XIYKM2qzo1GZFpzYrmuJqr9rFsI0yo5j6yGB6rwdTVgiuvMrqH8rqP8GUtziynrZ/NOd+cRDsf1coqMreAPY554afZp1NQJpzbo+ZXQbcDVxKwQQkI5xz7c4xeKlgZvOdc2le5wgmarOiU5sVndqsaNRewSuYfnbBlBWCK6+y+oey+k8w5fV31sIcaesEDAaWmtli37LfOue+OM36X1BQsK0DjgA3n3dKERERERGRMuqsRZtzbganPk/t5HXqnHTbAcPOO5mIiIiIiIicfcp/KRajvA4QhNRmRac2Kzq1WdGovYJXMP3sgikrBFdeZfUPZfWfYMrr16xnPadNREREREREvKMjbSIiIiIiIgFMRZufmFmymU0xs5VmttzM7vM6U7Aws1AzW2Rmn3udJRiYWZyZfWhmq3zvtwu9zhTozOx+3+/lMjMbb2aRXmcKNGY2zsx2mdmyk5ZVNrPJZrbW972Slxnl7E71cwxUwdRvmlmkmc0zsx98Wf/odaazCaa+1cw2mdlSM1tsZvO9znMmwdIHm1lDX3v+9+ugmZ1yVvhAEEz9tJnd58u53J9tqqLNf3KBB51zjYAOwDAza+xxpmBxH7DS6xBB5B/Al865C4AWqO3OyMySgHspuExJUyAU6O9tqoD0OnDJz5Y9CnzrnEsFvvXdl8D2Or/8OQaqYOo3jwM9nHMtgJbAJWbWweNMZxNsfWt351zLIJjuPSj6YOfcal97tgTaUDDD+ycexzqlYOqnzawpcDvQjoKf/+VmluqPfalo8xPn3Hbn3ELf7UMU/BIneZsq8JlZTeAyYIzXWYKBmVUEugJjAZxzOc65LG9TBYUwIMrMwoDywDaP8wQc59w0YN/PFvel4Lqd+L5fVaKhpMhO83MMSMHUb7oC2b674b6vgJ0kQH2rfwRxH9wTWO+c2+x1kDMIln66ETDHOXfEOZcLTAWu9seOVLSVADOrA7QC5nqbJCi8CDwM5HsdJEjUA3YDr/mGvYwxs2ivQwUy59yPwHPAFmA7cMA597W3qYJGgnNuOxT8gw1U8ziPlFLB0G/6hhsuBnYBk51zAZuV4OtbHfC1mS0ws6FehzmDYO2D+wPjvQ5xOkHWTy8DuppZFTMrT8G1qpP9sSMVbX5mZjHAR8Bw59xBr/MEMjO7HNjlnFvgdZYgEga0BkY651oBh9GQtTPynYfVF6gL1ACizWyQt6lE5L+Cpd90zuX5hprVBNr5hkkFnCDtWzs551oDfSgYJtvV60CnEXR9sJlFAFcCH3id5XSCqZ92zq0EngEmA18CP1Aw1LvYqWjzIzMLp6Djecc597HXeYJAJ+BKM9sETAB6mNnb3kYKeJlA5kmf8H5IQQcip9cL2Oic2+2cOwF8DHT0OFOw2GlmiQC+77s8ziOlTDD2m77hcBkE7rmDQde3Oue2+b7vouC8q3beJjqtYOyD+wALnXM7vQ5yBkHVTzvnxjrnWjvnulIwHH2tP/ajos1PzMwoGOO80jn3gtd5goFz7jHnXE3nXB0KDt1/55wLyE9WAoVzbgew1cwa+hb1BFZ4GCkYbAE6mFl53+9pTwL0xPEANBEY4rs9BPjMwyxSygRTv2lmVc0sznc7ioJ/Mld5m+rUgq1vNbNoM6vw39vARRQMQQs4QdoHDyCAh0b6BFU/bWbVfN9rAdfgp/YN88dGBSj4ZGswsNQ35h3gt865LzzMJKXTPcA7viEPG4CbPc4T0Jxzc83sQ2AhBUMYFgGjvE0VeMxsPJAOxJtZJvAE8DTwvpndSkGner13CaUwTvVzdM6N9TbVaQVTv5kIvGFmoRR8AP6+cy7gp9IPEgnAJwX/qxMGvOuc+9LbSGcUNH2w75yr3sAdXmc5kyDspz8ysyrACWCYc26/P3ZizgXsZEciIiIiIiJlnoZHioiIiIiIBDAVbSIiIiIiIgFMRZuIiIiIiEgAU9EmIiIiIiISwFS0iYiIiIiIBDAVbSIiIiIiIgFMRZuIiIiIiEgAU9EmIiIiIiISwP4/H+EnsNjJXMUAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<Figure size 1080x432 with 2 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "elbow_method.showPlot(boundary = 10)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Since, we don't have any clear elbow yet and also we don't have differences inside the boundary. Now let it for cluster 11-20"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {},
   "outputs": [],
   "source": [
    "elbow_method.run(11, 30)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "metadata": {
    "scrolled": false
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAA24AAAF1CAYAAACQ37kWAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4xLjEsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy8QZhcZAAAgAElEQVR4nOzdd3xW9fn/8deVdYcMCElu9pQpoAxxL0TcC2tdratLbWvV1lqrbb+tttUO99fft45qa1vrwq3Yugg4kY0gG4QwA4FAAmR/fn+cE7gJSbizuNf7+XjkkdznnPuc63MnOedc57PMOYeIiIiIiIhEr6RIByAiIiIiIiJNU+ImIiIiIiIS5ZS4iYiIiIiIRDklbiIiIiIiIlFOiZuIiIiIiEiUU+ImIiIiIiIS5ZS4SdQzs2vM7KOQ187MBkYyprbSlmUxs6/MbEJb7KstmNk4M1sb6ThEJD6Y2aNm9quQ1983s01mVmZmeWZ2vJkt819PjGSsbc3MTjSzJZGOI1S0XXPijZl9YGaXRuC4z5nZLw/2cSU8StwkKvgXgN3+Bbfu65FIxwV7EkdnZvfXWz7RX/73MPdTYGbfbZcgwzv+WDN708y2mVmJmX1pZr83s86RiklEBPa5BpT656dPzOx6M9tzn+Kcu94591t/+1TgfuB051yWc64YuAt4xH/9amRK0j6ccx8654a05L3+Naym3vW1zMx6tHWcjRz/jpBjlteLZWE7HjfJzG7xr3U7zazQT0qGtdcxW8rM/mBmfw1d5pwb75x7vh2O1e6fi5mdaWbL22p/spcSN4km5/kX3LqvGyIdUIgVwKVmlhKy7CpgaYTiaRYzOw4oAD4GhjrncoAzgWpgZCPvSWlouYhIOznPOZcN9AX+ANwGPNnItl2BdCD0xr9vvddhS4Dz3af1rq9Zzrn1B+PAzrm7644JXF8vluHteOhHgeuA7wOdgaHA28DZ7XjMWBD1n0sC/D+2mBI3iVVnm9lKM9tiZn+ueyrrP0n6pZmtNrMiM/uHmXXy1z1tZrf4P/f0a8t+4L8eaGZbzcwaOd5G4AvgDH/7XOA44PXQjczsGP9JcYmZzTOzcf7y3wMnAo80UJs4wW/es83M/l9dDE2VxV9/pb+u2Mx+cYDP60/A35xz9zjnNgE459Y4537tnCvw93eNmX1sZg+Y2VbgN2Y2wG+uUex/1s+YWU5IDF+Z2e3+k7ttZvY3M0uv95nc4se/wcy+dYA4RSTBOee2O+deBy4FrjazEQBm9ncz+52ZDQbqmg2W+OeoFcAhwBv+OTZgZp3M7En/3LPOf2+yv6/9znf+8m+b2SL/fPZfM+tbF5d/zbi+ofO1v/57/ntL/XPiGH95DzN7ycw2m9kqM7sx5D1HmdlMM9thXrPPfVp2hGy3T9Nz/9z7UzObb2bbzez5+ufecJnZz81sRUjcF9Zb32C5fKNaG4OZ/dHM/uz/3MHMKszsLv91R/Nq6bL81xf5MZSY2XtmNqiRfY4AvgNc7Jyb6pyrdM7tdM497Zy7198m18z+HfJ7+VnI9fd6M3vfzB72j7XCQpqF+p/JV/5nstLMLg5Zd52ZLTHvnuItM+sZsm6k//e6zcw2+tfHicBP8P7Wy8zsc3/bz8zsCjPL9JcPDNlPT/NqqDv7ry/0fw8lZvahNVJ7Fs7nUm/7683svZDX6f7/QS//9QVmttj/HArN7EYzywNeAQ6xvTWreWaWbGa/sr33bnvuJ8xsqJlV+59rITDZL/dz/udYYmbTTS2ElLhJzLoQGAuMAS4Avu0vv8b/OgXvIp4F1CVJU4Fx/s8nAyv97wAnAR8651wTx/wHXi0bwGXAa0BF3Ur/5PwW8DsgF/gp8JKZBZ1zvwA+BG5ooDbxXOBIvJqvS/CTw6bK4p+U/wJcCfQA8oBeDQVtZpnAscBLTZStztF4n0sX4PeAAff4xzgU6I1/gxPim37MA4DBQGjb+G5AJ6An3sXi/+nEKyLhcM59DqzFe+gVunwpUFdTk+M3KRsArGFvy40K4Gm8VgUDgdHA6UBoc/V9znf+DfQdwNeAIN45+9l6YTV4vvZv3H+Dd43oCJwPFJv3UPENYB7eefBU4GYzqzvPPwQ85JzriHcOfaEZH9EleC0n+gOH410vWmIF3mfcCbgT+JeZdW+qXG0cQ+i1+Vi833ndtfkEYJ5zrsxPOv4O/ADvdzYVeN0arp2ZACx3zs1r4riPAql+7Kfh1UB9I2T9ScBMvOvrI8BfAfxr2J+BU/0a4hOBBf66y4CbgfPwaoXnAP8Ked97wMt418bBwDS/We/9wNP+3+5RoUE653biPSS+PGTxZcB/nXPbzOwY4P+Ab/mx/hN4tRWfS3M8BVzlfw6j8O6jivHu0VaG1KwWA7fi/Q+egHe/UgU8ELKvZLz/ySF493XfBVLw/m/ygRuAyjaKO2YpcZNo8qr/VKXu63tNbPtH59xW59wa4EH2ntC+CdzvnFvpnCsDbgcu809gU4ET/QvpSXi1UMf77zvZX9+UV4Bx5tV6XYWXyIW6ApjsnJvsnKt1zr2Ld9I/UPODPzjnSvyyTME7+R2oLF8H3nTOTfNvUH4F1Day/854/+sb6xaY2Z/8z3in7dsJeb1z7n+dc9XOud3OueXOuXedcxXOuc14F5eT6+3/EedcoXNuK16yF3pxqQLucs5VOecmA2V4J2URkXCsx3sQ1ixm1hU4C7jZr1EowrtJvCx036HnO7zmY/c45xY556qBu/FqlPqGvKex8/V3gT8552Y4z3Ln3Gq8JC/onLvLr91YCTwREkcVMNDM8p1zZc65z5pRzIedc+v9c+8bIbE05Jh619cVdSuccy/6+6n1+1QtA+qSh8bK1ZIYGvMRcLiZdcS7Nv8FGOzX3oVemy8HXnHOFTjnKvF+P/l4D3HrywM2NHZAMwsAFwG3+Z/7crx7iStDNlvinPuHc64G7yFAXwtpcQKMMLN059w659wif9l1wO+cc0udc1V4ifAJ/t/jRLyk6RH/mrrDOTcjzM/o3+x7bf2Gv6zumI8452Y552qcc48DAeCIBvbT5OfSAtXAcDPLds4VO+fmNLHtdcDP/b+XcrzP5tK6Wk7f/zjndvn/j1V4D1AG+P+jM/wkNqEpcZNoMtE5lxPy9UQT2xaG/Lwar0YI//vqeutSgK7OuRV4icMovCdkbwLrzWwIYSRu/onkLbwapXzn3Mf1NukLXBx6ccR7stS9qf0SklABu/Bq1posi79uz2fgn8xCn4KG2oaX1HUP2f5nzuvn9oq/zzqhnytm1sVvqrDOzHbgPTnMr7f/xn4XAMX+DVBD5RMROZCewNYWvK8vXm3KhpDz8WN4NTV1Cht4z0Mh22/Fa3XQM2Sbxs7XvfFqrhqKo0e968IdeOdx8FoiDAYWm9kMMzu3GWVsLJaGfFbv+jqgboWZXWVmc0PiG8He83xj5WpJDA1yzu3A64pwAl7iNgWYgVf7Enpt3uea6CdU69j391OnmKavvd3w7oHXhCxbTdO/a4As59w2vAerNwIbzez1kGaMfYFHQz7LzXjJTS8O/Fk25b9AV7+p5WBgEF6iXHfMO+r9jQVp2efSXBPxEuA1fhPQhpJo/OSsN14TyLoY5+D9DvL8zWrdvv0un8T73U8ys7Vmdrf5TZ0TmRI3iVW9Q37ug/dUFv9733rrqoFN/uupeLVVac65df7rq/BqpeaGcdx/ALfgNUWorxD4Z72LY6Zz7g/++qaaYTakqbJsIOQzMLMM9p789uEnddPxmv8cSP0Y7/GXHe435bkC70YmVGO/CxGRFjOzI/FuPj860LYNKMRryp4fcj7u6PYdDKP++a4QuK7eObyDc+6TMI83oJHlq+rtM9s5dzaAc26Zc+5yvITyj3g3qZnNLWxL+bWJT+A1Q8vzH+gtYO95vrFytbWpeM0VD8W7Fk8FzsF70Fr3+9/nmujfxPfES97qew+vJvPwRo63Ee+BZp+QZX0a2dd+nHNvOedOxUsm1+DVEoL3eV3TwN/QLJr+LJu8P/Br7ybh1bp9E6/mcXfIMf+n3jEznHMvN7CrA30u9e0EMkJed6sX16fOuXPxHkS8w96mxa7edg7vsx1fL85059yWRt5T4Zz7H+fcULyE/mL2rTFPSErcJFbdamadzaw3cBNQN2Tus8CPzay/eZ2Z7waeD6n1mYp3gZrmvy4AfgR85D+9O5C6i8v/NrDuX8B5ZnaG3wk33bwO5XV9zzbh9VULV1NlmQSca2YnmFka3jDYTf0//wz4tnmd0LsA+HH1P0AM2Xi1lCV+H75bG9jmh2bWy7wBW+5g7+9CRKTZzBuQ4lzgOeBfzrkvmrsP59wGvBvJ+/z9JZk32FL9pt6hHgVuN7PhfhydLGTQiQP4K/BTMzvCPAP9pOhzYIeZ3WbewBvJZjbCT0oxb/CJoHOuFijx9xXOtaitZOLdMG/24/kWXo1bncbK1dam4tU+zvavxQV4I1AudM5t97d5HrjQzE4ybzqIn+PVIM2svzPn3AK8/lcvmDcHXpr/+X/TzG5xXheDV4C7zRsEYwDevcS/DhSoeQODnOM/MK3Au0bW/c4eBX7pt+TBv0+5yF/3Kl7S9H0/no51fwd49wf96zUbrO/feInL5extJgnwOPAj86b8MTPLMrPz/fia9bk0cMy5wGgzG+7v739CPodMM7vMvCauVUBpyOewCeji37vUeRT4g3/fVtei57zGCmtmE8xsmHndW3bgPbg+mP8bUUmJm0STutHA6r5eaWLb14BZeCeVt9g7ZPRTeLVh04BVQDleYlZnKl4yUpe4fYT3NGkaYfDb+L/vt+evv64Qr0PtHXgXwUK8RKfu/+wh4OvmjSb1cBiHa7QszrmFwA/xTt4b8JpDNjrZtXPuI2A83lOrpX4zhf/gXRwbSkLr3Ik3AMx2vM+5oSd4/8a7QVrpf/0ujLKJiNT3hpmV4p07f4HXp7Y1I9FeBaQBX+KdIyfRRDMx59wreLVez5nXNHwBXj+5A3LOvYjXx/ffeDewrwK5fhJyHl7N0SpgC14yVDdC8JnAQjMrw7tGXOb3/2lrx9r+87gd6Zz7ErgP+BTvZvswvGljmixXO8T3IV4SWXctnotXI7bn2uycm4+X3D2Gd409FbigXnP8UNfh1SY+jvf7X4ZXi/dWyHrwmkh+gPd7eSaMWJPx+pxvxEscj2TvtflZvIFMXvb/hubiPezFb2J5Gl7yVYQ3MuoJ/j6fw7sX2WpmjdXwTvOP3Qmv5gx/vx/jNdt8DC/5X4rXB66xWrwDfS57+A9N/oT3+1mMd88Q6tt4n992vP+3q/3l8/AGVFltXtPIXH8/7wEf+P/nn+DdXzSmJ969Xine/+Jkmjd4T1wy1+QgeiIijTOzr4DvOufeO9C2IiIiItJyqnETERERERGJckrcREREREREopyaSoqIiIiIiEQ51biJiIiIiIhEOSVuIiIiIiIiUS4l0gEA5Ofnu379+u23fOfOnWRmHrR5KCMqkcoKiVXeRCorqLzxrK3KOmvWrC3OuWAbhBT1/EmCZwLrnHPnmll/vKG/c4HZwJXOucqm9tHQNTKR/u7qJGKZQeVONIlY7kQsMzRc7gNdH6MicevXrx8zZ+43fyIFBQWMGzfu4AcUAYlUVkis8iZSWUHljWdtVVYzW936aGLGTcAioKP/+o/AA86558zsUbx5qf7S1A4aukYm0t9dnUQsM6jciSYRy52IZYaGy32g66OaSoqIiLQDM+uFN7HtX/3XBozHmwga4GlgYmSiExGRWBMVNW4iIiJx6EHgZ0C2/zoPKHHOVfuv1wI9G3qjmV0LXAvQtWtXCgoK9llfVla237J4l4hlBpU70SRiuROxzNCycitxExERaWNmdi5Q5JybZWbj6hY3sGmDc/I45x4HHgcYO3asq9+cJhGbFiVimUHlTjSJWO5ELDO0rNxK3ERERNre8cD5ZnY2kI7Xx+1BIMfMUvxat17A+gjGKCIiMUR93ERERNqYc+5251wv51w/4DLgA+fcN4EpwNf9za4GXotQiCIiEmOUuImIiBw8twE/MbPleH3enoxwPCIiEiPUVFJERKQdOecKgAL/55XAUZGMR0REYpNq3ERERERERKKcEjcREREREZEop8RNREREREQkyilxExERERERiXJxkbiVVVTznwUb2V1ZE+lQREREosqCdduZ8dXWSIchIiKtFBeJ26zV27j+X7OYvqo40qGIiIhElXvfWcJv3/wy0mGIiEgrxUXidnT/XAIpSUxbuiXSoYiIiESVYFaAzaUVkQ5DRERaKS4St/TUZI7qn8vUpUWRDkVERCSqBLMDbCmroLbWRToUERFphbhI3ABOHhxkxeadrCvZHelQREREokYwO0BVjWP77qpIhyIiIq0QV4kbwLSlmyMciYiISPQIZgcA2Fym5pIiIrEsbhK3gV2y6N4pnalLlLiJiIjUCWb5iZv6uYmIxLS4SdzMjJMHB/l4xRaqa2ojHY6IiEhUqKtxKyotj3AkIiLSGnGTuAGcNDhIaXk1cwtLIh2KiIhIVNjTVFI1biIiMS2uErfjB+STZDBV/dxEREQAyAqkkJ6apMRNRCTGxVXi1ikjldF9OmuAEhEREZ+ZEczWXG4iIrEurhI3gJMGBZm/bjtbd1ZGOhQREZGoEMwKaFRJEZEYF3+J2+B8nIMPl6nWTUREBFCNm4hIHIi7xO3wXjnkZKQybemWSIciIiISFZS4iYjEvrhL3JKTjBMG5vPhss045yIdjoiISMR1yU5n264qKqs1XY6ISKyKu8QNvGkBikorWLyxNNKhiIiIRFzdlADFO1XrJiISq+IycTt5cBDQtAAiIiLgDU4CmstNRCSWxWXi1rVjOkO7ZWtaABERETQJt4hIPIjLxA285pIzv9rGzorqSIciIiISUUrcRERiX9wmbicPDlJZU8tnK4sjHYqIiEhE5WWlAUrcRERiWdwmbmP7daZDarKaS4qISMILpCSTk5FKkRI3EZGYFbeJWyAlmWMOyWXaMs3nJiIiEszSXG4iIrEsbhM38Pq5rdqykzXFuyIdioiISEQFswNsLlPiJiISq+I6cdszLcAyNZcUEZHEFsxWjZuISCyL68Stf34mvTp3UD83ERFJeHVNJZ1zkQ5FRERaIK4TNzPjpMFBPlm+hcrq2kiHIyIiEjHB7AC7q2rYWVkT6VBERKQF4jpxA6+55M7KGmav2RbpUERERCJGc7mJiMS2uE/cjhuQR0qSqbmkiIgktC7Z6YASNxGRWBX3iVt2eipj+nRmmgYoERGRBKYaNxGR2Bb3iRvAyUOCLFi3QxcrERFJWHsTt/IIRyIiIi2REInbSYO8aQE+Wq5aNxERSUw5HVJJSTLN5SYiEqMSInEb3qMjeZlpTFu6JdKhiIiIRERSkpGfpbncRERiVUIkbklJxomD8pm2dDO1tZq/RkREElMwO0CREjcRkZh0wMTNzNLN7HMzm2dmC83sTn/5381slZnN9b9G+cvNzB42s+VmNt/MxrR3IcJx0uAgxTsr+XLDjkiHIiIiEhHBbNW4iYjEqnBq3CqA8c65kcAo4EwzO8Zfd6tzbpT/NddfdhYwyP+6FvhLWwfdEif6/dymaloAERFJUEE1lRQRiVkHTNycp8x/mep/NdXe8ALgH/77PgNyzKx760NtnWB2gOE9OipxExGRhBXMDlC8s5IadRsQEYk5YfVxM7NkM5sLFAHvOuem+6t+7zeHfMDMAv6ynkBhyNvX+ssi7qTBQWav3kZpeVWkQxERETnogtkBamod23ZVRjoUERFpppRwNnLO1QCjzCwHeMXMRgC3AxuBNOBx4DbgLsAa2kX9BWZ2LV5TSrp27UpBQcF+byorK2tweUt13FlDda3jidemMqZrWEU/aNq6rNEukcqbSGUFlTeeJVJZ41XoJNz5WYEDbC0iItGkWdmLc67EzAqAM51z9/qLK8zsb8BP/ddrgd4hb+sFrG9gX4/jJXyMHTvWjRs3br/jFRQU0NDyljquupZH5r1DcVpXxo07rM322xbauqzRLpHKm0hlBZU3niVSWeNVaOJ2aMQ7MYiISHOEM6pk0K9pw8w6ABOAxXX91szMgInAAv8trwNX+aNLHgNsd85taJfomyktJYljB+QzbdlmnFP7fhERSSzBrL2Jm4iIxJZwaty6A0+bWTJeoveCc+5NM/vAzIJ4TSPnAtf7208GzgaWA7uAb7V92C138uB83lu0ia+Kd9E/PzPS4YiIiBw0e2rcypS4iYjEmgMmbs65+cDoBpaPb2R7B/yw9aG1j5MHdwEWMnVJEf3z+0c6HBERkYMmM5BCZlqyatxERGJQWKNKxpM+eRn0y8tg2rItkQ5FRETkoNMk3CIisSnhEjfwpgX4dEUxFdU1kQ5FRETkoFLiJiISmxIycTttWFd2V9Xwz09XRzoUERGRgyqYHVAfNxGRGJSQidsJA/M5dWgX7ntnKYVbd0U6HBERkYMmmBWgaEd5pMMQEZFmSsjEzcy4a+IIzOBXry3Q1AAiIpIwgtkBdpRXU16l7gIiIrEkIRM3gJ45Hbjl9CEULNnMm/OjYpo5ERGRdlc3JcAWNZcUEYkpCZu4AVxzXD8O79WJO99YyPZdVZEOR0RE4oSZpZvZ52Y2z8wWmtmd/vL+ZjbdzJaZ2fNmlnawY9szl5sGKBERiSkJnbglJxl3X3gY23ZV8Yf/LIp0OCIiEj8qgPHOuZHAKOBMMzsG+CPwgHNuELAN+M7BDiyYlQ4ocRMRiTUJnbgBjOjZie+c0J9nPy9k+sriSIcjIiJxwHnK/Jep/pcDxgOT/OVPAxMPdmx7atzUVFJEJKYkfOIGcPOEQfTq3IHbX/lCc7uJiEibMLNkM5sLFAHvAiuAEudctb/JWqDnwY4rL8trnakaNxGR2JIS6QCiQUZaCr+bOIJr/jaDvxSs4OYJgyMdkoiIxDjnXA0wysxygFeAQxvarKH3mtm1wLUAXbt2paCgYJ/1ZWVl+y1rjuxUmLdkFQUp61u8j4OttWWOVSp3YknEcidimaFl5Vbi5hs3pAsXjOrB/01ZwbmHd2dgl+xIhyQiInHAOVdiZgXAMUCOmaX4tW69gAYzJ+fc48DjAGPHjnXjxo3bZ31BQQH1lzVHz7nTSM3OYNy4sS3ex8HW2jLHKpU7sSRiuROxzNCycqupZIhfnTuMDmnJ3PHyAmprNbebiIi0jJkF/Zo2zKwDMAFYBEwBvu5vdjXwWiTiC2YH1MdNRCTGKHELkZ8V4BdnH8rnX23lhZmFkQ5HRERiV3dgipnNB2YA7zrn3gRuA35iZsuBPODJSAQXzAqoj5uISIxRU8l6Lh7bi5fnrOXuyYsYf2gXumSnRzokERGJMc65+cDoBpavBI46+BHtK5jtJW7OOcws0uGIiEgYVONWj5nx+wsPo7yqlrve+DLS4YiIiLS5YHaAiupaSiuqD7yxiIhEBSVuDRgQzOKG8QN5c/4GpiwuinQ4IiIibapuLreiHWouKSISK5S4NeL6kwcwqEsWv3x1ATv1RFJEROJIMMufhFv93EREYoYSt0akpSRx99cOY13Jbh54d2mkwxEREWkzdTVuGllSRCR2KHFrwpH9cvnG0X146uNVLFi3PdLhiIiItIk9iZtq3EREYoYStwO47cyh5GUF+PnL86mqqY10OCIiIq3WqUMqqcmmxE1EJIYocTuATh1S+e0Fw1mwbgf3q8mkiIjEATPTXG4iIjFGiVsYzhzRncuP6sNfClYwdenmSIcjIiLSasHsgPq4iYjEECVuYfr1ecMY0jWbnzw/l007yiMdjoiISKvUTcItIiKxQYlbmNJTk/l/3xzNrsoabn5uLjW1LtIhiYiItFgwO12Jm4hIDFHi1gwDu2Rz1wXD+XRlMY98sDzS4YiIiLRYMDvA1p0VehApIhIjlLg109eP6MXXRvfkofeX8umK4kiHIyIi0iLB7AC1Dop3qtZNRCQWKHFrJjPjtxNH0C8vk5uem0OxOnaLiEgMCmZpLjcRkViixK0FMgMpPPKNMZTsruInL8yjVs1MREQkxtRNwl2kxE1EJCYocWuhYT068j/nDmPq0s08/uHKSIcjIiLSLF2yVeMmIhJLlLi1wjeP7sM5h3Xnz/9dwqzV2yIdjoiISNjy1VRSRCSmKHFrBTPjnosOo0dOOjc+O4ftu6oiHZKIiEhYOqQlkx1IUeImIhIjlLi1Usf0VB65fAxFpeXcOmkezqm/m4iIxIZgdoDNGmRLRCQmKHFrAyN753DbmUN558tNPP3JV5EOR0REJCz52QHVuImIxAglbm3kOyf059ShXbh78mK+WLs90uGIiIgcUDA7wBYlbiIiMUGJWxsxM+69eCR5WWnc8OxsSsvV301ERKJbMEs1biIisUKJWxvqnJnGw5ePZu223fzilQWRDkdERKRJwewApRXV7K6siXQoIiJyAErc2tiR/XK56dRBvD5vPR8t2xLpcERERBpVN5fbFg1QIiIS9ZS4tYPrTj6EnjkduOftRdTWapRJERGJTkE/cStSc0kRkainxK0dBFKS+ekZg1m4fgevz1sf6XBEREQaVJe4qZ+biEj0U+LWTi4Y2ZNh3Tty7ztLqKhW3wEREYk+exI3NZUUEYl6StzaSVKScfvZQ1m7bTf//HR1pMMRERHZT15mgCSDzTvKIx2KiIgcgBK3dnTioCAnDsrnkSnL2b5b0wOIiEh0SU4ycjMDqnETEYkBStza2W1nDqVkVxWPTl0R6VBERET2E8zWXG4iIrFAiVs7G9GzExNH9eCpj1axYfvuSIcjIiKyDyVuIiKxQYnbQXDL6UNwDu5/Z2mkQxEREdlHMEuJm4hILFDidhD0zs3gqmP78tLstSzZWBrpcERERPYIZnt93JzTvKMiItHsgImbmaWb2edmNs/MFprZnf7y/mY23cyWmdnzZpbmLw/4r5f76/u1bxFiww9PGUhmIIU//mdxpEMRERHZI5gdoKrGaRAtEZEoF06NWwUw3jk3EhgFnGlmxwB/BB5wzg0CtgHf8bf/DrDNOTcQeMDfLuF1zkzjB+MG8sHiIj5bWRzpcERERABNwi0iEisOmLg5T5n/Mkygim0AACAASURBVNX/csB4YJK//Glgov/zBf5r/PWnmpm1WcQx7FvH96N7p3TueXuxmqSIiEhUCGYpcRMRiQVh9XEzs2QzmwsUAe8CK4AS51y1v8laoKf/c0+gEMBfvx3Ia8ugY1V6ajI/Pm0w8wpLmPzFxkiHIyIisrfGTXO5iYhEtZRwNnLO1QCjzCwHeAU4tKHN/O8N1a7tV71kZtcC1wJ07dqVgoKC/d5UVlbW4PJYlu8cvbKMO1+dQ2DLYlKSvI8rHsvalEQqbyKVFVTeeJZIZU0kXTqqxk1EJBaElbjVcc6VmFkBcAyQY2Ypfq1aL2C9v9laoDew1sxSgE7A1gb29TjwOMDYsWPduHHj9jteQUEBDS2Pdda9iG/9fQbr0vtz9XH9gPgta2MSqbyJVFZQeeNZIpU1kWQHUgikJClxExGJcuGMKhn0a9owsw7ABGARMAX4ur/Z1cBr/s+v+6/x13/g1KFrH+OGBDnmkFwefn8ZpeUaxUtERCLHzAhmByhS4iYiEtXC6ePWHZhiZvOBGcC7zrk3gduAn5jZcrw+bE/62z8J5PnLfwL8vO3Djm1mxu1nHUrxzkqemLYy0uGIiEiCC2ZrEm4RkWh3wKaSzrn5wOgGlq8EjmpgeTlwcZtEF8dG9s7hnMO788SHq7jimL6RDkdERBJYMCvA6uJdkQ5DRESaENaoktI+fnbGEKpra3nw/WWRDkVERBJYMDugUSVFRKKcErcI6puXyTeP7svzMwpZX1Yb6XBERCRBBbMDbN1ZSVWNrkUiItFKiVuE/Wj8QDqkJvPMogq26GmniIhEQN1cbsVllRGOREREGqPELcLysgL89PTBfFlcy/F/+IBfvvoFq4t3RjosERFJIMEszeUmIhLtmjWPm7SPa47vT9q2VcyvyOeFGWv59/Q1nHVYd6476RAO75UT6fBERCTO1dW4bS4rx5t+VUREoo0StyjRIyuJb5x7OD85bTBPffwVz3y2mrfmb+C4AXlcd/IAThqUj5lFOkwREYlDexI31biJiEQtNZWMMl06pvPzs4byye3juePsoazYXMbVT33O2Q9/xGtz11GtjuMiItLG8tVUUkQk6ilxi1LZ6alce9IAPvzZeP709cOpqqnlpufmcvKfC/jbx6vYVVkd6RBFRCROpKcm0zE9RYmbiEgUU+IW5dJSkrhkbG/eufkk/nrVWLp3SufON77ktPun8dUWDWIiIiJto0vHdM3lJiISxZS4xYikJGPCsK5M+v5xPPu9Y9hVWc0lj33K8qLSSIcmIiJxIJgVUI2biEgUU+IWg44dkMdz1x5LrYNLH/uML9fviHRIIiIS44LZAYqUuImIRC0lbjFqSLdsXrjuGNJSkrjs8U+ZW1gS6ZBERCSGBbNV4yYiEs2UuMWwQ4JZvHDdsXTKSOWKv07n81VbIx2SiIgAZtbbzKaY2SIzW2hmN/nLc83sXTNb5n/vHOlY6wSzA+yqrGFnhQa/EhGJRkrcYlzv3AxevO44unQMcNVT0/lo2ZZIhyQiIlAN3OKcOxQ4BvihmQ0Dfg6875wbBLzvv44KQU0JICIS1ZS4xYFundJ5/tpj6ZeXybefnsH7izZFOiQRkYTmnNvgnJvt/1wKLAJ6AhcAT/ubPQ1MjEyE+9szCbdGlhQRiUopkQ5A2kYwO8Cz3zuGq//2Odf9cxYPXz6asw/rHumwREQSnpn1A0YD04GuzrkN4CV3ZtalkfdcC1wL0LVrVwoKCvZZX1ZWtt+y1iosrQWg4LPZ7Pwq+m4P2qPMsUDlTiyJWO5ELDO0rNzRd2aWFuucmca/vns03/rbDG7492zuu2QkF47uFemwREQSlpllAS8BNzvndphZWO9zzj0OPA4wduxYN27cuH3WFxQUUH9Za20pq+BXH79Hlz4DGXdcvzbdd1tojzLHApU7sSRiuROxzNCycqupZJzpmJ7KP759FMccksdPXpjHv6eviXRIIiIJycxS8ZK2Z5xzL/uLN5lZd399d6AoUvHV1zkjjeQkOyh93N77chP//Gx1ux9HRCSeKHGLQ5mBFJ665kjGDQ5yxytf8NRHqyIdkohIQjGvau1JYJFz7v6QVa8DV/s/Xw28drBja0xykpGXmdbuiVttrePXry/kwXeXtutxRETijRK3OJWemsxjV47lzOHduOvNL3nwvaXU1rpIhyUikiiOB64ExpvZXP/rbOAPwGlmtgw4zX8dNYLZgXYfnOSTFcWsK9lN8c5KyjT1gIhI2NTHLY6lpSTxyDdG87OX5vPge8uYvaaE+y8ZSb4/5LOIiLQP59xHQGMd2k49mLE0x8GYhPv5mYV7fl5dvJPhPTq16/FEROKFatziXEpyEvddPJLfXziC6SuLOeuhD/lkueZ6ExGR/XVp58StZFcl/124kbF9vXnH1xTvardjiYjEGyVuCcDM+ObRfXnthuPpmJ7CN5+czn3vLKG6pjbSoYmISBQJZgfYUlbRbk3rX5u7nsrqWn56xhAAVm9V4iYiEi4lbglkaLeOvPGjE7hoTC/+94PlfOOJ6WzYvjvSYYmISJQIZgWornVs21XZLvt/fkYhw3t05JhD8sjNTGO1atxERMKmxC3BZKSlcO/FI3ng0pEsWL+dsx76kPe+3BTpsEREJAoEs9MB2mWAkgXrtvPlhh1cemRvAPrkZrC6eGebH0dEJF4pcUtQF47uxZs/OoEenTrw3X/M5K43vqSyWk0nRUQSWTDbG7yqPfq5vTCzkLSUJC4Y2ROAvnkZqnETEWkGJW4J7JBgFi//4DiuPrYvT328iov+8omefoqIJLD2StzKq2p4dc46zhzejU4ZqQD0zc1gw/bdemgoIhImJW4JLj01mTsvGMGjVxzB6uKdnPPwR7w+b32kwxIRkQhor8Ttvws3sqO8mkvG9t6zrG9eJrUO1m5TrZuISDiUuAkAZ47oxuSbTmRw1yxufHYOf/rP4kiHJCIiB1lmWjIdUpPbPHF7YWYhvTp34LgBeXuW9c3LADSypIhIuJS4yR69Omfw/HXHctmRvfm/ghUatEREJMGYmTcJdxsOTlK4dRcfLy/m4iN6k5S0d07yPn7iprncRETCo8RN9pGanMSdFwxneI+O3DppHpt2lEc6JBEROYiCbTwJ94uz1mIGXx/ba9/jZAXISEvWACUiImFS4ib7CaQk8/DloymvquUnL8xtt4lYRUQk+gSz2i5xq6l1TJpZyAkD8+mZ02GfdWZGn9wM1mzVoFgiIuFQ4iYNGhDM4tfnDePj5cU8/uHKSIcjIiIHSVs2lfx4+RbWby/fZ1CSUN5cbqpxExEJhxI3adSlR/bm7MO6ce9/lzB/bUmkwxERkYMgmB2gZFcVFdU1rd7X8zMLyclI5fThXRtc3zcvgzVbd6llh4hIGJS4SaPMjHsuPJwu2QFufHYOZRXVkQ5JRETaWRd/SoDFG0pbtZ9tOyt5d+EmJo7qSSAlucFt+uRlUlFdy6ZS9acWETkQJW7SpE4ZqTx42WjWbN3Fb15fGOlwRESknZ16aFfyswLc9Nwctu+qavF+Xp27jsqa2kabSYI3CTeg5pIiImFQ4iYHdFT/XG44ZSCTZq3V5NwiInEumB3g0SvGsK5kNzc+N4eaFjRjdM7x/IxCDuvZiWE9Oja6XV9NCSAiEjYlbhKWG08dxJg+Ofzi5S8o1GSpIiJxbWy/XO48fwRTl27m3neWNPv9C9btYPHGUi6pNwVAfT1yOpCcZKzWyJIiIgekxE3CkpKcxEOXjQbg5ufnUl1TG+GIRESkPX3j6D584+g+/KVgBW80s7XFCzMLCaQkcf6onk1ul5qcRK/OHdRUUkQkDErcJGy9czP43YUjmLV6Gw9/sDzS4YiISDv7zXnDGdu3M7dOmseX63eE9Z7yqhpenbuOM0d0o1OH1ANu783lpsRNRORAlLhJs1wwqicXjenFIx8s4/NVWyMdjoiItKO0lCT+74ox5HRI49p/zmTrzsoDvuc/CzZSWl7NpU0MShKqb57mchMRCYcSN2m2Oy8YTp/cDG5u5YhjIiIS/bpkp/PYlUdQVFrBDf+efcCm8i/MLKR3bgeOOSQvrP33zc1k++4qXU9ERA5AiZs0W1YghYcuG01RaQW3vzIf5zRxqohIPBvZO4ffTxzBJyuKuXvy4ka3W1O8i09WFHPxEb1JSrKw9t3HH1lSA5SIiDRNiZu0yMjeOdxy+hAmf7GRF2YWRjocERFpZxeP7c01x/XjqY9X8dKstQ1uM2lWIWbw9SOaHk0yVN2UAGouKSLSNCVu0mLXnXQIxw3I4zevf8mKzWWRDkdERNrZL845lGMPyeP2V75g/tqSfdbV1DpenLWWEwcF6ZHTIex99tkzCbdq3EREmqLETVosKcl44NJRpKcm8c0npu93ERcRkfiSmpzEI98YTTArwHX/nMXm0oo96z5avoUN28vDHpSkTkZaCsHsgGrcREQOQImbtErXjun867tHk5xkXPzop7w6Z12kQxIRkXaUlxXgsSuPYNuuSn7wzCwqq73BSl6YUUjnjFQmDOvS7H32zc1gdQxOCVC0ozzSIYhIAjlg4mZmvc1sipktMrOFZnaTv/w3ZrbOzOb6X2eHvOd2M1tuZkvM7Iz2LIBE3vAenXj9huMZ2TuHm5+fyz2TF1FTqwFLRETi1YienfjjRYcz46tt3PXmQrburOSdLzcycXRPAinJzd5fn7wM1sRYjduMr7Zy1N3v88mKLZEORUQSREoY21QDtzjnZptZNjDLzN711z3gnLs3dGMzGwZcBgwHegDvmdlg51xNWwYu0SUvK8C/vnM0d76xkMemrWTJplIeumx0WJOviohI7LlgVE++XL+Dx6atZOmmMqpqHJce2bxmknX65WXy8ux1lFfVkJ7a/MQvEv6zYCMAr89dz3ED8iMcjYgkggPWuDnnNjjnZvs/lwKLgJ5NvOUC4DnnXIVzbhWwHDiqLYKV6JaWksTvLzyM300cwUfLtnDh//tYg5aIiMSxn505lBMH5fP5qq0c3qsTQ7t1bNF+6kaWLIyh5pJTlhQB8N+FG6k6wNx2IiJtoVl93MysHzAamO4vusHM5pvZU2bW2V/WEwgdH34tTSd6EmeuOKYv//7eMWzfXcXERz5myuKiSIckIiLtIDnJ+N/LR3Py4CA/njC4xfvZO7JkbCRuq4t3snLzTo49JI9tu6qYvnJrpEMSkQQQTlNJAMwsC3gJuNk5t8PM/gL8FnD+9/uAbwMNzbi5X4cnM7sWuBaga9euFBQU7PemsrKyBpfHo3gs6+1jk3l4djXf/vsMvj44lbP7p2Lm/XnEY3kbk0hlBZU3niVSWSV8ORlpPP3t1jWs6ZuXCRAzA5TUPZD89fnD+Nr/fcLkBRs4YZCaS4pI+worcTOzVLyk7Rnn3MsAzrlNIeufAN70X64FQhu59wLW19+nc+5x4HGAsWPHunHjxu133IKCAhpaHo/itaxnn1rNrZPm8+L8DVR0CPLHiw6nQ1py3Ja3IYlUVlB541kilVUOrs4ZqWQHUlgTI3O5TVmymUPyMxnarSPjh3bhvws28tsLRpCc1NCzaxGRthHOqJIGPAkscs7dH7K8e8hmFwIL/J9fBy4zs4CZ9QcGAZ+3XcgSSzLSUnjk8tHcesYQ3pi/nosf+4T1JbsjHZaIiEQRM6NPXmxMCbCrsppPVxYzbog37cHZh3WneGcl01cVRzgyEYl34fRxOx64Ehhfb+j/P5nZF2Y2HzgF+DGAc24h8ALwJfAf4IcaUTKxmRk/PGUgT1w5lq+27OL8Rz5iyVb9SYiIyF598zJioo/bpyuKqayuZfxQL3EbNyRIemoSb3+xMcKRiUi8C2dUyY+cc+acO9w5N8r/muycu9I5d5i//Hzn3IaQ9/zeOTfAOTfEOfd2+xZBYsWEYV159YfHkZ2eyh8+L+f+d5ZQrZG4REQE6JObydptu6J+HtAPFheRkZbMkf29Mdky0lIYP7QL/1m4MepjF5HY1qxRJUVaa2CXbN740Qkc1yOFhz9YziWPfRpTwz+LiEj76JuXQVWNi+rm9M45CpZs5viB+ftMNH7WiO5sLq1g1uptEYxOROKdEjc56LICKXzv8AAPXz6aZZvKOPuhD3lt7rpIhyUiIhHU158SYE0UP8xbVlTGupLde5pJ1jllaBcCKUlM/mJDI+8UEWk9JW4SMeeP7MHkm05kSLdsbnpuLj9+fi6l5VWRDktERCKgT170z+X2gT8NwLghwX2WZwVSOHlwkLcXbKBWzSVFpJ0ocZOI6p2bwXPXHsPNEwbx2tx1nP3wh8xeo6YmIiKJpnunDqQlJ7F6a/ROCTBlcRGHdu9I904d9lt3zuHd2bSjgjmFuoaJSPtQ4iYRl5KcxM0TBvPCdcdSWwsXP/opj3ywTJ28RUQSSHKS0Su3A2uitMZt++4qZq7exin1atvqjB/ahbTkJCZrdEkRaSdK3CRqjO2Xy9s3n8jZh3Xn3neWcvkTn7Euijupi4hI2+qbG71TAny0bAs1tY5T6vVvq5OdnspJg/N5+ws1lxSR9qHETaJKx/RUHr5sFPddPJKF67Zz1oPT1NlbRCRB9M3LZM3WXTgXfYnPlCVFdOqQyujeOY1uc9aI7qzfXs68tSUHMTIRSRRK3CTqmBkXHdGLyTedSP9gFj94Zjb3vL0oKi/kIiLSdvrkZlBWUc3WnZWRDmUftbWOgiVFnDQ4SEpy47dOE4Z1JTXZeHtB/DaXnLNmG9f/cxb3TF7EpFlrmVdYws6K6kiHJZIQUiIdgEhj+uZlMun6Y/nN6wt5bOpKqmscvzznUMws0qGJiEg76OuPLPlV8S7ysgIRjmavBeu3s6WskvFDG+7fVqdTh1ROGJjPW/M3cPtZQ+PyevXc54W8u2gTyWZU1tTuWd4zpwODumYxqEsWg7pkM9D/OTs9NYLRisQXJW4S1VKTk/jdxBGkJifx5EerqKl1/Pq8YXF5MRQRSXR1iduarTs5om/nCEez1weLizCDkwY1nbgBnHVYd6Ysmc8X67ZzeK/Gm1XGqjmF2zhpUD5PXDWWNVt3sayojOVFZSzdVMqyTWV8uqKYiuq9CV33TukM696RuyaOoGfO/qNxikj4lLhJ1DMzfn3eMJKTjCc/WkWtc9x5/nAlbyIicaZX5wzMom8utylLNjOyV05YtYCnD+vKHUnG5C82xl3itqO8imVFZZx7eA9SkpM4JJjFIcEszhi+d5uaWkehn9AtK/KSube+2MBjU1dw1wUjIhe8SBxQ4iYxwcz45TmHkpJkPDZtJTW1jt9eMIKkJCVvIiLxIj01mW4d06NqSoAtZRXMX1vCjycMDmv7nIw0jhuYz9sLNnDbmUPi6iHj/MLtOAej+zSekCYnGf3yM+mXn8lpw7oCUF3reH3een55zjDSUjS8gkhL6b9HYoaZ8fOzhvL9cQN4Zvoa7njlCw25LCISZ/rkZrB6a/QkblOXbMY5OGVIw9MANOTsEd1YXbyLhet3tGNkB9+cNdswg5FNjKzZkK+N6UnJriqmLClqp8hEEoMSN4kpZsbPzhjCDacM5LkZhdz20nxN1C0iEkf65WVGVVPJKUuKCGYHGN6jY9jvOX14N5KTjLcXxNd0NrPXbGNgMIuOzRxw5MSB+eRnBXh59tp2ikwkMShxk5hjZtxy+mBuOnUQL85ay62T5il5ExGJE33yMthSVhEVQ8xX19Qybelmxg0ONqtpfm5mGsceksfkLzbGzVQ2zjnmFJY02UyyMSnJSUwc1YMPFhexLcqmehCJJUrcJCaZGT8+bTA/njCYl2ev45YX5lIdMiyxiIjEpr0jS0a+1m32mhJ2lFdzytDwm0nWOeuwbqzaspMlm0rbIbKD76viXZTsqmJMn5aN9vm1Mb2oqnG8MX99G0cmkjiUuElMu2nCIG49Ywivzl3Pj1+Yp+RNRCTG9c3NBKJjZMkpS4pISTJOGJTf7PeePqwbSQaT58dHc8k5a7YBMLqFiduwHh0Z2i2bl2ava8uwRBKKEjeJeT88ZSC3nTmUN+at56bn51Kl5E1EIszMnjKzIjNbELIs18zeNbNl/vfomagsivQJmcst0qYsLmJsv87N7tMFEMwOcFT/XCYv2NgOkTVs2aZSTn9gKl+2w6Aoc9aUkBVIYWCXrBbv46IxvZhXWMLyorI2jEwkcShxk7jw/XEDuOPsobw1fwM3PjuH3ZU1kQ5JRBLb34Ez6y37OfC+c24Q8L7/Wurp1CGVnIxUvmpljdv23VWtGnl4fcluFm8sbdZokvWdc1h3lheVsewgNJesrK7lpufmsnRTGW990fbNEecUbmNk704kt2IangtG9SDJ4JU5GqREpCWUuEncuPakAfzynEN5e8FGRt71Dlf8dTqPT1vB4o074qZzuIjEBufcNGBrvcUXAE/7Pz8NTDyoQcWQvrkZrZrLbXdlDafeV8C3/j6jxU3o64auH9+C/m11zhjeDTOY/EX717rd/+5Svtywg7zMND5aXtym+95VWc2iDaWM7t26SuIuHdM5cVCQV2av03Q+Ii2gCbglrnz3xEM4vFcO7yzcyLRlm7l78mLunryYLtkBThwU5KTB+Zw4KEhuZlqkQxWRxNPVObcBwDm3wcxanhE0x803w9y5B+VQbeXeojLKKqrhX3tHMBxVUgI54Y1oWFZWwSN+c7zC+9Ppl59Jc+uJxm4s5eXKGgZ+1vxRFOt0Ad5cv4PqFx306tSifYRT7h3lVYxbv4NLOqaTmpzEum27qH4+l5RW1I6Fqi6v4pn1OxjyXjbc07rr531llSwvKqX01Y506tB4E9Tm/L7jSSKWO27KPGoUPPhgux5CiZvEnaP653JU/1wANmzfzYdLtzBt2WbeX7yJl2avxQwO69mJkwYFOXFQPmP6diY1WZXPIhI9zOxa4FqArl27UlBQsM/6srKy/ZY1ZuDatWSVlLRxhO2sxlFRVcu2kpI9CVdNTQ0lYZZjQ2ktqUlGdpqxaUc5rrqS3PTwk5haoGR3DZ0CxvZWfnYdkhxF5bVsKi4hkNz89x+o3DUOVm2vJTXZyEmuorzGq8nasKWE7LS2SdyKy7191lTsoqSydU1YkxwkGazfWorLbPza25zfdzxJxHLHS5nL1q5leZjnZWjeebyOEjeJa907deCSI3tzyZG9qal1fLFuO9OWbmba0s38ZeoKHpmynOxACvdeMpIzhneLdLgiEt82mVl3v7atO1DU2IbOuceBxwHGjh3rxo0bt8/6goIC6i9rVLjbRZF3Zhbys0nzKfjpOPrle6NMhlvmwq27OP9PU/jxhMH8aPxAfvDMbP775UaeuHIsE4Z1Dev405Zu5qqnPuepa8YydGh472lM+fZyLrvnfX56+mBuGD+o2e8/ULl//PxcXp+3nknXH0tun85U1dRy2p3v8LUxvfjtxBGtiHyv2/45kyUbSym49ZQ22d9Lk+bz5vz1zPjlBDLSGr4VbdbfeBxJxHLHS5lzgF7N2L4l5VY1gySM5CRjVO8cbjx1EJO+fxyzf3Uaj14xhn75mdz47Bxmra7fHUVEpE29Dlzt/3w18FoEY4lqfXO9kSVXt2Aut0mzvJYVFx3Rk6Qk44FLR3FYz07c+NwcFqzbHtY+piwpIpCSxLGHNH8agPq6dUrniL6d26Wf2xvz1vPKnHX8aPzAPcP0pyYncfQheXy8fEubHMM5x+w1JS2eBqAhXxvTk52VNbyzcFOb7VMkEShxk4TVqUMqZ47ozt+/dSTdO6Xz3adnsnKzhigWkdYzs2eBT4EhZrbWzL4D/AE4zcyWAaf5r6UBdbVsa4qbNyVAba1j0qy1HDcgj16dveSvQ1oyf71qLDkdUvnu0zPZuL38gPuZsriIYwfk0SGtBW0bG3DWiG58uWEHX21puykONmzfzS9e+YJRvXO44ZSB+6w7fmA+K7fsZF3J7lYfZ13JbjaXVjC6T9v1QTqyXy69OnfgpdkaXVKkOZS4ScLLywrw928dhZlxzd9msKWsItIhiUiMc85d7pzr7pxLdc71cs496Zwrds6d6pwb5H9XNX8jumQHSE9NavYk3J+tLGZdyW4uPqL3vvvrmM6T1xxJaXkV33l6Bjsrqhvdx6otO/mqeFerpgGo76zDugMweUHbTMZdW+v46YvzqK51PHDpKFLq9dM+YaBXU9gWtW5z1nh9j8a0YY1bUpLxtdE9+Xj5lrASaRHxKHETwXu6+9erx1JUWs53np7JrsrGL+oiItK+zIw+uRnNbir54qy1ZAdSGuyzfGj3jjzyjTEs2rCDm56bS00jw9FPWex1PWzLxK1nTgdG9c7h7TZqLvnUx6v4eHkxvzp3GP392slQg7tmkZ8VaLPELT01iSHdslu9r1AXjulFrYPX5q5r0/2KxDMlbiK+MX0689Blo5m/toQbn53T4rl/RESk9frkZjZrLrcd5VW8vWAD547s0WgTx1OGduHX5w3nvUWb+MPbixrcZsqSIgYEM+mTl9GiuBtz9mHd+GLddgpb0G8v1OKNO/jTf5cw4dCuXHZk7wa3MTNOGOj1c2vtPKZzCrdxeM+cNh99uX9+JmP65PDS7LWaa1UkTErcREKcMbwbd54/nPcWFfGbNxbqYiIiEiF98zJYvXVn2Ofht+ZvoLyqlovHNj2u29XH9eOa4/rxxIereGb66n3W7ayoZvrKrW1a21bnrBFec8m/TF1BeVVNi/ZRUV3Dzc/NpWN6Kn+86DDMGh/u//iB+Wwpq2TJptIWHavueAvX7WjT/m2hvjamF0s3lbFw/Y522X+8e2XOWv73/WXteozVxTvZUV7VrseQ8ClxE6nnqmP7cd1Jh/Cvz9bw6NSVkQ5HRCQh9c3LoLyqlqLS8PodvzizkAHBTEb3PnCS8atzhzF+aBf+57WFTFu6ec/yj5dvobKmlvFD2z5x652bwdfG9OTf09dw8p+n8M/PVlNZe8ULCgAAIABJREFU3byWHfe9s5TFG0v509cPIy8r0OS2x/v93D5a1vLmkgvX76CyprbdErdzD+9OWnISL89Wc8nmqq11/Ok/S3jw/WVsDvN/pLl2lFdx1kMfMuG+qUwN+T+RyFHiJtKA284cynkje/DH/yxW+3sRkQjoUzclQBjNJZcXlTF7TQmXjO3dZC1UneQk4+HLRzOoSxY/fGY2S/1aqSlLNpMVSGFsv9zWBd+I+y8ZxbPfO4Y+uRn86tUFjL+vgBdmFobVNP+TFVt44sOVXHFMH8aHMbdcj5wOHBLMbFU/t7qBSdpyKoBQORlpnHpoF16bu44qdU9olumrtrJhezk1tY7X561vl2O8NX8DuyprSE1O4uqnPufXry1gd2XLaoulbShxE2lAUpJx78WHc1T/XH764jw+WdE28+GIiEh4+uZ5g26sDmNKgEmz1pKcZFw4pmfY+88KpPDUNUeSnpbMt/42g82lFRQsKeKEgfmkpbTf7dGxA/L4/+3dd3zV1f3H8de5NzskBLIgAwiEPRMCAoksGQ4sAopYWwdabZ2obX9dv65frW2to7bVqnVQq4IDBBUHFSJDNgl7r5AACZuElXV+f5DYCAEybnJv7n0/H488knzv997v5/Al9+STc87nvHPvQKZO7k/L0AB+/N5aRj6zgFnZeZRfpGDK8VMlPPbOGpIiQ/n5td1qfK2M5CiW7TpS65G9Slk5R4mPCCY2PKhOz6+J8akJHD5Z/I2RT7m8D7LyCA1w0jk2jJlZDbOtwozVuSTHNOOLx4YwOT2JqUv2cN1fF7I291iDXK+m7n1jJa8v3uXWGNxFiZvIRQT6OXn5u2m0jQzl3jdWseVA3dcJiIhI7cRHBOMwkHOZYh6lZeXMWJ3L0E7RxITVLsGIiwjmldvTOHzyLBNfXML+42cY1iW6PmHXiDGGIZ2imXV/Oi99ty+Bfg4enpbNNX9ZyKfrD1ywru9/Z63nYOFZnp3Up1Z7y6UnR3GquIysnKN1ijMr5xh9GmiaZKUhnaJpGRqg6ZK1cKakjDnr9zO6Rysm9ktkfd4JttVjLWN19hw+yYrdRxmfGk+Qv5NfXt+NN+++glNnyxj//Ff89YttbinitvNgEZ9tyOfvmTt8soicEjeRS2ge4s/rd/YjyN/Jna8tJ/+E9psREWkMAX4O4iKCLztVcuH2QxQUnr1sUZKL6ZUQwbM3p7C7YmRvaAMUJrkYYwyjurdizkNX8tdbUigpL+f7/17F9X9bxPzNBVhrWbKvlNlr9vHwVR3plVC7JGpA+0gcpm77uRWcOEPesdM1WjNYHwF+Dr7VO465m/I5fkpFMGpi/uYCCs+UMi4lnm/1jsPpMMzIcm3iO2N1HsbAuJT/jmKnJ0fx2ZTBXNuzNU/N3cpNLy5x6abyNTF3Yz4ABwvPMn+L743SKnETuYyEFiG8dkc/jp8u4Y7XVlCo6koiIo2iXWToZfdye29lLi1DA2q07utiru7Rij+O78W9g9s36LTAi3E4DNf3juPzKYN56qbeHD9dwp2vr2DCC1/xr41n6du2BT8Y2qHWr9s82J9eCREsqkPilrW3Yde3VTUhNYHi0nI+XueaDco9wfaCIv7x5Y4GWbv3QXYe0WGBDOoQRXRYIFd2jGJW1sWn2taWtZYZWbmkd4iidfPgbzzWPMSf525J4S+T+rCjoIhrn1vI28tzGq0K99yN+XRpFUZMWCDTluc0yjU9iRI3kRroEd+c57/Tl635hdz35motohYRaQRtIkPIucQat2Onipm7MZ+xfeLqvS5tYr9Efnpt13q9Rn35OR1M6JvAvMeG8vtxPdl//Nwsj2cm9sGvjvuoZSRHsSb3eK1Luq/OOUqA00GP+PA6Xbc2esSH0zGmGTNWN8xarcY2Z91+xv5tEX/4ZDNzXJyMHjtVzPzNB78eaYNzo2L7jp9h6a7DLrnGyj1H2XvkNOMvsWZ0bJ94PntkMCltIvjpjHXcPXVlg1W3rHSw8Cyrco4yunsrbkpLYP6WAg4c962ZUErcRGpoSKdonhjXk4XbDvHj99a67C9bIiJSvbYtQzh6quSiSces7H0Ul5VzU9/qN6JuqvydDr59RRsyfzSUPw0Oqddm4OnJUZSVW5btPFKr52XlHKNbXDiBfjVfU1dXxhjGpyawcs/RGhWj8VSlZeX8fs4m7ntzNZ1ahdEuMoRXF+926TXmrDtAcVk5N/T5b1I1qlsrmgX6MdNF6wTfX5VLSICT0d1bXfK81s2DeWPyFfxyTDcWbj/E6GcX8PmGAy6JoTrzNudjLYzqHsvEtETKLby3am+DXc8TKXETqYWJ/RJ5bGQnZmbl8YdPN7s7HBERr9a2ImHJucg6t3dX7aV7XDjd4hp+VMgdAv2chAVcfnuDS0ltG0Gwv7NW69xKy8pZm3uswfZvq84NKXEYQ5MtUnKw8CzfeWUZLy3YyW0D2zL9noFMzkhizd5jrK5jcZjqfJCdR4fo0G+MhAYHOLm6Rys+WX+g3uX6z5SU8fHa/VzTozWhgX6XPd/hMEzOSOLjBzNoFR7EPW+s4vGPN9YrhouZuzGf+IhgurUOp21kKIM6RDJ95V6f+kO6EjeRWnpgeDK3DWzLSwt28vICbdAtItJQ2rSs3BLgwsRt0/4TrM87wU1961aUxFcE+jnpn9SyVuvcNh8o5ExJeaOsb6vUunkw6R2imJGV22jrpVxl1Z6jjPnrQrL3HuPpib357dgeBPg5mJCaQFiQH68uck3p+tyjp1i+6wjjUuIv2K9wfEo8RWdLmbspv17XmLsxn8KzpUyoxdYaAB1jw/jg/nQmpCbwz0W72HfsdL3iON+p4lIWbjvEyG6xX7f95n6J7D1ymiU7XTNFtClQ4iZSS8YYfnV9d67t2YrH52xqsP1TRER8XeUUwd3VTJ97d2UuAU4HY/vU7hdMX5SRHMX2gqIarwf6ujBJA1eUPN/41Hj2HjnNyj01G6EqLStn+a4jPPHJJh6Zns2p4tIGjvCbrLX8a8luJr20hEA/JzN+kM741P/+ISE00I9J/RL5ZP0B9h+vfyJTudF2df/nB7SPpHXzIGbWc53g+6tziWsexID2kbV+boCfg4ev6oi150YGXWnB1kOcLS1nZLf/FiEa3b0VzYP9mbbCd6ZLKnETqQOnw/D0xD4MaN+SH727lswtBe4OSUTE6zQL9COqWcAFUyWLS8v5IDuPEd1iaBEa4Kbomo705Cig5tsCZO05SnRYIAktgi9/sguN7t6KkADnJYuUHD9VwqzsPB6elkXf3/2HiS8u4ZWFu5iZlcfjH29qtFhPF5fx6Dtr+OWsDVzZMZoPH8iodsrubQPbYa3ljSV76nU9ay0fZOWR1rYFiS0vXPPocBjG9olnwbZDdS4SUlB4hgVbDzIuNR6Ho25TdNtEhtC/XUtmrM5z6cjp3I35hAf50T+p5dfHgvydjEuJ57P1Bzh6sthl1/JkStxE6ijI38lLt6XRMTaM+95cTXbFXyhFRMR12rQMYc+Rb464zdtcwJGTxV5XlKShdGkVRmRoQM0Tt73HSEmMuGA6XkMLDfTj6h6t+GjtforLzv3Sb61le0ERLy3Ywc0vLiH1d3N5eFo2C7cdYkTXWJ6/NZXVvxzJ3RlJvLksh3mb6zdVsCb2HD7JuOcX80F2Ho+O7MQ/b0ujeYh/tecmtgxhVLdWvLU8p17rzzbtL2RrfhFjUy4+wjw+NZ6ycsuHFSNztTU7ex/lFsal1G/68fjUeLYXFLEu73i9XqdSaVk58zbnM7xLDP7nVVed1D+R4rJyl+9j56mUuInUQ3iQP1Pv7EdkswAmv76CHQeL3B2SiIhXaRsZesGI23ur9hJTsX+VXJ7DYRiUHMWi7YcuOwpy9GQxuw6dbNT1bVVNSE2g8EwpH+4o4TcfbmDonzMZ8fSX/H7OZo6fLuH7Q9rz/g8GseLnI3hqYm+u7dma8CB/fji6M11ahfHj99ZxuKjhytJ/sSmfMX9dxP7jZ3jtjn48dFXHy45O3ZnejmOnSuo1ffCD7Dz8HIYxPVtf9JxOsWF0jwtnZh2TmPdW5dI7MYLkmGZ1DROAa3u1JsDP4bJCM6v2HOXoqRJGdruwymWXVuH0SYxg+orG20vOnZS4idRTTHgQ/5p8BQa47ZXl5J/wrT1FREQaUpuWIew/cYaSispxBYVnmL/lIONTE+q8t5kvykiOpKDwLNsLLv0HxuyvN95u3PVtlSrXan24s4Q3l+XQPiqU/7uhB4t/MpxPpwzmR6O70Ldti6/3MKsU5O/kmZv7cOJ0CT+Zsc7lv8SXlVue/nwLd01dSZuWIXz0YAZDO8fU6Ln9k1rSPS6c1xbvqlNcZeWW2dn7GNo5+rJTg8elxLMu7zjbCwprdY2N+06w+UAhN9ayKEl1woP8GdUtltlr9lFcWv99bz/fmE+A08GQztHVPj6pXyJb84u+XpvpzfSOJ+ICSVGhvHZnP46eKub2V5dz/HTtNjoVEZHqtYsKwVo4eOrcL7wfZOVRVm65KU3VJGujcp3b5apLZuUcxekw9Epo3hhhXcDpMPzz9jSmpAaS/cuRvHZnf747oC3xEZdfb9e1dTg/HN2JuRvzeWel6wpWlJSVc9+bq3hu3nZu7JvA+z8YVO06s4sxxnBnehJb84tYvL32FRCX7TzMgRNnuOES0yQrfatPHI46bKswY3Uu/k7DmF5xtY6vOuNT4zlyspgvtx6s1+tYa5m7MZ9ByZE0u8j2BGN6xxES4GT6cu8vUqLETcRFeiVE8I/v9GV7QRHf+9dKzpTUby8VERH575YABafKsdby7spcUttE0CG6ftO5fE1CixDaRYZcdp3b6pxjdGkVRkjA5ffwaijd45rTJ8avTjHcndGeAe1b8psPN7pkM+/SsnKmTMvmsw35/OK6rjx5Yy+C/Gu/Kfn1vVsT1SyAVxfXfmuAD7LzaBbox4iusZc9NyYsiCs7RjMre1+N9zcrLSvng+x9DO/iumI/V3aMJqpZwCULzdTE1vwico6c+kY1yfM1C/Tj+l5xfLh2H0VnG7eyaGNT4ibiQoM7RfPUxN4s33WEKdOyKfOhTSFFRBpC5SbcB09Z1uQeZ1tBETelqShJXaQnR7F05xFKyqqfvlZWbsne27gbb7uaw2F4amIfnA7DI9OzKb1IW2uivNzy4/fX8vG6/fzs2i7cfWX7OhdsCfRzcusVbZm3uYBdh2qeUJ4pKeOTdQe4ukerGieM41PjyTt2mmW7jtTo/IXbDnGo6CwTUl03iu3vdPCt3vF8samAY6fqXvHx8w0HAC6btN7cP5FTxWV8VMfCLE2FEjcRFxvbJ57/HdONTzcc4H9nrfeJxbIiIg0lMjSA0AAnBafLeXflXoL8HYzpdfECDXJxGclRFJ0tZW1u9WuBdhwsouhsKSmJ7ilM4irxEcH87oYerM45xguZO+r0GtZafjFrPTNW5/HIiE7cM7hDveO6dUAb/J2G12sx6jZvcwGFZ0u5oRb7FY7q1orQAGeN95l9f3UuLUL8a7xmr6bGp8ZTXFbOR2v31/k15m7Kp09iBLHhQZc8LyUxgk6xzXjby/d0u2ziZoxJNMbMN8ZsMsZsMMY8XHG8pTFmrjFmW8XnFhXHjTHmOWPMdmPMWmNMakM3QsTT3JWRxL1D2vPWshxm7dB6NxGRujLG0CYylNzCcmav2cc1PVoTFlR96XW5tIEdIjEGFm2rfp1VVs65ja+b8ohbpbF94rm+dxx/+WLbRRPVi7HW8n8fbeKtZTl8f0gHHroq2SUxxYQFcX3vON5blcuJMzX73WBmVh4xYYEM7FDzDbGDA5xc3aM1n6w7cNllG8dPl/D5xny+1TuOAD/Xjud0jwunc2xYnadLHjh+hrW5xy85TbKSMYab+7Vhzd5jbNp/ok7XawpqcodKgcestV2BAcD9xphuwE+AL6y1HYEvKr4HuAboWPFxD/CCy6MWaQJ+cnUXJqQm8MH2Er7/xir2Hjl1+SeJiMgF2rYMYdORcgrPlHJTXxUlqauIkAB6xje/6Dq3rJxjRIT4kxQV2siRNYzfje1BdFggU6Zn12oPtac+38qri3dxx6B2/M/VnV26n93k9CROFpfxTg1Gho6dKiZzSwHf6h13QRXNyxmfGk/h2VLmbrz0vnZz1u2nuLScCQ3wc2WMYXxqPKtzjtVqemiluZvOxT6qBokbnKuoGeB0MN2LR90um7hZa/dba1dXfF0IbALigbHA1IrTpgI3VHw9FviXPWcpEGGM0ZwG8TnGGP44oSfjO/rz5daDjHj6S/7yn20qWiIiUkuV69wSWgQzoH3NRx7kQunJUazOOVptEYesHPdsvN1Qmof48+eberPz4El+P2dTjZ7zt3nb+Nv87dzSP5FfXd/N5f8WPeKb069dC17/avdl18F/vG4/JWW2RtUkzzegfSStwoMuu6fbjNW5JMc0o2d8w1QRvSElHoeBmXUYdft8wwGSokJrvK9cy9AARvdoxcysvEb9Xet0cRmfrj/Awm31q6BZE7Uq12OMaQekAMuAWGvtfjiX3BljKifGxgNVU93cimPfmOBqjLmHcyNyxMbGkpmZecH1ioqKqj3ujXypreBb7R0eW0x6XAjTtxTzzH+28sbibXy7SwApMU6v6Ryr8qV7C77VXl9qq3iWNhWJ24TUhMtudiyXlpEcxQuZO1i+6zDDu/x3JOPEmRK2FhRynZetH0xPjuKujCReWbSL4V1jGHaJdVz/XLiTP3++lXEp8fzuhp4N1kdPTk/iB2+u5j+b8hnd/cJNpSvNytpHckwzuseF1/oaTodhbEoc/1y4i0NFZ4lqFnjBOXsOn2TF7qP82MWjilXFhgeRnhzFjKw8pozoVOOf3xNnSli68zB3pifVKrZJ/RL5cM0+PttwgLG1WBdYW0VnS5m/uYBP1u9n/uaDnC4pY0TXGK7sWP1ec65S48TNGNMMeB+YYq09cYl/xOoeuOBPCtbal4CXANLS0uzQoUMveFJmZibVHfdGvtRW8K32ZmZmMmboUCZcA19tP8SvP9zAc1lFDO4Uza+u7+Z1Ja196d6Cb7XXl9oqnmVA+0jahTuY1F/VJOurb9sWBPo5WLTtm4nb2r3HsdY71red70ejO7No2yF+/N5aPpsymJbVlLz/99I9/O7jTVzToxVP3tir1lMTa2Nkt1jiI4J5ddGuiyZue4+cYvnuI/xodN2TqvEpCbz45U4+XLOPO9OTLnh8xuo8jDk3xbAhTUhNYMr0bFbsPsIVNRwx/3LLQUrKbI3Wt1U1sH0kiS2Dmb5ir8sTt+OnS/jPxnw+WX+ABdsOUlxaTlSzQManxnNtz9ZckdTSpderTo1WIRpj/DmXtL1prZ1RcTi/cgpkxeeCiuO5QNV31gTAu2tzitTQoOQoPn7oSv53TDey9hzl6mcX8MQnm7x+3xERkfroEN2MXw8KpnXzy2/CLJcW5O+kX7uWF6xzy8o5ijHQO9H7ErcgfyfP3NyH46dK+OmMtRdUe35vVS6/+GA9w7vE8JdJKfg5G7boup/Twe2D2rJs1xE27Dte7TmzK8raf6t33TfE7twqjG6tw6udLmmtZUZWLukdohr852pU91hCA5y12hR87sZ8IkMDSG1TuwqnDofh5rREvtpx2CX7+B05Wcy05Tnc/upy0n43l8feXcOGfcf5dv82vHPvQJb97CoeH9eT9OSoBv9/AzWrKmmAV4BN1tqnqzw0G7i94uvbgVlVjt9WUV1yAHC8ckqliJzb2+SujCTm/XAoN/SJ58Uvd3LVU5nMys7T1gEiItLg0pOj2JJfSEHhma+PZe09RnJ0M8K9tGJnt7hwHhvVic825PPuqv+ut/po7T5+/N4aMpKjeP7WVJdXVryYm9PaEOzv5LXFuy94zFrLzKw8+rVrQWLLkHpdZ3xqPGtzj7O9oOgbx1fsPsreI6cZn9qwo20AIQF+XNOzNR+v21+jtWfFpeXM31zAVV1j6jTyeWPfRByGOhcpKS4t581le/j2y0vp9/h/+MmMdew8VMSd6UnMvG8Qi/9nOL/+Vnf6J7Vs0JHZ6tTkf2c68F1guDEmu+LjWuAPwEhjzDZgZMX3AHOAncB24GXgPteHLdL0RYcF8uRNvZlx3yBiw4N4eFo2N7+01KvL2IqIiPtlJEcB8NX2c9sCWGvJyjnqldMkq7r7yvZckdSS38zeQM7hU8zdmM+Uadn0bduCl27rW+MNrl2heYg/E/rGMzt7H4eKzn7jsQ37TrC9oKhORUnO963eceeKg5y3p9uM1bmEBDgvucbOlcanxlN0tpTPL1PlEmDZrsMUni1lZLe6xdaqeRDDOsfw7qrcWm/Anr33GGP+upCfz1zPgRNn+P6Q9nz0YAYLfjSMn13blZQ2Ldy6zrYmVSUXWWuNtbaXtbZPxccca+1ha+1V1tqOFZ+PVJxvrbX3W2s7WGt7WmtXNnwzRJqu1DYt+OC+dP4wvifb8gu57rmFPPHJJlWfFBGRBtEtLpyIEH8WVUyX3H34FEdPldR6WlpT43QYnprYG4cx3DV1Bfe/uZruceG8ekc/QgJqVa/PJe4YlERxWTlvLs35xvFZ2Xn4Ow3X9ax/oZiY8CAyOkbzQdY+yiuqWJ4pKePjtfu5pkdrQgMbp90DkiKJax5Uoz3d5m7MJ8jf8fUfGOri5n6JHCw8y/wtNav0eLq4jMc/3sj45xdz4nQpr9yexhePDuFHo7vQI765xxSTa5zxYBG5JIfDMKl/G+b/cCg390vkxS93cs1fFrJ0Z/WbpIqIiNSV02EY1CGSxdsPfT3aBpDi5YkbQEKLEH57Q3e2FRTRIaYZUyf3d9uG7skxzRjSKZp/L9tDcem5kaFya5mVvY+hnWOICLmwiEpdjE+JJ+/YaZbvPgLA5xvzKTxbyoRGmCZZyeEwjEuNZ8HWg9+Yons+ay1zN+YzuGM0wQF1HwEd1iWG6LBApq/Iuey5S3Yc5uq/LODlhbuY1L8Nnz86mKu6xnpMslaVEjcRDxIREsAT43vx1t1XUFZumfTSUn4+cx2FZ0rcHZqIiHiRjORo9h8/w85DJ8nKOUazQL8a75fV1N3QJ56pk/vz9veucFlyVFeTM5I4WHiWj9edK0ay+Ug5BYVnucGFFRFHdY8lJMDJzIriIDNW5xLXPKjR90Qcl5JAuYXZ2RevWbg+7wT7j5+pdTXJ8/k7HdzYN4F5mws4cLz6RLHwTAk/m7mOW15eCsBb37uC34/r6dHrPJW4iXigQclRfDZlMN+7Mom3l+cw6pkFzNt8+XnhIiIiNVE5DW3x9kNk7T1K78TmjV5owV2MMQzpFO32pA1gcMcoOkSH8uqi3Vhr+WpfKWGBflzV9eL7zdVWSIAfV/doxZx1+9l75BQLth5kXGp8o6/VSo5pRu/ECN6/RHXJuRsP4DBwVdf6JW4AN6clUm7h/WqmZ87fXMCoZxYwbXkOd2ck8enDgxnUoe5TMxuLEjcRDxUc4OTn13Vjxn3phAf5M/n1lTz0dhaHz1vELCIiUlttIkNIbBnM3I35bNpfSEqi90+T9ETGGO5MT2Jd3nEWbz/MygOlXN2jlcsLpYxPSaDwbClTpmdTbs+NfrnDhNR4Nu0/wcZ91Rdi+3xjPmltW1a7115ttYsKZWD7SKatyPl6fd+Rk8VMmZbFna+vICzIj/d/MIhfjOlWr2mZjUmJm4iH65MYwYcPZvDIiE58sn4/I57+UlsHiIhIvWUkR7Fw2yHKyi2pbb27oqQnG58aT3iQH4+8k82ZsobZEHtgh0hiwwNZtecovRMj3DYtdkyvOPyd5oIql3Bu0/HNBwoZ1b3+o22VJvVPZO+R03y14zAfrd3HyKe/5KO1+3noqo58+GBGk1vXqcRNpAkI8HPw8IiOfPzQlbSLCuXhadncNXUl+46ddndoIiLSRKVXqdrXRyNubhMS4Mct/dtwsPAsEYGGKxpg7ZnTYb5eN3djIxYlOV/L0ACGdY7hg+x9F5Tqr9wqoL7r26oa3b0VzYP9uf+t1TzwVhZxEcF8+GAGj47sRKBf0xhlq0qJm0gT0ik2jPe+P4hfjunGkh2HGfXMAl5fvItTxaXuDk1ERJqYyjU97SJDXDI1TerutkHt8HcaBsX5Ndhaw9sHtWNCagJjG2BErzbGp8ZzsPAsi3d8s3L23I0H6BTbjLaRoS67VpC/k0n9EzlTUsZPr+nCzPsG0bV1uMtev7E1/qYVIlIvTodhckYSI7vF8tMZ6/j1hxv58+dbua5na25MSyCtbQuPLGErIiKepWVoAEM6RdO5VZi7Q/F58RHBfDplMDvWrmiwa8RFBPPUxN4N9vo1NaxLDM2D/ZmxOpchnaIBOHqymBW7j/L9Ie1dfr0fj+7Cg8M70qyR9qxrSE2/BSI+KrFlCG/c1Z/lu47w3qpcPly7j+kr95IUFcqNfRMYlxJPXESwu8MUEREPNnVyf3eHIBU6RDdjr9P7//Aa6Ofk+t6teW9V7tfbHc3bXEBZuWVUt1Yuv57TYbwiaQNNlRRp0ow5Nxf+yZt6s+LnI3jyxl7EhAXy5GdbSP/jPL77yjJmr9nHmZIyd4cqIiIiAsD41ATOlJTzyfoDAMzdmE9seCA945u7OTLP5h3pp4gQGujHTWmJ3JSWyJ7DJ3l/VS7vr87jobezCA/y4/recdyUlkjvhOaaSikiIiJuk5IYQVJUKDNW5zK5g2XBtoOMS2n8veWaGiVuIl6obWQoj47qzJQRnViy8zDvrtzLe6tyeXNZDl1bh/PTa7owuGJeuYiIiEhjMsYwPiWep+ZuJTkwgFPFZYzq7vppkt5GUyVFvJjDYUhPjuLZSSms+MUInhjfk5NnS7nt1eXc9foKdh4scneIIiIi4oNuqKhu+e7WYpoF+jGgfUs3R+T5lLiJ+IjwIH9u6d+GuY8O5ifXdGHZriOMfnYBv/toI8dPl7gDAk5jAAAVv0lEQVQ7PBEREfEhiS1DuCKpJWfLYEjn6Ca5r1pjU+Im4mMC/Zx8f0gH5v1wCONTEnhl8S6G/TmTN5ftoazcujs8ERER8RETUhMAGOXCTbe9mRI3ER8VExbEH2/sxYcPZJAc3Yyfz1zPdc8t5Ksdh9wdmoiIiPiAcanxfK9nANf1bO3uUJoEJW4iPq5HfHOm3zuAv387lcIzpXz75WXc+8ZKcg6fcndoIiIi4sX8nQ7S4/3xcyolqQn9K4kIxhiu69WaLx4bwg9HdWLhtkOMePpL/vDJZorOlro7PBERERGfp8RNRL4W5O/kgeEdmf/DoYzp3Zp/fLmDEU99qemTIiIiIm6mxE1ELhAbHsTTE/sw875BhAQ6ufWfy/jTp5spKSt3d2giIiIiPkmJm4hcVEqbFnz0YAYT+ybyfOYObvzHEvYcPunusERERER8jhI3EbmkkAA//nhjL/7+7VR2HSziuucWMTMr191hiYiIiPgUJW4iUiPX9WrNJ1MG07V1GI9MX8Mj07MpPKONu0VqyxhztTFmizFmuzHmJ+6OR0REmgYlbiJSY/ERwbz9vQFMGdGRWdl5XPfcIrJyjro7LJEmwxjjBP4OXAN0A24xxnRzb1QiItIUKHETkVrxczqYMqIT79w7kLJyy03/WMLf52+nrNy6OzSRpqA/sN1au9NaWwxMA8a6OSYREWkC/NwdgIg0TWntWjLn4Sv52cx1PPnZFhZtO8QzN/dxd1gini4e2Fvl+1zgivNPMsbcA9wDEBsbS2Zm5jceLyoquuCYt/PFNoPa7Wt8sd2+2GaoW7uVuIlInTUP9udvt6QwpGM0v5q9gav/soAJ7Q0pp0poHuLv7vBEPJGp5tgFw9XW2peAlwDS0tLs0KFDv/F4ZmYm5x/zdr7YZlC7fY0vttsX2wx1a7cSNxGpF2MME/sl0rddCx6elsUr60/w+sa5pLaJYGjnGIZ1jqFr6zCMqe73VRGfkwskVvk+AdjnplhERKQJUeImIi7RIboZs+7P4NVZ8zgRmsD8LQU8+dkWnvxsC7HhgQzrHMPQztGkJ0cRFqTROPFZK4COxpgkIA+YBHzbvSGJiEhToMRNRFzG6TB0bOFk6NDOPDaqMwUnzpC59SCZWwr4eO1+pq3Yi5/D0K9dS4Z1iWZY5xiSY5ppNE58hrW21BjzAPAZ4ARetdZucHNYIiLSBChxE5EGExMexMS0RCamJVJSVs7qPUeZv+VcIvf7OZv5/ZzN9G3bgudvTSU2PMjd4Yo0CmvtHGCOu+MQEZGmRYmbiDQKf6eDK9pHckX7SH5yTRf2HTvN5xsO8KfPtvCtvy3ixe+m0Scxwt1hioiIiHgk7eMmIm4RFxHMHelJzLhvEAF+Dia+uIQZq3PdHZaIiIiIR1LiJiJu1aVVOLPuz6BvmxY8+s4aHv94I6Vl5e4OS0RERMSjKHETEbdrGRrAv+7qz+0D2/Lywl3c+foKjp8qcXdYIiIiIh5DiZuIeAR/p4PfjO3BH8b3ZOnOw9zw/GK2FxS6OywRERERj6DETUQ8yqT+bXjrewMoPFPCuL9/xbzN+e4OSURERMTtlLiJiMfp164lsx7IoG1UCHdNXcnzmdux1ro7LBERERG3UeImIh4pPiKYd+8dxJhecfzp0y08PC2b08Vl7g5LRERExC20j5uIeKzgACfPTepDl1Zh/PnzLew8VMRzk1JoH93M3aGJiIiINColbiLi0Ywx3D8smS6twnh4WjbDn/qSzrFhDO8aw1VdYkhp0wKnw7g7TBEREZEGpcRNRJqEq7rG8vkjg5mzbj9fbCrg5QU7eSFzBy1C/BnaOYbhXWIY3Cma5sH+7g5VRERExOWUuIlIkxEXEczdV7bn7ivbc/x0CQu3HWTe5gIytxxkZlYeToehX7sWXNUlluFdY2gfFYoxGo0TERGRpk+Jm4g0Sc2D/RnTK44xveIoK7dk7z3GvM35fLGpgMfnbOLxOZtoFxnC9wa359v92yiBExERkSZNiZuINHlOh6Fv2xb0bduCH43uQt6x08zbXMDs7Dx+PnM9a/Ye4/9u6EGgn9PdoYqIiIjUibYDEBGvEx8RzHcHtGX6PQN5aHgy76zMZdJLS8k/ccbdoYmIiIjUiRI3EfFaDofh0VGdeeHWVLYcKOT6vy4iK+eou8MSERERqbXLJm7GmFeNMQXGmPVVjv3aGJNnjMmu+Li2ymM/NcZsN8ZsMcaMbqjARURq6pqerZlx3yAC/R3c/OJS3lm5190hiYiIiNRKTUbcXgeurub4M9baPhUfcwCMMd2ASUD3iuc8b4zRohIRcbsurcKZfX8G/ZJa8OP31vLr2RsoKSt3d1giIiIiNXLZxM1auwA4UsPXGwtMs9aetdbuArYD/esRn4iIy7QIDWDqnf25KyOJ17/azW2vLOfIyWJ3hyUiIiJyWfWpKvmAMeY2YCXwmLX2KBAPLK1yTm7FsQsYY+4B7gGIjY0lMzPzgnOKioqqPe6NfKmt4Fvt9aW2QtNo75XNwNEzgNc2HGbkk//hodRA2obXbXJAU2ivq/hSW0VERDxNXRO3F4D/A2zF56eAyUB1GyXZ6l7AWvsS8BJAWlqaHTp06AXnZGZmUt1xb+RLbQXfaq8vtRWaTnuHAmP2HuPeN1bxxIpinryxN9f3jqv16zSV9rqCL7VVRETE09SpqqS1Nt9aW2atLQde5r/TIXOBxCqnJgD76heiiEjD6J0YwewH0+kR15wH387ij59upqy82r81iYiIiLhVnRI3Y0zrKt+OAyorTs4GJhljAo0xSUBHYHn9QhQRaTgxYUG89b0B3NK/DS9k7uDWfy5l75FT7g5LRERE5Btqsh3A28ASoLMxJtcYcxfwJ2PMOmPMWmAY8AiAtXYD8A6wEfgUuN9aW9Zg0YuIuECAn4MnxvfkTzf2Yn3eCa5+dgFvL8/BWo2+iYiIiGe47Bo3a+0t1Rx+5RLnPw48Xp+gRETcYWJaIoM6RPLj99by0xnr+HT9Af44oRetmge5OzQRERHxcXWaKiki4q0SWoTw77uu4Ldju7N81xFGPfMlM7NyNfomIiIibqXETUTkPA6H4baB7fjk4SvpFBvGI9PXcO8bqzhYeNbdoYmIiIiPUuImInIR7aJCmX7vQH52bRcytx5k9LMLmLNuv7vDEhERER+kxE1E5BKcDsM9gzvw8YMZJLQI5r43V/PQ21kcO1Xs7tBERETEhyhxExGpgY6xYcz4wSAeG9mJOev2M/KZBXyxKd/dYYmIiIiPuGxVSREROcfP6eDBqzoyvGsMj72zhrumriQ62NBz9wqSY5qRHNOMjhWfw4L83R2uiIiIeBElbiIitdQ9rjmzH8jg30v38NnKLew7dppF2w9RXFr+9TmtwoPoGNusSkIXRseYZrQIDXBj5CIiItJUKXETEamDAD8HkzOSaF+6h6FDB1NWbtl75BTbCorYVlDI9oIithcUMX3FXk4Vl339vO8OaMsvxnQl0M/pxuhFRESkqVHiJiLiAk6HoV1UKO2iQhnZLfbr4+Xlln3HT7O9oIh5mwv415I9rM07zvO3phIfEezGiEVERKQpUXESEZEG5HAYElqEMLRzDL8d24N/fCeVHQVFjHluIQu2HnR3eCIiItJEKHETEWlEV/dozewH0okND+L215bz3BfbKC+37g5LREREPJwSNxGRRtY+uhkz70tnXJ94np67lclTV3D0pPaFExERkYtT4iYi4gbBAU6emtibx8f14Kvthxnz10WszT3m7rBERETEQylxExFxE2MMt17Rlne/PxCAG19YwlvLcrBWUydFRETkm5S4iYi4We/ECD56MIOBHSL52cx1/PDdtZyusoWAiIiIiBI3EREP0CI0gNfu6McjIzoxIyuXcc8vZvehk+4OS0RERDyEEjcREQ/hcBgeHtGR1+/sz4ETZ7j+r4v4xQfr+GJTvkbgREREfJw24BYR8TBDOkXz0YMZ/H7OJmaszuPfS3MI8HMwsH0kwzpHM6xLDG0jQ90dpoiIiDQiJW4iIh4ooUUIz9/al7OlZazYdZT5WwqYv6WAX3+4kV9/uJH2UaEM6xLDsM4x9EtqQaCf090hi4iISANS4iYi4sEC/ZxkdIwio2MU/zumG7sPnSRzSwHztxzkjaV7eGXRLkICnKQnRzG8SwzX9mxN82B/d4ctIiIiLqbETUSkCWkXFcodUUnckZ7E6eIyvtpx6Nxo3OaDzN2Yz28/3MgNKXF8Z0Bbusc1d3e4IiIi4iJK3EREmqjgACdXdY3lqq6xWGtZl3ecN5fmMDMrj7eX7yW1TQTfGdCWa3u2JshfUylFRESaMlWVFBHxAsYYeiVE8Mcbe7HspyP45ZhuHDtVwqPvrGHgE1/wxCebyDl8yt1hioiISB1pxE1ExMs0D/FnckYSd6a346sdh3ljyR7+uXAXLy3YyZBO0Xx3QFuGdo7B6TDuDlVERERqSImbiIiXMsaQnhxFenIUB46f4e3lOby9PIe7pq4kPiKYb1/Rhu9c0ZbmISpmIiIi4uk0VVJExAe0ah7EIyM7sfgnw3nh1lTaRobw5GdbGPSHc9MoCwrPuDtEERERuQSNuImI+BB/p4Nrerbmmp6t2bT/BC9k7uDlBTt5bfFubuqbwL2DO9AmMsTdYYqIiMh5NOImIuKjurYO57lbUpj32FAmpCbw7spchj2VyZRpWWw5UOju8ERERKQKJW4iIj6uXVQoT4zvycL/Gcbk9HZ8vjGf0c8u4O6pK1mdc9Td4TU5xpibjDEbjDHlxpi08x77qTFmuzFmizFmtLtiFBGRpkdTJUVEBIDY8CB+fl037huazNQlu3lt8W7GP5/PwPaR3D8sGWutu0NsKtYD44EXqx40xnQDJgHdgTjgP8aYTtbassYPUUREmholbiIi8g0tQgOYMqIT37uyPW8vz+HlhTv5zivLSAp30L7XSdpGhro7RI9mrd0E56p6nmcsMM1aexbYZYzZDvQHljRoQFOmQHZ2g16iMfQ5dgwiItwdRqNTu32LL7bba9rcpw88+2yDXkKJm4iIVCs00I+7r2zPdwe2ZcbqPF6dt4HY8CB3h9WUxQNLq3yfW3HsAsaYe4B7AGJjY8nMzPzG40VFRRccu5jk3FyaHTtW+2g9TFlZGce8oB21pXb7Fl9st7e0uSg3l+01fF+G2r2PV1LiJiIilxTo5+SW/m1ofWonQf5Od4fjEYwx/wFaVfPQz621sy72tGqOVTv/1Fr7EvASQFpamh06dOg3Hs/MzOT8YxdV0/M8XK3a7EXUbt/ii+32ljZHAAm1OL8u7VbiJiIiUkvW2hF1eFoukFjl+wRgn2siEhERb6eqkiIiIo1jNjDJGBNojEkCOgLL3RyTiIg0EUrcREREXMgYM84YkwsMBD42xnwGYK3dALwDbAQ+Be5XRUkREakpTZUUERFxIWvtTGDmRR57HHi8cSMSERFvoBE3ERERERERD6fETURERERExMMpcRMREREREfFwStxEREREREQ8nBI3ERERERERD6fETURERERExMMpcRMREREREfFwStxEREREREQ8nBI3ERERERERD2este6OAWPMQWBPNQ9FAYcaORx38aW2gm+115faCmqvN3NVW9taa6Nd8Do+4SJ9pC/9v6vki20GtdvX+GK7fbHNUH27L9k/ekTidjHGmJXW2jR3x9EYfKmt4Fvt9aW2gtrrzXyprZ7OF++FL7YZ1G53x9HYfLHdvthmqFu7NVVSRERERETEwylxExERERER8XCenri95O4AGpEvtRV8q72+1FZQe72ZL7XV0/nivfDFNoPa7Wt8sd2+2GaoQ7s9eo2biIiIiIiIeP6Im4iIiIiIiM/zyMTNGHO1MWaLMWa7MeYn7o6noRljdhtj1hljso0xK90dj6sZY141xhQYY9ZXOdbSGDPXGLOt4nMLd8boKhdp66+NMXkV9zfbGHOtO2N0JWNMojFmvjFmkzFmgzHm4YrjXnd/L9FWr7y/xpggY8xyY8yaivb+puJ4kjFmWcW9nW6MCXB3rL7E1/rHSt7eT1bypf6yKl/rO8G3+s+qfK0vreSqPtXjpkoaY5zAVmAkkAusAG6x1m50a2ANyBizG0iz1nrlHhbGmMFAEfAva22PimN/Ao5Ya/9Q8ctHC2vt/7gzTle4SFt/DRRZa//sztgagjGmNdDaWrvaGBMGrAJuAO7Ay+7vJdo6ES+8v8YYA4Raa4uMMf7AIuBh4FFghrV2mjHmH8Aaa+0L7ozVV/hi/1jJ2/vJSr7UX1bla30n+Fb/WZWv9aWVXNWneuKIW39gu7V2p7W2GJgGjHVzTFIP1toFwJHzDo8FplZ8PZVzP7RN3kXa6rWstfuttasrvi4ENgHxeOH9vURbvZI9p6jiW/+KDwsMB96rOO4V97YJUf/o5Xypv6zK1/pO8K3+sypf60sruapP9cTELR7YW+X7XLz/hlrgc2PMKmPMPe4OppHEWmv3w7kfYiDGzfE0tAeMMWsrpoN41bSHSsaYdkAKsAwvv7/ntRW89P4aY5zGmGygAJgL7ACOWWtLK07xhfdnT+KL/WMlX+wnK3n1++lleOV76/l8qf+sylf60kqu6FM9MXEz1RzzrPmcrpdurU0FrgHur5gyIN7jBaAD0AfYDzzl3nBczxjTDHgfmGKtPeHueBpSNW312vtrrS2z1vYBEjg32tO1utMaNyqf5ov9YyX1k77Ha99bq/Kl/rMqX+pLK7miT/XExC0XSKzyfQKwz02xNApr7b6KzwXATM7dTG+XXzHPuXK+c4Gb42kw1tr8ih/WcuBlvOz+VszVfh9401o7o+KwV97f6trq7fcXwFp7DMgEBgARxhi/ioe8/v3Zw/hc/1jJR/vJSl75fno5vvDe6kv9Z1W+2pdWqk+f6omJ2wqgY0WVlQBgEjDbzTE1GGNMaMXiTIwxocAoYP2ln+UVZgO3V3x9OzDLjbE0qMo34Arj8KL7W7HY9hVgk7X26SoPed39vVhbvfX+GmOijTERFV8HAyM4txZhPnBjxWlecW+bEJ/qHyv5cD9ZyeveT2vCW99bK/lS/1mVr/WllVzVp3pcVUmAihKgzwJO4FVr7eNuDqnBGGPac+6vhwB+wFve1l5jzNvAUCAKyAd+BXwAvAO0AXKAm6y1TX5h8kXaOpRzQ/8W2A3cWzl/vakzxmQAC4F1QHnF4Z9xbr66V93fS7T1Frzw/hpjenFuobSTc3/ke8da+9uK96xpQEsgC/iOtfas+yL1Lb7UP1byhX6yki/1l1X5Wt8JvtV/VuVrfWklV/WpHpm4iYiIiIiIyH954lRJERERERERqUKJm4iIiIiIiIdT4iYiIiIiIuLhlLiJiIiIiIh4OCVuIiIiIiIiHk6Jm4iIiIiIiIdT4iYiIiIiIuLhlLiJiIiIiIh4uP8HNuUZjs4ivmAAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<Figure size 1080x432 with 2 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "elbow_method.showPlot(boundary = 10)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**What happend?**\n",
    "\n",
    "We don't have elbow, but we have boundary in differences graph. If we look at the differences graph, we observe that after the cluster 14, the differences are almost inside the boundary. So, we will run **k-means** for clusters 15 because the 14'th difference is the difference between $k=14$ and $k=15$. Since we have done to analyze the optimal clusters $k$. Now move to fitting the model and making recommendations."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Fitting data on Model"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now let first create the same k-means model and run it to make predictions."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 27,
   "metadata": {},
   "outputs": [],
   "source": [
    "kmeans = KMeans(n_clusters=15, init = 'k-means++', max_iter = 300, n_init = 10, random_state = 0)\n",
    "clusters = kmeans.fit_predict(sparseMatrix)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now, let create a dataframe where we can see each user cluster number"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 28,
   "metadata": {
    "scrolled": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>0</th>\n",
       "      <th>1</th>\n",
       "      <th>2</th>\n",
       "      <th>3</th>\n",
       "      <th>4</th>\n",
       "      <th>5</th>\n",
       "      <th>6</th>\n",
       "      <th>7</th>\n",
       "      <th>8</th>\n",
       "      <th>9</th>\n",
       "      <th>...</th>\n",
       "      <th>90</th>\n",
       "      <th>91</th>\n",
       "      <th>92</th>\n",
       "      <th>93</th>\n",
       "      <th>94</th>\n",
       "      <th>95</th>\n",
       "      <th>96</th>\n",
       "      <th>97</th>\n",
       "      <th>98</th>\n",
       "      <th>99</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <td>userId</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "      <td>8</td>\n",
       "      <td>9</td>\n",
       "      <td>10</td>\n",
       "      <td>11</td>\n",
       "      <td>12</td>\n",
       "      <td>15</td>\n",
       "      <td>16</td>\n",
       "      <td>18</td>\n",
       "      <td>...</td>\n",
       "      <td>134</td>\n",
       "      <td>137</td>\n",
       "      <td>142</td>\n",
       "      <td>146</td>\n",
       "      <td>150</td>\n",
       "      <td>151</td>\n",
       "      <td>153</td>\n",
       "      <td>155</td>\n",
       "      <td>156</td>\n",
       "      <td>157</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>Cluster</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>4</td>\n",
       "      <td>0</td>\n",
       "      <td>14</td>\n",
       "      <td>0</td>\n",
       "      <td>3</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>3</td>\n",
       "      <td>0</td>\n",
       "      <td>5</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>11</td>\n",
       "      <td>7</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>2 rows × 100 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "         0   1   2   3   4   5   6   7   8   9   ...   90   91   92   93   94  \\\n",
       "userId    1   2   8   9  10  11  12  15  16  18  ...  134  137  142  146  150   \n",
       "Cluster   0   0   1   1   4   0  14   0   3   0  ...    0    0    3    0    5   \n",
       "\n",
       "          95   96   97   98   99  \n",
       "userId   151  153  155  156  157  \n",
       "Cluster    0    1   11    7    0  \n",
       "\n",
       "[2 rows x 100 columns]"
      ]
     },
     "execution_count": 28,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "users_cluster = pd.DataFrame(np.concatenate((users.reshape(-1,1), clusters.reshape(-1,1)), axis = 1), columns = ['userId', 'Cluster'])\n",
    "users_cluster.T"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now we'll define a function which will create a list of dataframes where each dataframe will contain the movieId and the counts for that movie (count: the number of users who has that respective movie in their favourite list). So, the movie which will have more counts will be of more interest to other users who has not watched that movie yet.\n",
    "<br>\n",
    "For Example, we'll create a list as following\n",
    "<br>\n",
    "```[dataframe_for_Cluster_1, dataframe_for_Cluster_2, ..., dataframe_for_Cluster_3]```\n",
    "<br>\n",
    "Where each dataframe will be of following format\n",
    "<table class='dataframe'>\n",
    "        <thead>\n",
    "                <td>Index</td>\n",
    "                <td>Movie ID</td>\n",
    "                <td>Count</td>\n",
    "        </thead>\n",
    "        <tr>\n",
    "                <td>0</td>\n",
    "                <td>121</td>\n",
    "                <td>100</td>\n",
    "        </tr>\n",
    "        <tr>\n",
    "                <td>1</td>\n",
    "                <td>8786</td>\n",
    "                <td>95</td>\n",
    "        </tr>\n",
    "        <tr>\n",
    "                <td>&#8942;</td>\n",
    "                <td>&#8942;</td>\n",
    "                <td>&#8942;</td>\n",
    "        </tr>\n",
    "        <tr>\n",
    "                <td>N-1</td>\n",
    "                <td>2374</td>\n",
    "                <td>1</td>\n",
    "        </tr>\n",
    "        <tr>\n",
    "                <td>N</td>\n",
    "                <td>84374</td>\n",
    "                <td>1</td>\n",
    "        </tr>\n",
    "</table>\n",
    "where 3rd column of <b>Count</b> is representing the total number of users in the cluster who have watched that particular movie. So, we will sort movies by their count in order to priortise the movie which have most seen by users in cluster and is more favourite for users in the cluster."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now we want to create a list of all user movies in each cluster. For this, first we'll define a method for creating movies of clusters."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 29,
   "metadata": {},
   "outputs": [],
   "source": [
    "def clustersMovies(users_cluster, users_data):\n",
    "    clusters = list(users_cluster['Cluster'])\n",
    "    each_cluster_movies = list()\n",
    "    for i in range(len(np.unique(clusters))):\n",
    "        users_list = list(users_cluster[users_cluster['Cluster'] == i]['userId'])\n",
    "        users_movies_list = list()\n",
    "        for user in users_list:    \n",
    "            users_movies_list.extend(list(users_data[users_data['userId'] == user]['movieId']))\n",
    "        users_movies_counts = list()\n",
    "        users_movies_counts.extend([[movie, users_movies_list.count(movie)] for movie in np.unique(users_movies_list)])\n",
    "        each_cluster_movies.append(pd.DataFrame(users_movies_counts, columns=['movieId', 'Count']).sort_values(by = ['Count'], ascending = False).reset_index(drop=True))\n",
    "    return each_cluster_movies"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 30,
   "metadata": {},
   "outputs": [],
   "source": [
    "cluster_movies = clustersMovies(users_cluster, users_fav_movies)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now, let take a look at any one dataframe of **cluster_movies**. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 31,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>0</th>\n",
       "      <th>1</th>\n",
       "      <th>2</th>\n",
       "      <th>3</th>\n",
       "      <th>4</th>\n",
       "      <th>5</th>\n",
       "      <th>6</th>\n",
       "      <th>7</th>\n",
       "      <th>8</th>\n",
       "      <th>9</th>\n",
       "      <th>...</th>\n",
       "      <th>21</th>\n",
       "      <th>22</th>\n",
       "      <th>23</th>\n",
       "      <th>24</th>\n",
       "      <th>25</th>\n",
       "      <th>26</th>\n",
       "      <th>27</th>\n",
       "      <th>28</th>\n",
       "      <th>29</th>\n",
       "      <th>30</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <td>movieId</td>\n",
       "      <td>1</td>\n",
       "      <td>150</td>\n",
       "      <td>50</td>\n",
       "      <td>47</td>\n",
       "      <td>111</td>\n",
       "      <td>6</td>\n",
       "      <td>151</td>\n",
       "      <td>70</td>\n",
       "      <td>165</td>\n",
       "      <td>32</td>\n",
       "      <td>...</td>\n",
       "      <td>95</td>\n",
       "      <td>89</td>\n",
       "      <td>2</td>\n",
       "      <td>62</td>\n",
       "      <td>41</td>\n",
       "      <td>39</td>\n",
       "      <td>36</td>\n",
       "      <td>34</td>\n",
       "      <td>22</td>\n",
       "      <td>198</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>Count</td>\n",
       "      <td>19</td>\n",
       "      <td>8</td>\n",
       "      <td>7</td>\n",
       "      <td>5</td>\n",
       "      <td>4</td>\n",
       "      <td>3</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>2 rows × 31 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "         0    1   2   3    4   5    6   7    8   9   ...  21  22  23  24  25  \\\n",
       "movieId   1  150  50  47  111   6  151  70  165  32  ...  95  89   2  62  41   \n",
       "Count    19    8   7   5    4   3    2   2    2   2  ...   1   1   1   1   1   \n",
       "\n",
       "         26  27  28  29   30  \n",
       "movieId  39  36  34  22  198  \n",
       "Count     1   1   1   1    1  \n",
       "\n",
       "[2 rows x 31 columns]"
      ]
     },
     "execution_count": 31,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "cluster_movies[1].T"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We have 30 movies in 1st cluster where movie with ID 1 is favourite by 19 users and at the top priority followed by movie ID 150 which is favourited by 8 users."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now, let see how much users we have in each cluster"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 32,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Users in Cluster 0 ->  35\n",
      "Users in Cluster 1 ->  19\n",
      "Users in Cluster 2 ->  1\n",
      "Users in Cluster 3 ->  5\n",
      "Users in Cluster 4 ->  8\n",
      "Users in Cluster 5 ->  1\n",
      "Users in Cluster 6 ->  12\n",
      "Users in Cluster 7 ->  2\n",
      "Users in Cluster 8 ->  1\n",
      "Users in Cluster 9 ->  1\n",
      "Users in Cluster 10 ->  1\n",
      "Users in Cluster 11 ->  11\n",
      "Users in Cluster 12 ->  1\n",
      "Users in Cluster 13 ->  1\n",
      "Users in Cluster 14 ->  1\n"
     ]
    }
   ],
   "source": [
    "for i in range(15):\n",
    "    len_users = users_cluster[users_cluster['Cluster'] == i].shape[0]\n",
    "    print('Users in Cluster ' + str(i) + ' -> ', len_users)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "As, we can see that there are some clusters which contain only 1 user or 2 or 5. As we don't want such small cluster where we can't recommend enough movies to users. As the user in a cluster of size one will not get any recommendation for movies OR even user in size of cluster 2 will not get enough recommendations. So, we have to fix such small clusters."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Fixing Small Clusters"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Since, there are many clusters which includes less number of users. So we don't want any user in a cluster alone and let say we want at least 6 users in each cluster. So we have to move users from small cluster into a large cluster which contain more relavant movies to user"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "First of all we'll write a function to get user favourite movies list"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 33,
   "metadata": {},
   "outputs": [],
   "source": [
    "def getMoviesOfUser(user_id, users_data):\n",
    "    return list(users_data[users_data['userId'] == user_id]['movieId'])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now, we'll define a function for fixing clusters "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 34,
   "metadata": {},
   "outputs": [],
   "source": [
    "def fixClusters(clusters_movies_dataframes, users_cluster_dataframe, users_data, smallest_cluster_size = 11):\n",
    "    # clusters_movies_dataframes: will be a list which will contain each dataframes of each cluster movies\n",
    "    # users_cluster_dataframe: will be a dataframe which contain users IDs and their cluster no.\n",
    "    # smallest_cluster_size: is a smallest cluster size which we want for a cluster to not remove\n",
    "    each_cluster_movies = clusters_movies_dataframes.copy()\n",
    "    users_cluster = users_cluster_dataframe.copy()\n",
    "    # Let convert dataframe in each_cluster_movies to list with containing only movies IDs\n",
    "    each_cluster_movies_list = [list(df['movieId']) for df in each_cluster_movies]\n",
    "    # First we will prepair a list which containt lists of users in each cluster -> [[Cluster 0 Users], [Cluster 1 Users], ... ,[Cluster N Users]] \n",
    "    usersInClusters = list()\n",
    "    total_clusters = len(each_cluster_movies)\n",
    "    for i in range(total_clusters):\n",
    "        usersInClusters.append(list(users_cluster[users_cluster['Cluster'] == i]['userId']))\n",
    "    uncategorizedUsers = list()\n",
    "    i = 0\n",
    "    # Now we will remove small clusters and put their users into another list named \"uncategorizedUsers\"\n",
    "    # Also when we will remove a cluster, then we have also bring back cluster numbers of users which comes after deleting cluster\n",
    "    # E.g. if we have deleted cluster 4 then their will be users whose clusters will be 5,6,7,..,N. So, we'll bring back those users cluster number to 4,5,6,...,N-1.\n",
    "    for j in range(total_clusters):\n",
    "        if len(usersInClusters[i]) < smallest_cluster_size:\n",
    "            uncategorizedUsers.extend(usersInClusters[i])\n",
    "            usersInClusters.pop(i)\n",
    "            each_cluster_movies.pop(i)\n",
    "            each_cluster_movies_list.pop(i)\n",
    "            users_cluster.loc[users_cluster['Cluster'] > i, 'Cluster'] -= 1\n",
    "            i -= 1\n",
    "        i += 1\n",
    "    for user in uncategorizedUsers:\n",
    "        elemProbability = list()\n",
    "        user_movies = getMoviesOfUser(user, users_data)\n",
    "        if len(user_movies) == 0:\n",
    "            print(user)\n",
    "        user_missed_movies = list()\n",
    "        for movies_list in each_cluster_movies_list:\n",
    "            count = 0\n",
    "            missed_movies = list()\n",
    "            for movie in user_movies:\n",
    "                if movie in movies_list:\n",
    "                    count += 1\n",
    "                else:\n",
    "                    missed_movies.append(movie)\n",
    "            elemProbability.append(count / len(user_movies))\n",
    "            user_missed_movies.append(missed_movies)\n",
    "        user_new_cluster = np.array(elemProbability).argmax()\n",
    "        users_cluster.loc[users_cluster['userId'] == user, 'Cluster'] = user_new_cluster\n",
    "        if len(user_missed_movies[user_new_cluster]) > 0:\n",
    "            each_cluster_movies[user_new_cluster] = each_cluster_movies[user_new_cluster].append([{'movieId': new_movie, 'Count': 1} for new_movie in user_missed_movies[user_new_cluster]], ignore_index = True)\n",
    "    return each_cluster_movies, users_cluster\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 35,
   "metadata": {
    "scrolled": true
   },
   "outputs": [],
   "source": [
    "movies_df_fixed, clusters_fixed = fixClusters(cluster_movies, users_cluster, users_fav_movies, smallest_cluster_size = 6)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now take a look at data which we were had before and data after fixing"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "First we'll print those clusters which contain maximum 5 users"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 36,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Users in Cluster 2 ->  1\n",
      "Users in Cluster 3 ->  5\n",
      "Users in Cluster 5 ->  1\n",
      "Users in Cluster 7 ->  2\n",
      "Users in Cluster 8 ->  1\n",
      "Users in Cluster 9 ->  1\n",
      "Users in Cluster 10 ->  1\n",
      "Users in Cluster 12 ->  1\n",
      "Users in Cluster 13 ->  1\n",
      "Users in Cluster 14 ->  1\n",
      "Total Cluster which we want to remove ->  10\n"
     ]
    }
   ],
   "source": [
    "j = 0\n",
    "for i in range(15):\n",
    "    len_users = users_cluster[users_cluster['Cluster'] == i].shape[0]\n",
    "    if len_users < 6:\n",
    "        print('Users in Cluster ' + str(i) + ' -> ', len_users)\n",
    "        j += 1\n",
    "print('Total Cluster which we want to remove -> ', j)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now look at the users cluster data frame"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 37,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Length of total clusters before fixing is ->  15\n",
      "Max value in users_cluster dataframe column Cluster is ->  14\n",
      "And dataframe is following\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>0</th>\n",
       "      <th>1</th>\n",
       "      <th>2</th>\n",
       "      <th>3</th>\n",
       "      <th>4</th>\n",
       "      <th>5</th>\n",
       "      <th>6</th>\n",
       "      <th>7</th>\n",
       "      <th>8</th>\n",
       "      <th>9</th>\n",
       "      <th>...</th>\n",
       "      <th>90</th>\n",
       "      <th>91</th>\n",
       "      <th>92</th>\n",
       "      <th>93</th>\n",
       "      <th>94</th>\n",
       "      <th>95</th>\n",
       "      <th>96</th>\n",
       "      <th>97</th>\n",
       "      <th>98</th>\n",
       "      <th>99</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <td>userId</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "      <td>8</td>\n",
       "      <td>9</td>\n",
       "      <td>10</td>\n",
       "      <td>11</td>\n",
       "      <td>12</td>\n",
       "      <td>15</td>\n",
       "      <td>16</td>\n",
       "      <td>18</td>\n",
       "      <td>...</td>\n",
       "      <td>134</td>\n",
       "      <td>137</td>\n",
       "      <td>142</td>\n",
       "      <td>146</td>\n",
       "      <td>150</td>\n",
       "      <td>151</td>\n",
       "      <td>153</td>\n",
       "      <td>155</td>\n",
       "      <td>156</td>\n",
       "      <td>157</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>Cluster</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>4</td>\n",
       "      <td>0</td>\n",
       "      <td>14</td>\n",
       "      <td>0</td>\n",
       "      <td>3</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>3</td>\n",
       "      <td>0</td>\n",
       "      <td>5</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>11</td>\n",
       "      <td>7</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>2 rows × 100 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "         0   1   2   3   4   5   6   7   8   9   ...   90   91   92   93   94  \\\n",
       "userId    1   2   8   9  10  11  12  15  16  18  ...  134  137  142  146  150   \n",
       "Cluster   0   0   1   1   4   0  14   0   3   0  ...    0    0    3    0    5   \n",
       "\n",
       "          95   96   97   98   99  \n",
       "userId   151  153  155  156  157  \n",
       "Cluster    0    1   11    7    0  \n",
       "\n",
       "[2 rows x 100 columns]"
      ]
     },
     "execution_count": 37,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "print('Length of total clusters before fixing is -> ', len(cluster_movies))\n",
    "print('Max value in users_cluster dataframe column Cluster is -> ', users_cluster['Cluster'].max())\n",
    "print('And dataframe is following')\n",
    "users_cluster.T"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "So, we want max value in **Cluster** column is 4 starting from index 0, as we'll remove 10 smallest clusters and we'll have 5 remaining clusters"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now, let see what happend after fixing data."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We want to remove all those 10 small clusters and also the users_cluster dataframe shouldn't contain any user clusters which is invalid."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 38,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Length of total clusters after fixing is ->  5\n",
      "Max value in users_cluster dataframe column Cluster is ->  4\n",
      "And fixed dataframe is following\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>0</th>\n",
       "      <th>1</th>\n",
       "      <th>2</th>\n",
       "      <th>3</th>\n",
       "      <th>4</th>\n",
       "      <th>5</th>\n",
       "      <th>6</th>\n",
       "      <th>7</th>\n",
       "      <th>8</th>\n",
       "      <th>9</th>\n",
       "      <th>...</th>\n",
       "      <th>90</th>\n",
       "      <th>91</th>\n",
       "      <th>92</th>\n",
       "      <th>93</th>\n",
       "      <th>94</th>\n",
       "      <th>95</th>\n",
       "      <th>96</th>\n",
       "      <th>97</th>\n",
       "      <th>98</th>\n",
       "      <th>99</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <td>userId</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "      <td>8</td>\n",
       "      <td>9</td>\n",
       "      <td>10</td>\n",
       "      <td>11</td>\n",
       "      <td>12</td>\n",
       "      <td>15</td>\n",
       "      <td>16</td>\n",
       "      <td>18</td>\n",
       "      <td>...</td>\n",
       "      <td>134</td>\n",
       "      <td>137</td>\n",
       "      <td>142</td>\n",
       "      <td>146</td>\n",
       "      <td>150</td>\n",
       "      <td>151</td>\n",
       "      <td>153</td>\n",
       "      <td>155</td>\n",
       "      <td>156</td>\n",
       "      <td>157</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>Cluster</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>3</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>4</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>2 rows × 100 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "         0   1   2   3   4   5   6   7   8   9   ...   90   91   92   93   94  \\\n",
       "userId    1   2   8   9  10  11  12  15  16  18  ...  134  137  142  146  150   \n",
       "Cluster   0   0   1   1   2   0   3   0   1   0  ...    0    0    0    0    0   \n",
       "\n",
       "          95   96   97   98   99  \n",
       "userId   151  153  155  156  157  \n",
       "Cluster    0    1    4    0    0  \n",
       "\n",
       "[2 rows x 100 columns]"
      ]
     },
     "execution_count": 38,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "print('Length of total clusters after fixing is -> ', len(movies_df_fixed))\n",
    "print('Max value in users_cluster dataframe column Cluster is -> ', clusters_fixed['Cluster'].max())\n",
    "print('And fixed dataframe is following')\n",
    "clusters_fixed.T"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now let see what happend when 10 clusters were deleted and how the remaining users clusters were adjusted which were already in large clusters."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Let take a look at anyone 11th cluster user. Since 11th cluster was already containing enough users i.e. 11 users and we were not want to delete that, but as now we only have max 5 cluster and max value of cluster column is 4, so what actually happend to 11 cluster. As there are 7 clusters before cluster no. 11 which were small and removed, so the value 11 now should be bring back to 4."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 39,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Users cluster dataFrame for cluster 11 before fixing:\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>31</th>\n",
       "      <th>36</th>\n",
       "      <th>47</th>\n",
       "      <th>55</th>\n",
       "      <th>56</th>\n",
       "      <th>60</th>\n",
       "      <th>66</th>\n",
       "      <th>80</th>\n",
       "      <th>82</th>\n",
       "      <th>89</th>\n",
       "      <th>97</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <td>userId</td>\n",
       "      <td>52</td>\n",
       "      <td>58</td>\n",
       "      <td>71</td>\n",
       "      <td>82</td>\n",
       "      <td>83</td>\n",
       "      <td>89</td>\n",
       "      <td>99</td>\n",
       "      <td>120</td>\n",
       "      <td>125</td>\n",
       "      <td>133</td>\n",
       "      <td>155</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>Cluster</td>\n",
       "      <td>11</td>\n",
       "      <td>11</td>\n",
       "      <td>11</td>\n",
       "      <td>11</td>\n",
       "      <td>11</td>\n",
       "      <td>11</td>\n",
       "      <td>11</td>\n",
       "      <td>11</td>\n",
       "      <td>11</td>\n",
       "      <td>11</td>\n",
       "      <td>11</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "         31  36  47  55  56  60  66   80   82   89   97\n",
       "userId   52  58  71  82  83  89  99  120  125  133  155\n",
       "Cluster  11  11  11  11  11  11  11   11   11   11   11"
      ]
     },
     "execution_count": 39,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "print('Users cluster dataFrame for cluster 11 before fixing:')\n",
    "users_cluster[users_cluster['Cluster'] == 11].T"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now let look at the cluster 4 after fixing"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 40,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Users cluster dataFrame for cluster 4 after fixing which should be same as 11th cluster before fixing:\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>31</th>\n",
       "      <th>36</th>\n",
       "      <th>47</th>\n",
       "      <th>55</th>\n",
       "      <th>56</th>\n",
       "      <th>60</th>\n",
       "      <th>66</th>\n",
       "      <th>80</th>\n",
       "      <th>82</th>\n",
       "      <th>89</th>\n",
       "      <th>97</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <td>userId</td>\n",
       "      <td>52</td>\n",
       "      <td>58</td>\n",
       "      <td>71</td>\n",
       "      <td>82</td>\n",
       "      <td>83</td>\n",
       "      <td>89</td>\n",
       "      <td>99</td>\n",
       "      <td>120</td>\n",
       "      <td>125</td>\n",
       "      <td>133</td>\n",
       "      <td>155</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>Cluster</td>\n",
       "      <td>4</td>\n",
       "      <td>4</td>\n",
       "      <td>4</td>\n",
       "      <td>4</td>\n",
       "      <td>4</td>\n",
       "      <td>4</td>\n",
       "      <td>4</td>\n",
       "      <td>4</td>\n",
       "      <td>4</td>\n",
       "      <td>4</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "         31  36  47  55  56  60  66   80   82   89   97\n",
       "userId   52  58  71  82  83  89  99  120  125  133  155\n",
       "Cluster   4   4   4   4   4   4   4    4    4    4    4"
      ]
     },
     "execution_count": 40,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "print('Users cluster dataFrame for cluster 4 after fixing which should be same as 11th cluster before fixing:')\n",
    "clusters_fixed[clusters_fixed['Cluster'] == 4].T"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Both dataframe are containing same user IDs, So we don't disturbed any cluster and similiary we do same with list of movies dataframes for each cluster"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now let take a look at list of movies dataframes"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 41,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Size of movies dataframe after fixing ->  5\n"
     ]
    }
   ],
   "source": [
    "print('Size of movies dataframe after fixing -> ', len(movies_df_fixed))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now, lets look at the sizes of clusters"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 42,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Users in Cluster 0 ->  45\n",
      "Users in Cluster 1 ->  21\n",
      "Users in Cluster 2 ->  8\n",
      "Users in Cluster 3 ->  15\n",
      "Users in Cluster 4 ->  11\n"
     ]
    }
   ],
   "source": [
    "for i in range(len(movies_df_fixed)):\n",
    "    len_users = clusters_fixed[clusters_fixed['Cluster'] == i].shape[0]\n",
    "    print('Users in Cluster ' + str(i) + ' -> ', len_users)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Each cluster is now containing enough users so that we can make recommendations for other users. Let take a look at each size of clusters movies list."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 43,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Total movies in Cluster 0 ->  64\n",
      "Total movies in Cluster 1 ->  39\n",
      "Total movies in Cluster 2 ->  15\n",
      "Total movies in Cluster 3 ->  50\n",
      "Total movies in Cluster 4 ->  25\n"
     ]
    }
   ],
   "source": [
    "for i in range(len(movies_df_fixed)):\n",
    "    print('Total movies in Cluster ' + str(i) + ' -> ', movies_df_fixed[i].shape[0])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "As, we have done working with training machine learning model k-means, making predictions of clusters for each user and fixing some issues. Finally, we need to store this training so that we can use it later. For this, we will **Pickle** liabrary to save and load trainings. We have already imported Pickle, now we will use it."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Let me first design object to save and load trainings. We will directly design methods for saving/loading particular files and also we will design general save/load methods"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 44,
   "metadata": {},
   "outputs": [],
   "source": [
    "class saveLoadFiles:\n",
    "    def save(self, filename, data):\n",
    "        try:\n",
    "            file = open('datasets/' + filename + '.pkl', 'wb')\n",
    "            pickle.dump(data, file)\n",
    "        except:\n",
    "            err = 'Error: {0}, {1}'.format(exc_info()[0], exc_info()[1])\n",
    "            print(err)\n",
    "            file.close()\n",
    "            return [False, err]\n",
    "        else:\n",
    "            file.close()\n",
    "            return [True]\n",
    "    def load(self, filename):\n",
    "        try:\n",
    "            file = open('datasets/' + filename + '.pkl', 'rb')\n",
    "        except:\n",
    "            err = 'Error: {0}, {1}'.format(exc_info()[0], exc_info()[1])\n",
    "            print(err)\n",
    "            file.close()\n",
    "            return [False, err]\n",
    "        else:\n",
    "            data = pickle.load(file)\n",
    "            file.close()\n",
    "            return data\n",
    "    def loadClusterMoviesDataset(self):\n",
    "        return self.load('clusters_movies_dataset')\n",
    "    def saveClusterMoviesDataset(self, data):\n",
    "        return self.save('clusters_movies_dataset', data)\n",
    "    def loadUsersClusters(self):\n",
    "        return self.load('users_clusters')\n",
    "    def saveUsersClusters(self, data):\n",
    "        return self.save('users_clusters', data)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In above class, **exc_info** imported from **sys** liabrary for error handling and error writings."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We will use **saveClusterMoviesDataset/loadClusterMoviesDataset** methods to save/load list of clusters movies dataframes and **saveUsersClusters/loadUsersClusters** methods to save/load users clusters dataframes. Now, lets try it. We will run and print responses in order to check if any error comes. If it return True then its mean our files has been saved in proper place."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 45,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[True]\n",
      "[True]\n"
     ]
    }
   ],
   "source": [
    "saveLoadFile = saveLoadFiles()\n",
    "print(saveLoadFile.saveClusterMoviesDataset(movies_df_fixed))\n",
    "print(saveLoadFile.saveUsersClusters(clusters_fixed))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "As reponse is True for both save methods. Our trained data has now saved and we can use it later. Let check it if we can load it."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 46,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Type of Loading list of Movies dataframes of 5 Clusters:  <class 'list'>  and Length is:  5\n",
      "Type of Loading 100 Users clusters Data:  <class 'pandas.core.frame.DataFrame'>  and Shape is:  (100, 2)\n"
     ]
    }
   ],
   "source": [
    "load_movies_list, load_users_clusters = saveLoadFile.loadClusterMoviesDataset(), saveLoadFile.loadUsersClusters()\n",
    "print('Type of Loading list of Movies dataframes of 5 Clusters: ', type(load_movies_list), ' and Length is: ', len(load_movies_list))\n",
    "print('Type of Loading 100 Users clusters Data: ', type(load_users_clusters), ' and Shape is: ', load_users_clusters.shape)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We have successfully saved and loaded our data by using pickle liabrary."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "As we worked for very small dataset. But often movies recommendation systems works with very large datasets and there we'll have enough movies in each cluster to make recommendations. \n",
    "\n",
    "Now, we need to design functions for making recommendations to users."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Recommendations For Users"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now here we'll create an object for recommending most favourited movies in the cluster to the user which user has not watched earlier. And also when any user has added another movie in his favourite list, then we have to update clusters movies datasets also."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 47,
   "metadata": {},
   "outputs": [],
   "source": [
    "class userRequestedFor:\n",
    "    def __init__(self, user_id, users_data):\n",
    "        self.users_data = users_data.copy()\n",
    "        self.user_id = user_id\n",
    "        # Find User Cluster\n",
    "        users_cluster = saveLoadFiles().loadUsersClusters()\n",
    "        self.user_cluster = int(users_cluster[users_cluster['userId'] == self.user_id]['Cluster'])\n",
    "        # Load User Cluster Movies Dataframe\n",
    "        self.movies_list = saveLoadFiles().loadClusterMoviesDataset()\n",
    "        self.cluster_movies = self.movies_list[self.user_cluster] # dataframe\n",
    "        self.cluster_movies_list = list(self.cluster_movies['movieId']) # list\n",
    "    def updatedFavouriteMoviesList(self, new_movie_Id):\n",
    "        if new_movie_Id in self.cluster_movies_list:\n",
    "            self.cluster_movies.loc[self.cluster_movies['movieId'] == new_movie_Id, 'Count'] += 1\n",
    "        else:\n",
    "            self.cluster_movies = self.cluster_movies.append([{'movieId':new_movie_Id, 'Count': 1}], ignore_index=True)\n",
    "        self.cluster_movies.sort_values(by = ['Count'], ascending = False, inplace= True)\n",
    "        self.movies_list[self.user_cluster] = self.cluster_movies\n",
    "        saveLoadFiles().saveClusterMoviesDataset(self.movies_list)\n",
    "\n",
    "    def recommendMostFavouriteMovies(self):\n",
    "        try:\n",
    "            user_movies = getMoviesOfUser(self.user_id, self.users_data)\n",
    "            cluster_movies_list = self.cluster_movies_list.copy()\n",
    "            for user_movie in user_movies:\n",
    "                if user_movie in cluster_movies_list:\n",
    "                    cluster_movies_list.remove(user_movie)\n",
    "            return [True, cluster_movies_list]\n",
    "        except KeyError:\n",
    "            err = \"User history does not exist\"\n",
    "            print(err)\n",
    "            return [False, err]\n",
    "        except:\n",
    "            err = 'Error: {0}, {1}'.format(exc_info()[0], exc_info()[1])\n",
    "            print(err)\n",
    "            return [False, err]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now lets try it to make recommendations and updating favourite list request. For this, first we'll import data for not only IDs but for movies details like title, genre etc."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 48,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Let take a look at movie metadata for all those movies which we were had in our dataset\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>genres</th>\n",
       "      <th>id</th>\n",
       "      <th>original_title</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <td>0</td>\n",
       "      <td>[{'id': 80, 'name': 'Crime'}, {'id': 35, 'name...</td>\n",
       "      <td>5</td>\n",
       "      <td>Four Rooms</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>1</td>\n",
       "      <td>[{'id': 12, 'name': 'Adventure'}, {'id': 28, '...</td>\n",
       "      <td>11</td>\n",
       "      <td>Star Wars</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2</td>\n",
       "      <td>[{'id': 53, 'name': 'Thriller'}, {'id': 80, 'n...</td>\n",
       "      <td>101</td>\n",
       "      <td>Léon</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3</td>\n",
       "      <td>[{'id': 18, 'name': 'Drama'}, {'id': 9648, 'na...</td>\n",
       "      <td>110</td>\n",
       "      <td>Trois couleurs : Rouge</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>4</td>\n",
       "      <td>[{'id': 28, 'name': 'Action'}, {'id': 53, 'nam...</td>\n",
       "      <td>6</td>\n",
       "      <td>Judgment Night</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>58</td>\n",
       "      <td>[{'id': 27, 'name': 'Horror'}, {'id': 53, 'nam...</td>\n",
       "      <td>17</td>\n",
       "      <td>The Dark</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>59</td>\n",
       "      <td>[{'id': 18, 'name': 'Drama'}, {'id': 53, 'name...</td>\n",
       "      <td>186</td>\n",
       "      <td>Lucky Number Slevin</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>60</td>\n",
       "      <td>[{'id': 12, 'name': 'Adventure'}, {'id': 14, '...</td>\n",
       "      <td>58</td>\n",
       "      <td>Pirates of the Caribbean: Dead Man's Chest</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>61</td>\n",
       "      <td>[{'id': 28, 'name': 'Action'}, {'id': 12, 'nam...</td>\n",
       "      <td>82</td>\n",
       "      <td>Miami Vice</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>62</td>\n",
       "      <td>[{'id': 18, 'name': 'Drama'}, {'id': 10749, 'n...</td>\n",
       "      <td>86</td>\n",
       "      <td>Elementarteilchen</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>63 rows × 3 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                                               genres   id  \\\n",
       "0   [{'id': 80, 'name': 'Crime'}, {'id': 35, 'name...    5   \n",
       "1   [{'id': 12, 'name': 'Adventure'}, {'id': 28, '...   11   \n",
       "2   [{'id': 53, 'name': 'Thriller'}, {'id': 80, 'n...  101   \n",
       "3   [{'id': 18, 'name': 'Drama'}, {'id': 9648, 'na...  110   \n",
       "4   [{'id': 28, 'name': 'Action'}, {'id': 53, 'nam...    6   \n",
       "..                                                ...  ...   \n",
       "58  [{'id': 27, 'name': 'Horror'}, {'id': 53, 'nam...   17   \n",
       "59  [{'id': 18, 'name': 'Drama'}, {'id': 53, 'name...  186   \n",
       "60  [{'id': 12, 'name': 'Adventure'}, {'id': 14, '...   58   \n",
       "61  [{'id': 28, 'name': 'Action'}, {'id': 12, 'nam...   82   \n",
       "62  [{'id': 18, 'name': 'Drama'}, {'id': 10749, 'n...   86   \n",
       "\n",
       "                                original_title  \n",
       "0                                   Four Rooms  \n",
       "1                                    Star Wars  \n",
       "2                                         Léon  \n",
       "3                       Trois couleurs : Rouge  \n",
       "4                               Judgment Night  \n",
       "..                                         ...  \n",
       "58                                    The Dark  \n",
       "59                         Lucky Number Slevin  \n",
       "60  Pirates of the Caribbean: Dead Man's Chest  \n",
       "61                                  Miami Vice  \n",
       "62                           Elementarteilchen  \n",
       "\n",
       "[63 rows x 3 columns]"
      ]
     },
     "execution_count": 48,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "movies_metadata = pd.read_csv(\n",
    "    './Prepairing Data/From Data/movies_metadata.csv', \n",
    "    usecols = ['id', 'genres', 'original_title'])\n",
    "\n",
    "movies_metadata = movies_metadata.loc[\n",
    "    movies_metadata['id'].isin(list(map(str, np.unique(users_fav_movies['movieId']))))].reset_index(drop=True)\n",
    "print('Let take a look at movie metadata for all those movies which we were had in our dataset')\n",
    "movies_metadata"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Here is the list of movies which user with ID 12 has added into its favourite movies"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 49,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Movie title:  ['Dancer in the Dark'] , Genres: [Drama , Crime , Music , \b\b]\n",
      "Movie title:  ['The Dark'] , Genres: [Horror , Thriller , Mystery , \b\b]\n",
      "Movie title:  ['Miami Vice'] , Genres: [Action , Adventure , Crime , Thriller , \b\b]\n",
      "Movie title:  ['Tron'] , Genres: [Science Fiction , Action , Adventure , \b\b]\n",
      "Movie title:  ['The Lord of the Rings'] , Genres: [Fantasy , Drama , Animation , Adventure , \b\b]\n",
      "Movie title:  ['48 Hrs.'] , Genres: [Thriller , Action , Comedy , Crime , Drama , \b\b]\n",
      "Movie title:  ['Edward Scissorhands'] , Genres: [Fantasy , Drama , Romance , \b\b]\n",
      "Movie title:  ['Le Grand Bleu'] , Genres: [Adventure , Drama , Romance , \b\b]\n",
      "Movie title:  ['Saw'] , Genres: [Horror , Mystery , Crime , \b\b]\n",
      "Movie title:  [\"Le fabuleux destin d'Amélie Poulain\"] , Genres: [Comedy , Romance , \b\b]\n"
     ]
    }
   ],
   "source": [
    "user12Movies = getMoviesOfUser(12, users_fav_movies)\n",
    "for movie in user12Movies:\n",
    "    title = list(movies_metadata.loc[movies_metadata['id'] == str(movie)]['original_title'])\n",
    "    if title != []:\n",
    "        print('Movie title: ', title, ', Genres: [', end = '')\n",
    "        genres = ast.literal_eval(movies_metadata.loc[movies_metadata['id'] == str(movie)]['genres'].values[0].split('[')[1].split(']')[0])\n",
    "        for genre in genres:\n",
    "            print(genre['name'], ', ', end = '')\n",
    "        print(end = '\\b\\b]')\n",
    "        print('')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "And finally these are the top 10 recommended movies for that user"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 50,
   "metadata": {
    "scrolled": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Movie title:  ['Trois couleurs : Rouge'] , Genres: [Drama , Mystery , Romance , ]\n",
      "Movie title:  [\"Ocean's Eleven\"] , Genres: [Thriller , Crime , ]\n",
      "Movie title:  ['Judgment Night'] , Genres: [Action , Thriller , Crime , ]\n",
      "Movie title:  ['Scarface'] , Genres: [Action , Crime , Drama , Thriller , ]\n",
      "Movie title:  ['Back to the Future Part II'] , Genres: [Adventure , Comedy , Family , Science Fiction , ]\n",
      "Movie title:  [\"Ocean's Twelve\"] , Genres: [Thriller , Crime , ]\n",
      "Movie title:  ['To Be or Not to Be'] , Genres: [Comedy , War , ]\n",
      "Movie title:  ['Back to the Future Part III'] , Genres: [Adventure , Comedy , Family , Science Fiction , ]\n",
      "Movie title:  ['A Clockwork Orange'] , Genres: [Science Fiction , Drama , ]\n",
      "Movie title:  ['Minority Report'] , Genres: [Action , Thriller , Science Fiction , Mystery , ]\n"
     ]
    }
   ],
   "source": [
    "user12Recommendations = userRequestedFor(12, users_fav_movies).recommendMostFavouriteMovies()[1]\n",
    "for movie in user12Recommendations[:15]:\n",
    "    title = list(movies_metadata.loc[movies_metadata['id'] == str(movie)]['original_title'])\n",
    "    if title != []:\n",
    "        print('Movie title: ', title, ', Genres: [', end = '')\n",
    "        genres = ast.literal_eval(movies_metadata.loc[movies_metadata['id'] == str(movie)]['genres'].values[0].split('[')[1].split(']')[0])\n",
    "        for genre in genres:\n",
    "            print(genre['name'], ', ', end = '')\n",
    "        print(']', end = '')\n",
    "        print()\n",
    "            "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<p style=\"font-size: 30px\"> You're Done</p>\n",
    "<br>\n",
    "<p>Thanks for reading this article. If you want this whole project then please visit my github liabrary <a href=\"https://github.com/asdkazmi/AI-Movies-Recommendation-System-K-Means-Clustering\" style=\"font-weight: bold\" target='_blank'>AI Movies Recommendation System Based on K-means Clustering Algorithm</a>.</p>"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "colab": {
   "name": "AI Movies Recommendation System with Clustering Based K-Means Algorithm.ipynb",
   "provenance": [],
   "toc_visible": true
  },
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.7.4"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 1
}