Example.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Getting recommendations\n",
    "\n",
    "**Important**: Make sure you have a csv of your zotero library and a text file with your feedly client token in the inputs folder."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "from article_recommender.load_zotero import ZoteroLibrary\n",
    "from article_recommender.training import TrainingData\n",
    "from article_recommender.feedly_connector import FeedlyStream\n",
    "import pandas as pd"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "If you have never loaded the nltk stopwords corpus before run the code below:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "collapsed": false,
    "scrolled": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[nltk_data] Downloading package stopwords to /Users/steve/nltk_data...\n",
      "[nltk_data]   Package stopwords is already up-to-date!\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "True"
      ]
     },
     "execution_count": 2,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "import nltk\n",
    "nltk.download('stopwords')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": true
   },
   "source": [
    "First load your zotero library."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "library = ZoteroLibrary()\n",
    "library.read_library('inputs/zotero_library.csv')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Load the library into a training data set."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "train_data = TrainingData(library.get_library())\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": true
   },
   "source": [
    "Train a count vectorizer (bag of words) based on the training data to prepare for scoring articles."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "train_data.train_count_vectorizer();"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Load articles from feedly that you would like to score. Category should be the category on feedly where you put your journal article feeds. You can load up to 1000 articles per stream (rss feed). You can also load multiple categories by running the load_category function for each category."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "%%capture \n",
    "# ^^ Hides the SSL warnings from the requests library\n",
    "with open('inputs/feedly_client_token.txt', 'r') as f:\n",
    "    FEEDLY_CLIENT_TOKEN = f.readline()\n",
    "\n",
    "rss_articles = FeedlyStream(FEEDLY_CLIENT_TOKEN)\n",
    "rss_articles.load_category(category='Journals', articles_per_stream=100);"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Rank all the articles in loaded categories based on the trained vectorizer from train_data. The result is a pandas data frame that can be further manipulated or output to a file."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "/Users/steve/anaconda/lib/python2.7/site-packages/bs4/__init__.py:166: UserWarning: No parser was explicitly specified, so I'm using the best available HTML parser for this system (\"lxml\"). This usually isn't a problem, but if you run this code on another system, or in a different virtual environment, it may use a different parser and behave differently.\n",
      "\n",
      "To get rid of this warning, change this:\n",
      "\n",
      " BeautifulSoup([your markup])\n",
      "\n",
      "to this:\n",
      "\n",
      " BeautifulSoup([your markup], \"lxml\")\n",
      "\n",
      "  markup_type=markup_type))\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Title</th>\n",
       "      <th>Url</th>\n",
       "      <th>Score</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>Coupling between diffusion and orientation of pentacene molecules ...</td>\n",
       "      <td>http://feeds.nature.com/~r/nmat/rss/aop/~3/5WDMrZ2nT_4/nmat4575</td>\n",
       "      <td>0.323817</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>Chiral atomically thin films</td>\n",
       "      <td>http://feeds.nature.com/~r/nnano/rss/aop/~3/QsHzpeSSRpg/nnano.2016.3</td>\n",
       "      <td>0.313937</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>Controlling spin relaxation with a cavity</td>\n",
       "      <td>http://feeds.nature.com/~r/nature/rss/current/~3/ciM-agFY1BI/natur...</td>\n",
       "      <td>0.285625</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>Direct measurement of exciton valley coherence in monolayer WSe2</td>\n",
       "      <td>http://feeds.nature.com/~r/nphys/rss/aop/~3/y1wbRV0DAl8/nphys3674</td>\n",
       "      <td>0.278760</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>Electro-optic sampling of near-infrared waveforms</td>\n",
       "      <td>http://feeds.nature.com/~r/nphoton/rss/current/~3/ih2CR8lkn54/npho...</td>\n",
       "      <td>0.264122</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>Multi-wave coherent control of a solid-state single emitter</td>\n",
       "      <td>http://feeds.nature.com/~r/nphoton/rss/current/~3/fM48f_mmHSc/npho...</td>\n",
       "      <td>0.247482</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>Electrostatic catalysis of a Diels–Alder reaction</td>\n",
       "      <td>http://feeds.nature.com/~r/nature/rss/current/~3/9EIXjtxOevw/natur...</td>\n",
       "      <td>0.243864</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>Self-homodyne measurement of a dynamic Mollow triplet in the solid...</td>\n",
       "      <td>http://feeds.nature.com/~r/nphoton/rss/current/~3/FL8iMhrGP-g/npho...</td>\n",
       "      <td>0.241932</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>Realization of a tunable artificial atom at a supercritically char...</td>\n",
       "      <td>http://feeds.nature.com/~r/nphys/rss/aop/~3/kBJieWtqays/nphys3665</td>\n",
       "      <td>0.237848</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>Chiral magnetic effect in ZrTe5</td>\n",
       "      <td>http://feeds.nature.com/~r/nphys/rss/aop/~3/9TMnsh32Hi8/nphys3648</td>\n",
       "      <td>0.220471</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>Collective magnetic response of CeO2 nanoparticles</td>\n",
       "      <td>http://feeds.nature.com/~r/nphys/rss/aop/~3/Hob8ZdJ5bh4/nphys3676</td>\n",
       "      <td>0.216875</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>Experimental realization of two-dimensional synthetic spin–orbit c...</td>\n",
       "      <td>http://feeds.nature.com/~r/nphys/rss/aop/~3/e9bpO5vT08Y/nphys3672</td>\n",
       "      <td>0.216743</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>[Report] Observation of the Dirac fluid and the breakdown of the W...</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1058?rss=1</td>\n",
       "      <td>0.216461</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>Condensation on slippery asymmetric bumps</td>\n",
       "      <td>http://feeds.nature.com/~r/nature/rss/current/~3/Ukr2itGNCX0/natur...</td>\n",
       "      <td>0.216212</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>[In Depth] Flagship accelerators bid for better beams</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6276/899?rss=1</td>\n",
       "      <td>0.211132</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>A large light-mass component of cosmic rays at 1017–1017.5 electro...</td>\n",
       "      <td>http://feeds.nature.com/~r/nature/rss/current/~3/fLSPm552RYU/natur...</td>\n",
       "      <td>0.200653</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>Coherent control with a short-wavelength free-electron laser</td>\n",
       "      <td>http://feeds.nature.com/~r/nphoton/rss/current/~3/H4xCuMGuyZM/npho...</td>\n",
       "      <td>0.196862</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>Probing disorder in isometric pyrochlore and related complex oxides</td>\n",
       "      <td>http://feeds.nature.com/~r/nmat/rss/aop/~3/v3SQEkGO4RQ/nmat4581</td>\n",
       "      <td>0.195533</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>[Report] Highly stretchable electroluminescent skin for optical si...</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1071?rss=1</td>\n",
       "      <td>0.192563</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>Observation of room-temperature magnetic skyrmions and their curre...</td>\n",
       "      <td>http://feeds.nature.com/~r/nmat/rss/aop/~3/cpzy9V09J0M/nmat4593</td>\n",
       "      <td>0.192460</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>Electron viscosity, current vortices and negative nonlocal resista...</td>\n",
       "      <td>http://feeds.nature.com/~r/nphys/rss/aop/~3/ZcU8hDV4k3g/nphys3667</td>\n",
       "      <td>0.186118</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>Stable amorphous georgeite as a precursor to a high-activity catalyst</td>\n",
       "      <td>http://feeds.nature.com/~r/nature/rss/current/~3/iJh5H0oSSAw/natur...</td>\n",
       "      <td>0.182828</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>[Report] Selective conversion of syngas to light olefins</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1065?rss=1</td>\n",
       "      <td>0.177410</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>[Report] Negative local resistance caused by viscous electron back...</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1055?rss=1</td>\n",
       "      <td>0.174871</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>Crystal structure of eukaryotic translation initiation factor 2B</td>\n",
       "      <td>http://feeds.nature.com/~r/nature/rss/current/~3/GUdxMdgij70/natur...</td>\n",
       "      <td>0.172675</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>Pre-fusion structure of a human coronavirus spike protein</td>\n",
       "      <td>http://feeds.nature.com/~r/nature/rss/current/~3/FZ1id7OJsnQ/natur...</td>\n",
       "      <td>0.172489</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>Cryo-electron microscopy structure of a coronavirus spike glycopro...</td>\n",
       "      <td>http://feeds.nature.com/~r/nature/rss/current/~3/BHOGoxT1doA/natur...</td>\n",
       "      <td>0.171274</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>[Report] Evidence for hydrodynamic electron flow in PdCoO2</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1061?rss=1</td>\n",
       "      <td>0.170122</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>Mutant Kras copy number defines metabolic reprogramming and therap...</td>\n",
       "      <td>http://feeds.nature.com/~r/nature/rss/current/~3/9uIU8Tdde8I/natur...</td>\n",
       "      <td>0.165520</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>Geometric Hall effects in topological insulator heterostructures</td>\n",
       "      <td>http://feeds.nature.com/~r/nphys/rss/aop/~3/2WeO63pqxB4/nphys3671</td>\n",
       "      <td>0.163543</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>279</th>\n",
       "      <td>[This Week in Science] SRC shows it stripes</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1038.12?rss=1</td>\n",
       "      <td>0.007677</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>280</th>\n",
       "      <td>Turning point: Gun-crime analyst</td>\n",
       "      <td>http://feeds.nature.com/~r/nature/rss/current/~3/bJ7PtdvYXeo/nj759...</td>\n",
       "      <td>0.007129</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>281</th>\n",
       "      <td>[This Week in Science] Profiling the antibody response to Ebola</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1038.3?rss=1</td>\n",
       "      <td>0.006581</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>282</th>\n",
       "      <td>[Letter] Walking the open science walk</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6276/927.1?rss=1</td>\n",
       "      <td>0.006581</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>283</th>\n",
       "      <td>[Editors' Choice] KRAS gets the silencing treatment</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1039.5?rss=1</td>\n",
       "      <td>0.006032</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>284</th>\n",
       "      <td>[Letter] Seeing the grasslands through the trees—Response</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1036.2?rss=1</td>\n",
       "      <td>0.004634</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>285</th>\n",
       "      <td>[Letter] Migratory birds need coordinated protection</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6276/926.2?rss=1</td>\n",
       "      <td>0.003972</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>286</th>\n",
       "      <td>Activism: Frustrated postdocs rise up</td>\n",
       "      <td>http://feeds.nature.com/~r/nature/rss/current/~3/FeCcwUGlIRM/nj759...</td>\n",
       "      <td>0.003972</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>287</th>\n",
       "      <td>[This Week in Science] Resolving the thermoelectric paradox</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1038.2?rss=1</td>\n",
       "      <td>0.003310</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>288</th>\n",
       "      <td>[This Week in Science] Diversity reigns in antibody responses</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1038.4?rss=1</td>\n",
       "      <td>0.003310</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>289</th>\n",
       "      <td>[This Week in Science] Doubling DNA but not expression</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1038.5?rss=1</td>\n",
       "      <td>0.003310</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>290</th>\n",
       "      <td>[This Week in Science] Make it stretch, make it glow</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1038.9?rss=1</td>\n",
       "      <td>0.003310</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>291</th>\n",
       "      <td>[This Week in Science] A more complete look at the HIV-1 envelope</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1038.10?rss=1</td>\n",
       "      <td>0.003310</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>292</th>\n",
       "      <td>[This Week in Science] Credit assignment in the brain</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1038.13?rss=1</td>\n",
       "      <td>0.003310</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>293</th>\n",
       "      <td>[This Week in Science] Choosing where to start transcription</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1038.15?rss=1</td>\n",
       "      <td>0.003310</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>294</th>\n",
       "      <td>[Editors' Choice] Earthworms on a microplastics diet</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1039.1?rss=1</td>\n",
       "      <td>0.003310</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>295</th>\n",
       "      <td>[Editors' Choice] For health, microbial location matters</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1039.2?rss=1</td>\n",
       "      <td>0.003310</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>296</th>\n",
       "      <td>[Editors' Choice] Innocent until proven guilty</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1039.3?rss=1</td>\n",
       "      <td>0.003310</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>297</th>\n",
       "      <td>[Editors' Choice] Modeling Neandertal extinction</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1039.4?rss=1</td>\n",
       "      <td>0.003310</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>298</th>\n",
       "      <td>[Editors' Choice] Forecasting cascading fault rupture</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1039.6?rss=1</td>\n",
       "      <td>0.003310</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>299</th>\n",
       "      <td>[Editors' Choice] Dropping lead from perovskites</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1039.7?rss=1</td>\n",
       "      <td>0.003310</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>300</th>\n",
       "      <td>[Working Life] Making a game of science</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1106?rss=1</td>\n",
       "      <td>0.003310</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>301</th>\n",
       "      <td>[This Week in Science] A golden opportunity for graphene</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6276/929.5?rss=1</td>\n",
       "      <td>0.003310</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>302</th>\n",
       "      <td>[This Week in Science] Leaf seasonality in Amazon forests</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6276/929.6?rss=1</td>\n",
       "      <td>0.003310</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>303</th>\n",
       "      <td>[This Week in Science] Managing metastasis</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6276/929.7?rss=1</td>\n",
       "      <td>0.003310</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>304</th>\n",
       "      <td>[Letter] Seeing the grasslands through the trees</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1036.1?rss=1</td>\n",
       "      <td>0.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>305</th>\n",
       "      <td>[Letter] Government: Plan for ecosystem services</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1037.1?rss=1</td>\n",
       "      <td>0.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>306</th>\n",
       "      <td>[Letter] Trading away ancient amber's secrets</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6276/926.1?rss=1</td>\n",
       "      <td>0.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>307</th>\n",
       "      <td>Intraoperative diagnostics and elimination of residual microtumour...</td>\n",
       "      <td>http://feeds.nature.com/~r/nnano/rss/aop/~3/XowIhEJxxlg/nnano.2015...</td>\n",
       "      <td>0.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>308</th>\n",
       "      <td>Brain food: Clever eating</td>\n",
       "      <td>http://feeds.nature.com/~r/nature/rss/current/~3/zsFrdcRqZSs/531S12a</td>\n",
       "      <td>0.000000</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>309 rows × 3 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                                                                     Title  \\\n",
       "0    Coupling between diffusion and orientation of pentacene molecules ...   \n",
       "1                                             Chiral atomically thin films   \n",
       "2                                Controlling spin relaxation with a cavity   \n",
       "3         Direct measurement of exciton valley coherence in monolayer WSe2   \n",
       "4                        Electro-optic sampling of near-infrared waveforms   \n",
       "5              Multi-wave coherent control of a solid-state single emitter   \n",
       "6                        Electrostatic catalysis of a Diels–Alder reaction   \n",
       "7    Self-homodyne measurement of a dynamic Mollow triplet in the solid...   \n",
       "8    Realization of a tunable artificial atom at a supercritically char...   \n",
       "9                                          Chiral magnetic effect in ZrTe5   \n",
       "10                      Collective magnetic response of CeO2 nanoparticles   \n",
       "11   Experimental realization of two-dimensional synthetic spin–orbit c...   \n",
       "12   [Report] Observation of the Dirac fluid and the breakdown of the W...   \n",
       "13                               Condensation on slippery asymmetric bumps   \n",
       "14                   [In Depth] Flagship accelerators bid for better beams   \n",
       "15   A large light-mass component of cosmic rays at 1017–1017.5 electro...   \n",
       "16            Coherent control with a short-wavelength free-electron laser   \n",
       "17     Probing disorder in isometric pyrochlore and related complex oxides   \n",
       "18   [Report] Highly stretchable electroluminescent skin for optical si...   \n",
       "19   Observation of room-temperature magnetic skyrmions and their curre...   \n",
       "20   Electron viscosity, current vortices and negative nonlocal resista...   \n",
       "21   Stable amorphous georgeite as a precursor to a high-activity catalyst   \n",
       "22                [Report] Selective conversion of syngas to light olefins   \n",
       "23   [Report] Negative local resistance caused by viscous electron back...   \n",
       "24        Crystal structure of eukaryotic translation initiation factor 2B   \n",
       "25               Pre-fusion structure of a human coronavirus spike protein   \n",
       "26   Cryo-electron microscopy structure of a coronavirus spike glycopro...   \n",
       "27              [Report] Evidence for hydrodynamic electron flow in PdCoO2   \n",
       "28   Mutant Kras copy number defines metabolic reprogramming and therap...   \n",
       "29        Geometric Hall effects in topological insulator heterostructures   \n",
       "..                                                                     ...   \n",
       "279                            [This Week in Science] SRC shows it stripes   \n",
       "280                                       Turning point: Gun-crime analyst   \n",
       "281        [This Week in Science] Profiling the antibody response to Ebola   \n",
       "282                                 [Letter] Walking the open science walk   \n",
       "283                    [Editors' Choice] KRAS gets the silencing treatment   \n",
       "284              [Letter] Seeing the grasslands through the trees—Response   \n",
       "285                   [Letter] Migratory birds need coordinated protection   \n",
       "286                                  Activism: Frustrated postdocs rise up   \n",
       "287            [This Week in Science] Resolving the thermoelectric paradox   \n",
       "288          [This Week in Science] Diversity reigns in antibody responses   \n",
       "289                 [This Week in Science] Doubling DNA but not expression   \n",
       "290                   [This Week in Science] Make it stretch, make it glow   \n",
       "291      [This Week in Science] A more complete look at the HIV-1 envelope   \n",
       "292                  [This Week in Science] Credit assignment in the brain   \n",
       "293           [This Week in Science] Choosing where to start transcription   \n",
       "294                   [Editors' Choice] Earthworms on a microplastics diet   \n",
       "295               [Editors' Choice] For health, microbial location matters   \n",
       "296                         [Editors' Choice] Innocent until proven guilty   \n",
       "297                       [Editors' Choice] Modeling Neandertal extinction   \n",
       "298                  [Editors' Choice] Forecasting cascading fault rupture   \n",
       "299                       [Editors' Choice] Dropping lead from perovskites   \n",
       "300                                [Working Life] Making a game of science   \n",
       "301               [This Week in Science] A golden opportunity for graphene   \n",
       "302              [This Week in Science] Leaf seasonality in Amazon forests   \n",
       "303                             [This Week in Science] Managing metastasis   \n",
       "304                       [Letter] Seeing the grasslands through the trees   \n",
       "305                       [Letter] Government: Plan for ecosystem services   \n",
       "306                          [Letter] Trading away ancient amber's secrets   \n",
       "307  Intraoperative diagnostics and elimination of residual microtumour...   \n",
       "308                                              Brain food: Clever eating   \n",
       "\n",
       "                                                                       Url  \\\n",
       "0          http://feeds.nature.com/~r/nmat/rss/aop/~3/5WDMrZ2nT_4/nmat4575   \n",
       "1     http://feeds.nature.com/~r/nnano/rss/aop/~3/QsHzpeSSRpg/nnano.2016.3   \n",
       "2    http://feeds.nature.com/~r/nature/rss/current/~3/ciM-agFY1BI/natur...   \n",
       "3        http://feeds.nature.com/~r/nphys/rss/aop/~3/y1wbRV0DAl8/nphys3674   \n",
       "4    http://feeds.nature.com/~r/nphoton/rss/current/~3/ih2CR8lkn54/npho...   \n",
       "5    http://feeds.nature.com/~r/nphoton/rss/current/~3/fM48f_mmHSc/npho...   \n",
       "6    http://feeds.nature.com/~r/nature/rss/current/~3/9EIXjtxOevw/natur...   \n",
       "7    http://feeds.nature.com/~r/nphoton/rss/current/~3/FL8iMhrGP-g/npho...   \n",
       "8        http://feeds.nature.com/~r/nphys/rss/aop/~3/kBJieWtqays/nphys3665   \n",
       "9        http://feeds.nature.com/~r/nphys/rss/aop/~3/9TMnsh32Hi8/nphys3648   \n",
       "10       http://feeds.nature.com/~r/nphys/rss/aop/~3/Hob8ZdJ5bh4/nphys3676   \n",
       "11       http://feeds.nature.com/~r/nphys/rss/aop/~3/e9bpO5vT08Y/nphys3672   \n",
       "12               http://science.sciencemag.org/content/351/6277/1058?rss=1   \n",
       "13   http://feeds.nature.com/~r/nature/rss/current/~3/Ukr2itGNCX0/natur...   \n",
       "14                http://science.sciencemag.org/content/351/6276/899?rss=1   \n",
       "15   http://feeds.nature.com/~r/nature/rss/current/~3/fLSPm552RYU/natur...   \n",
       "16   http://feeds.nature.com/~r/nphoton/rss/current/~3/H4xCuMGuyZM/npho...   \n",
       "17         http://feeds.nature.com/~r/nmat/rss/aop/~3/v3SQEkGO4RQ/nmat4581   \n",
       "18               http://science.sciencemag.org/content/351/6277/1071?rss=1   \n",
       "19         http://feeds.nature.com/~r/nmat/rss/aop/~3/cpzy9V09J0M/nmat4593   \n",
       "20       http://feeds.nature.com/~r/nphys/rss/aop/~3/ZcU8hDV4k3g/nphys3667   \n",
       "21   http://feeds.nature.com/~r/nature/rss/current/~3/iJh5H0oSSAw/natur...   \n",
       "22               http://science.sciencemag.org/content/351/6277/1065?rss=1   \n",
       "23               http://science.sciencemag.org/content/351/6277/1055?rss=1   \n",
       "24   http://feeds.nature.com/~r/nature/rss/current/~3/GUdxMdgij70/natur...   \n",
       "25   http://feeds.nature.com/~r/nature/rss/current/~3/FZ1id7OJsnQ/natur...   \n",
       "26   http://feeds.nature.com/~r/nature/rss/current/~3/BHOGoxT1doA/natur...   \n",
       "27               http://science.sciencemag.org/content/351/6277/1061?rss=1   \n",
       "28   http://feeds.nature.com/~r/nature/rss/current/~3/9uIU8Tdde8I/natur...   \n",
       "29       http://feeds.nature.com/~r/nphys/rss/aop/~3/2WeO63pqxB4/nphys3671   \n",
       "..                                                                     ...   \n",
       "279           http://science.sciencemag.org/content/351/6277/1038.12?rss=1   \n",
       "280  http://feeds.nature.com/~r/nature/rss/current/~3/bJ7PtdvYXeo/nj759...   \n",
       "281            http://science.sciencemag.org/content/351/6277/1038.3?rss=1   \n",
       "282             http://science.sciencemag.org/content/351/6276/927.1?rss=1   \n",
       "283            http://science.sciencemag.org/content/351/6277/1039.5?rss=1   \n",
       "284            http://science.sciencemag.org/content/351/6277/1036.2?rss=1   \n",
       "285             http://science.sciencemag.org/content/351/6276/926.2?rss=1   \n",
       "286  http://feeds.nature.com/~r/nature/rss/current/~3/FeCcwUGlIRM/nj759...   \n",
       "287            http://science.sciencemag.org/content/351/6277/1038.2?rss=1   \n",
       "288            http://science.sciencemag.org/content/351/6277/1038.4?rss=1   \n",
       "289            http://science.sciencemag.org/content/351/6277/1038.5?rss=1   \n",
       "290            http://science.sciencemag.org/content/351/6277/1038.9?rss=1   \n",
       "291           http://science.sciencemag.org/content/351/6277/1038.10?rss=1   \n",
       "292           http://science.sciencemag.org/content/351/6277/1038.13?rss=1   \n",
       "293           http://science.sciencemag.org/content/351/6277/1038.15?rss=1   \n",
       "294            http://science.sciencemag.org/content/351/6277/1039.1?rss=1   \n",
       "295            http://science.sciencemag.org/content/351/6277/1039.2?rss=1   \n",
       "296            http://science.sciencemag.org/content/351/6277/1039.3?rss=1   \n",
       "297            http://science.sciencemag.org/content/351/6277/1039.4?rss=1   \n",
       "298            http://science.sciencemag.org/content/351/6277/1039.6?rss=1   \n",
       "299            http://science.sciencemag.org/content/351/6277/1039.7?rss=1   \n",
       "300              http://science.sciencemag.org/content/351/6277/1106?rss=1   \n",
       "301             http://science.sciencemag.org/content/351/6276/929.5?rss=1   \n",
       "302             http://science.sciencemag.org/content/351/6276/929.6?rss=1   \n",
       "303             http://science.sciencemag.org/content/351/6276/929.7?rss=1   \n",
       "304            http://science.sciencemag.org/content/351/6277/1036.1?rss=1   \n",
       "305            http://science.sciencemag.org/content/351/6277/1037.1?rss=1   \n",
       "306             http://science.sciencemag.org/content/351/6276/926.1?rss=1   \n",
       "307  http://feeds.nature.com/~r/nnano/rss/aop/~3/XowIhEJxxlg/nnano.2015...   \n",
       "308   http://feeds.nature.com/~r/nature/rss/current/~3/zsFrdcRqZSs/531S12a   \n",
       "\n",
       "        Score  \n",
       "0    0.323817  \n",
       "1    0.313937  \n",
       "2    0.285625  \n",
       "3    0.278760  \n",
       "4    0.264122  \n",
       "5    0.247482  \n",
       "6    0.243864  \n",
       "7    0.241932  \n",
       "8    0.237848  \n",
       "9    0.220471  \n",
       "10   0.216875  \n",
       "11   0.216743  \n",
       "12   0.216461  \n",
       "13   0.216212  \n",
       "14   0.211132  \n",
       "15   0.200653  \n",
       "16   0.196862  \n",
       "17   0.195533  \n",
       "18   0.192563  \n",
       "19   0.192460  \n",
       "20   0.186118  \n",
       "21   0.182828  \n",
       "22   0.177410  \n",
       "23   0.174871  \n",
       "24   0.172675  \n",
       "25   0.172489  \n",
       "26   0.171274  \n",
       "27   0.170122  \n",
       "28   0.165520  \n",
       "29   0.163543  \n",
       "..        ...  \n",
       "279  0.007677  \n",
       "280  0.007129  \n",
       "281  0.006581  \n",
       "282  0.006581  \n",
       "283  0.006032  \n",
       "284  0.004634  \n",
       "285  0.003972  \n",
       "286  0.003972  \n",
       "287  0.003310  \n",
       "288  0.003310  \n",
       "289  0.003310  \n",
       "290  0.003310  \n",
       "291  0.003310  \n",
       "292  0.003310  \n",
       "293  0.003310  \n",
       "294  0.003310  \n",
       "295  0.003310  \n",
       "296  0.003310  \n",
       "297  0.003310  \n",
       "298  0.003310  \n",
       "299  0.003310  \n",
       "300  0.003310  \n",
       "301  0.003310  \n",
       "302  0.003310  \n",
       "303  0.003310  \n",
       "304  0.000000  \n",
       "305  0.000000  \n",
       "306  0.000000  \n",
       "307  0.000000  \n",
       "308  0.000000  \n",
       "\n",
       "[309 rows x 3 columns]"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "results = rss_articles.rank_all(train_data)\n",
    "pd.set_option('max_colwidth',70)\n",
    "results"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Same as above but with the tf-idf vectorizer (term frequency inverse document frequency)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "train_data.train_tfidf_vectorizer();"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Title</th>\n",
       "      <th>Url</th>\n",
       "      <th>Score</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>Controlling spin relaxation with a cavity</td>\n",
       "      <td>http://feeds.nature.com/~r/nature/rss/current/~3/ciM-agFY1BI/natur...</td>\n",
       "      <td>21.571167</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>Condensation on slippery asymmetric bumps</td>\n",
       "      <td>http://feeds.nature.com/~r/nature/rss/current/~3/Ukr2itGNCX0/natur...</td>\n",
       "      <td>21.524228</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>Chiral atomically thin films</td>\n",
       "      <td>http://feeds.nature.com/~r/nnano/rss/aop/~3/QsHzpeSSRpg/nnano.2016.3</td>\n",
       "      <td>21.267093</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>Electrostatic catalysis of a Diels–Alder reaction</td>\n",
       "      <td>http://feeds.nature.com/~r/nature/rss/current/~3/9EIXjtxOevw/natur...</td>\n",
       "      <td>19.652238</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>Mutant Kras copy number defines metabolic reprogramming and therap...</td>\n",
       "      <td>http://feeds.nature.com/~r/nature/rss/current/~3/9uIU8Tdde8I/natur...</td>\n",
       "      <td>17.089904</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>Coupling between diffusion and orientation of pentacene molecules ...</td>\n",
       "      <td>http://feeds.nature.com/~r/nmat/rss/aop/~3/5WDMrZ2nT_4/nmat4575</td>\n",
       "      <td>16.249902</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>Chiral magnetic effect in ZrTe5</td>\n",
       "      <td>http://feeds.nature.com/~r/nphys/rss/aop/~3/9TMnsh32Hi8/nphys3648</td>\n",
       "      <td>14.911892</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>Collective magnetic response of CeO2 nanoparticles</td>\n",
       "      <td>http://feeds.nature.com/~r/nphys/rss/aop/~3/Hob8ZdJ5bh4/nphys3676</td>\n",
       "      <td>14.664494</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>Crystal structure of eukaryotic translation initiation factor 2B</td>\n",
       "      <td>http://feeds.nature.com/~r/nature/rss/current/~3/GUdxMdgij70/natur...</td>\n",
       "      <td>14.487845</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>Upper-plate controls on co-seismic slip in the 2011 magnitude 9.0 ...</td>\n",
       "      <td>http://feeds.nature.com/~r/nature/rss/current/~3/5iP_Odxasxw/natur...</td>\n",
       "      <td>14.385625</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>A large light-mass component of cosmic rays at 1017–1017.5 electro...</td>\n",
       "      <td>http://feeds.nature.com/~r/nature/rss/current/~3/fLSPm552RYU/natur...</td>\n",
       "      <td>14.331680</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>Direct measurement of exciton valley coherence in monolayer WSe2</td>\n",
       "      <td>http://feeds.nature.com/~r/nphys/rss/aop/~3/y1wbRV0DAl8/nphys3674</td>\n",
       "      <td>13.888268</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>Realization of a tunable artificial atom at a supercritically char...</td>\n",
       "      <td>http://feeds.nature.com/~r/nphys/rss/aop/~3/kBJieWtqays/nphys3665</td>\n",
       "      <td>13.400801</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>Stable amorphous georgeite as a precursor to a high-activity catalyst</td>\n",
       "      <td>http://feeds.nature.com/~r/nature/rss/current/~3/iJh5H0oSSAw/natur...</td>\n",
       "      <td>13.298458</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>Multi-wave coherent control of a solid-state single emitter</td>\n",
       "      <td>http://feeds.nature.com/~r/nphoton/rss/current/~3/fM48f_mmHSc/npho...</td>\n",
       "      <td>13.252562</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>Self-homodyne measurement of a dynamic Mollow triplet in the solid...</td>\n",
       "      <td>http://feeds.nature.com/~r/nphoton/rss/current/~3/FL8iMhrGP-g/npho...</td>\n",
       "      <td>12.652021</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>Late acquisition of mitochondria by a host with chimaeric prokaryo...</td>\n",
       "      <td>http://feeds.nature.com/~r/nature/rss/current/~3/SObROEn2-6A/natur...</td>\n",
       "      <td>12.087875</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>Electro-optic sampling of near-infrared waveforms</td>\n",
       "      <td>http://feeds.nature.com/~r/nphoton/rss/current/~3/ih2CR8lkn54/npho...</td>\n",
       "      <td>11.936096</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>[Report] Selective conversion of syngas to light olefins</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1065?rss=1</td>\n",
       "      <td>11.513983</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>[Report] Isolation of potent neutralizing antibodies from a surviv...</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1078?rss=1</td>\n",
       "      <td>11.454099</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>Experimental realization of two-dimensional synthetic spin–orbit c...</td>\n",
       "      <td>http://feeds.nature.com/~r/nphys/rss/aop/~3/e9bpO5vT08Y/nphys3672</td>\n",
       "      <td>11.442996</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>[Report] Negative local resistance caused by viscous electron back...</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1055?rss=1</td>\n",
       "      <td>10.620315</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>Observation of room-temperature magnetic skyrmions and their curre...</td>\n",
       "      <td>http://feeds.nature.com/~r/nmat/rss/aop/~3/cpzy9V09J0M/nmat4593</td>\n",
       "      <td>10.551432</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>Coherent control with a short-wavelength free-electron laser</td>\n",
       "      <td>http://feeds.nature.com/~r/nphoton/rss/current/~3/H4xCuMGuyZM/npho...</td>\n",
       "      <td>10.454383</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>Probing disorder in isometric pyrochlore and related complex oxides</td>\n",
       "      <td>http://feeds.nature.com/~r/nmat/rss/aop/~3/v3SQEkGO4RQ/nmat4581</td>\n",
       "      <td>10.440471</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>[Report] Observation of the Dirac fluid and the breakdown of the W...</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1058?rss=1</td>\n",
       "      <td>10.232374</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>[In Depth] Flagship accelerators bid for better beams</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6276/899?rss=1</td>\n",
       "      <td>10.222596</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>Pre-fusion structure of a human coronavirus spike protein</td>\n",
       "      <td>http://feeds.nature.com/~r/nature/rss/current/~3/FZ1id7OJsnQ/natur...</td>\n",
       "      <td>10.174632</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>Electron viscosity, current vortices and negative nonlocal resista...</td>\n",
       "      <td>http://feeds.nature.com/~r/nphys/rss/aop/~3/ZcU8hDV4k3g/nphys3667</td>\n",
       "      <td>9.828463</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>[Report] Highly stretchable electroluminescent skin for optical si...</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1071?rss=1</td>\n",
       "      <td>9.434851</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>279</th>\n",
       "      <td>[Editors' Choice] KRAS gets the silencing treatment</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1039.5?rss=1</td>\n",
       "      <td>0.078620</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>280</th>\n",
       "      <td>[This Week in Science] Brain activity shows underlying motives</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1038.8?rss=1</td>\n",
       "      <td>0.073843</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>281</th>\n",
       "      <td>[This Week in Science] Close-up view of the nuclear periphery</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6276/929.1?rss=1</td>\n",
       "      <td>0.072514</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>282</th>\n",
       "      <td>Ajdenia</td>\n",
       "      <td>http://feeds.nature.com/~r/nature/rss/current/~3/LyRWAxutbEs/531134a</td>\n",
       "      <td>0.064939</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>283</th>\n",
       "      <td>[This Week in Science] Profiling the antibody response to Ebola</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1038.3?rss=1</td>\n",
       "      <td>0.063331</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>284</th>\n",
       "      <td>[Letter] Walking the open science walk</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6276/927.1?rss=1</td>\n",
       "      <td>0.063113</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>285</th>\n",
       "      <td>[Editors' Choice] For health, microbial location matters</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1039.2?rss=1</td>\n",
       "      <td>0.061512</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>286</th>\n",
       "      <td>[This Week in Science] SRC shows it stripes</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1038.12?rss=1</td>\n",
       "      <td>0.060417</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>287</th>\n",
       "      <td>[Editors' Choice] Earthworms on a microplastics diet</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1039.1?rss=1</td>\n",
       "      <td>0.055920</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>288</th>\n",
       "      <td>[Editors' Choice] Forecasting cascading fault rupture</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1039.6?rss=1</td>\n",
       "      <td>0.055920</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>289</th>\n",
       "      <td>[Editors' Choice] Innocent until proven guilty</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1039.3?rss=1</td>\n",
       "      <td>0.050328</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>290</th>\n",
       "      <td>[Editors' Choice] Modeling Neandertal extinction</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1039.4?rss=1</td>\n",
       "      <td>0.050328</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>291</th>\n",
       "      <td>[Editors' Choice] Dropping lead from perovskites</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1039.7?rss=1</td>\n",
       "      <td>0.050328</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>292</th>\n",
       "      <td>[Letter] Seeing the grasslands through the trees—Response</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1036.2?rss=1</td>\n",
       "      <td>0.042993</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>293</th>\n",
       "      <td>[This Week in Science] Diversity reigns in antibody responses</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1038.4?rss=1</td>\n",
       "      <td>0.037284</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>294</th>\n",
       "      <td>[This Week in Science] A more complete look at the HIV-1 envelope</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1038.10?rss=1</td>\n",
       "      <td>0.037284</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>295</th>\n",
       "      <td>[This Week in Science] Resolving the thermoelectric paradox</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1038.2?rss=1</td>\n",
       "      <td>0.033894</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>296</th>\n",
       "      <td>[This Week in Science] Make it stretch, make it glow</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1038.9?rss=1</td>\n",
       "      <td>0.033894</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>297</th>\n",
       "      <td>[This Week in Science] Leaf seasonality in Amazon forests</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6276/929.6?rss=1</td>\n",
       "      <td>0.033894</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>298</th>\n",
       "      <td>[This Week in Science] Doubling DNA but not expression</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1038.5?rss=1</td>\n",
       "      <td>0.030505</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>299</th>\n",
       "      <td>[This Week in Science] Credit assignment in the brain</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1038.13?rss=1</td>\n",
       "      <td>0.030505</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>300</th>\n",
       "      <td>[This Week in Science] Choosing where to start transcription</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1038.15?rss=1</td>\n",
       "      <td>0.030505</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>301</th>\n",
       "      <td>[Working Life] Making a game of science</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1106?rss=1</td>\n",
       "      <td>0.030505</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>302</th>\n",
       "      <td>[This Week in Science] A golden opportunity for graphene</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6276/929.5?rss=1</td>\n",
       "      <td>0.030505</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>303</th>\n",
       "      <td>[This Week in Science] Managing metastasis</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6276/929.7?rss=1</td>\n",
       "      <td>0.027116</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>304</th>\n",
       "      <td>[Letter] Seeing the grasslands through the trees</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1036.1?rss=1</td>\n",
       "      <td>0.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>305</th>\n",
       "      <td>[Letter] Government: Plan for ecosystem services</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6277/1037.1?rss=1</td>\n",
       "      <td>0.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>306</th>\n",
       "      <td>[Letter] Trading away ancient amber's secrets</td>\n",
       "      <td>http://science.sciencemag.org/content/351/6276/926.1?rss=1</td>\n",
       "      <td>0.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>307</th>\n",
       "      <td>Intraoperative diagnostics and elimination of residual microtumour...</td>\n",
       "      <td>http://feeds.nature.com/~r/nnano/rss/aop/~3/XowIhEJxxlg/nnano.2015...</td>\n",
       "      <td>0.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>308</th>\n",
       "      <td>Brain food: Clever eating</td>\n",
       "      <td>http://feeds.nature.com/~r/nature/rss/current/~3/zsFrdcRqZSs/531S12a</td>\n",
       "      <td>0.000000</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>309 rows × 3 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                                                                     Title  \\\n",
       "0                                Controlling spin relaxation with a cavity   \n",
       "1                                Condensation on slippery asymmetric bumps   \n",
       "2                                             Chiral atomically thin films   \n",
       "3                        Electrostatic catalysis of a Diels–Alder reaction   \n",
       "4    Mutant Kras copy number defines metabolic reprogramming and therap...   \n",
       "5    Coupling between diffusion and orientation of pentacene molecules ...   \n",
       "6                                          Chiral magnetic effect in ZrTe5   \n",
       "7                       Collective magnetic response of CeO2 nanoparticles   \n",
       "8         Crystal structure of eukaryotic translation initiation factor 2B   \n",
       "9    Upper-plate controls on co-seismic slip in the 2011 magnitude 9.0 ...   \n",
       "10   A large light-mass component of cosmic rays at 1017–1017.5 electro...   \n",
       "11        Direct measurement of exciton valley coherence in monolayer WSe2   \n",
       "12   Realization of a tunable artificial atom at a supercritically char...   \n",
       "13   Stable amorphous georgeite as a precursor to a high-activity catalyst   \n",
       "14             Multi-wave coherent control of a solid-state single emitter   \n",
       "15   Self-homodyne measurement of a dynamic Mollow triplet in the solid...   \n",
       "16   Late acquisition of mitochondria by a host with chimaeric prokaryo...   \n",
       "17                       Electro-optic sampling of near-infrared waveforms   \n",
       "18                [Report] Selective conversion of syngas to light olefins   \n",
       "19   [Report] Isolation of potent neutralizing antibodies from a surviv...   \n",
       "20   Experimental realization of two-dimensional synthetic spin–orbit c...   \n",
       "21   [Report] Negative local resistance caused by viscous electron back...   \n",
       "22   Observation of room-temperature magnetic skyrmions and their curre...   \n",
       "23            Coherent control with a short-wavelength free-electron laser   \n",
       "24     Probing disorder in isometric pyrochlore and related complex oxides   \n",
       "25   [Report] Observation of the Dirac fluid and the breakdown of the W...   \n",
       "26                   [In Depth] Flagship accelerators bid for better beams   \n",
       "27               Pre-fusion structure of a human coronavirus spike protein   \n",
       "28   Electron viscosity, current vortices and negative nonlocal resista...   \n",
       "29   [Report] Highly stretchable electroluminescent skin for optical si...   \n",
       "..                                                                     ...   \n",
       "279                    [Editors' Choice] KRAS gets the silencing treatment   \n",
       "280         [This Week in Science] Brain activity shows underlying motives   \n",
       "281          [This Week in Science] Close-up view of the nuclear periphery   \n",
       "282                                                                Ajdenia   \n",
       "283        [This Week in Science] Profiling the antibody response to Ebola   \n",
       "284                                 [Letter] Walking the open science walk   \n",
       "285               [Editors' Choice] For health, microbial location matters   \n",
       "286                            [This Week in Science] SRC shows it stripes   \n",
       "287                   [Editors' Choice] Earthworms on a microplastics diet   \n",
       "288                  [Editors' Choice] Forecasting cascading fault rupture   \n",
       "289                         [Editors' Choice] Innocent until proven guilty   \n",
       "290                       [Editors' Choice] Modeling Neandertal extinction   \n",
       "291                       [Editors' Choice] Dropping lead from perovskites   \n",
       "292              [Letter] Seeing the grasslands through the trees—Response   \n",
       "293          [This Week in Science] Diversity reigns in antibody responses   \n",
       "294      [This Week in Science] A more complete look at the HIV-1 envelope   \n",
       "295            [This Week in Science] Resolving the thermoelectric paradox   \n",
       "296                   [This Week in Science] Make it stretch, make it glow   \n",
       "297              [This Week in Science] Leaf seasonality in Amazon forests   \n",
       "298                 [This Week in Science] Doubling DNA but not expression   \n",
       "299                  [This Week in Science] Credit assignment in the brain   \n",
       "300           [This Week in Science] Choosing where to start transcription   \n",
       "301                                [Working Life] Making a game of science   \n",
       "302               [This Week in Science] A golden opportunity for graphene   \n",
       "303                             [This Week in Science] Managing metastasis   \n",
       "304                       [Letter] Seeing the grasslands through the trees   \n",
       "305                       [Letter] Government: Plan for ecosystem services   \n",
       "306                          [Letter] Trading away ancient amber's secrets   \n",
       "307  Intraoperative diagnostics and elimination of residual microtumour...   \n",
       "308                                              Brain food: Clever eating   \n",
       "\n",
       "                                                                       Url  \\\n",
       "0    http://feeds.nature.com/~r/nature/rss/current/~3/ciM-agFY1BI/natur...   \n",
       "1    http://feeds.nature.com/~r/nature/rss/current/~3/Ukr2itGNCX0/natur...   \n",
       "2     http://feeds.nature.com/~r/nnano/rss/aop/~3/QsHzpeSSRpg/nnano.2016.3   \n",
       "3    http://feeds.nature.com/~r/nature/rss/current/~3/9EIXjtxOevw/natur...   \n",
       "4    http://feeds.nature.com/~r/nature/rss/current/~3/9uIU8Tdde8I/natur...   \n",
       "5          http://feeds.nature.com/~r/nmat/rss/aop/~3/5WDMrZ2nT_4/nmat4575   \n",
       "6        http://feeds.nature.com/~r/nphys/rss/aop/~3/9TMnsh32Hi8/nphys3648   \n",
       "7        http://feeds.nature.com/~r/nphys/rss/aop/~3/Hob8ZdJ5bh4/nphys3676   \n",
       "8    http://feeds.nature.com/~r/nature/rss/current/~3/GUdxMdgij70/natur...   \n",
       "9    http://feeds.nature.com/~r/nature/rss/current/~3/5iP_Odxasxw/natur...   \n",
       "10   http://feeds.nature.com/~r/nature/rss/current/~3/fLSPm552RYU/natur...   \n",
       "11       http://feeds.nature.com/~r/nphys/rss/aop/~3/y1wbRV0DAl8/nphys3674   \n",
       "12       http://feeds.nature.com/~r/nphys/rss/aop/~3/kBJieWtqays/nphys3665   \n",
       "13   http://feeds.nature.com/~r/nature/rss/current/~3/iJh5H0oSSAw/natur...   \n",
       "14   http://feeds.nature.com/~r/nphoton/rss/current/~3/fM48f_mmHSc/npho...   \n",
       "15   http://feeds.nature.com/~r/nphoton/rss/current/~3/FL8iMhrGP-g/npho...   \n",
       "16   http://feeds.nature.com/~r/nature/rss/current/~3/SObROEn2-6A/natur...   \n",
       "17   http://feeds.nature.com/~r/nphoton/rss/current/~3/ih2CR8lkn54/npho...   \n",
       "18               http://science.sciencemag.org/content/351/6277/1065?rss=1   \n",
       "19               http://science.sciencemag.org/content/351/6277/1078?rss=1   \n",
       "20       http://feeds.nature.com/~r/nphys/rss/aop/~3/e9bpO5vT08Y/nphys3672   \n",
       "21               http://science.sciencemag.org/content/351/6277/1055?rss=1   \n",
       "22         http://feeds.nature.com/~r/nmat/rss/aop/~3/cpzy9V09J0M/nmat4593   \n",
       "23   http://feeds.nature.com/~r/nphoton/rss/current/~3/H4xCuMGuyZM/npho...   \n",
       "24         http://feeds.nature.com/~r/nmat/rss/aop/~3/v3SQEkGO4RQ/nmat4581   \n",
       "25               http://science.sciencemag.org/content/351/6277/1058?rss=1   \n",
       "26                http://science.sciencemag.org/content/351/6276/899?rss=1   \n",
       "27   http://feeds.nature.com/~r/nature/rss/current/~3/FZ1id7OJsnQ/natur...   \n",
       "28       http://feeds.nature.com/~r/nphys/rss/aop/~3/ZcU8hDV4k3g/nphys3667   \n",
       "29               http://science.sciencemag.org/content/351/6277/1071?rss=1   \n",
       "..                                                                     ...   \n",
       "279            http://science.sciencemag.org/content/351/6277/1039.5?rss=1   \n",
       "280            http://science.sciencemag.org/content/351/6277/1038.8?rss=1   \n",
       "281             http://science.sciencemag.org/content/351/6276/929.1?rss=1   \n",
       "282   http://feeds.nature.com/~r/nature/rss/current/~3/LyRWAxutbEs/531134a   \n",
       "283            http://science.sciencemag.org/content/351/6277/1038.3?rss=1   \n",
       "284             http://science.sciencemag.org/content/351/6276/927.1?rss=1   \n",
       "285            http://science.sciencemag.org/content/351/6277/1039.2?rss=1   \n",
       "286           http://science.sciencemag.org/content/351/6277/1038.12?rss=1   \n",
       "287            http://science.sciencemag.org/content/351/6277/1039.1?rss=1   \n",
       "288            http://science.sciencemag.org/content/351/6277/1039.6?rss=1   \n",
       "289            http://science.sciencemag.org/content/351/6277/1039.3?rss=1   \n",
       "290            http://science.sciencemag.org/content/351/6277/1039.4?rss=1   \n",
       "291            http://science.sciencemag.org/content/351/6277/1039.7?rss=1   \n",
       "292            http://science.sciencemag.org/content/351/6277/1036.2?rss=1   \n",
       "293            http://science.sciencemag.org/content/351/6277/1038.4?rss=1   \n",
       "294           http://science.sciencemag.org/content/351/6277/1038.10?rss=1   \n",
       "295            http://science.sciencemag.org/content/351/6277/1038.2?rss=1   \n",
       "296            http://science.sciencemag.org/content/351/6277/1038.9?rss=1   \n",
       "297             http://science.sciencemag.org/content/351/6276/929.6?rss=1   \n",
       "298            http://science.sciencemag.org/content/351/6277/1038.5?rss=1   \n",
       "299           http://science.sciencemag.org/content/351/6277/1038.13?rss=1   \n",
       "300           http://science.sciencemag.org/content/351/6277/1038.15?rss=1   \n",
       "301              http://science.sciencemag.org/content/351/6277/1106?rss=1   \n",
       "302             http://science.sciencemag.org/content/351/6276/929.5?rss=1   \n",
       "303             http://science.sciencemag.org/content/351/6276/929.7?rss=1   \n",
       "304            http://science.sciencemag.org/content/351/6277/1036.1?rss=1   \n",
       "305            http://science.sciencemag.org/content/351/6277/1037.1?rss=1   \n",
       "306             http://science.sciencemag.org/content/351/6276/926.1?rss=1   \n",
       "307  http://feeds.nature.com/~r/nnano/rss/aop/~3/XowIhEJxxlg/nnano.2015...   \n",
       "308   http://feeds.nature.com/~r/nature/rss/current/~3/zsFrdcRqZSs/531S12a   \n",
       "\n",
       "         Score  \n",
       "0    21.571167  \n",
       "1    21.524228  \n",
       "2    21.267093  \n",
       "3    19.652238  \n",
       "4    17.089904  \n",
       "5    16.249902  \n",
       "6    14.911892  \n",
       "7    14.664494  \n",
       "8    14.487845  \n",
       "9    14.385625  \n",
       "10   14.331680  \n",
       "11   13.888268  \n",
       "12   13.400801  \n",
       "13   13.298458  \n",
       "14   13.252562  \n",
       "15   12.652021  \n",
       "16   12.087875  \n",
       "17   11.936096  \n",
       "18   11.513983  \n",
       "19   11.454099  \n",
       "20   11.442996  \n",
       "21   10.620315  \n",
       "22   10.551432  \n",
       "23   10.454383  \n",
       "24   10.440471  \n",
       "25   10.232374  \n",
       "26   10.222596  \n",
       "27   10.174632  \n",
       "28    9.828463  \n",
       "29    9.434851  \n",
       "..         ...  \n",
       "279   0.078620  \n",
       "280   0.073843  \n",
       "281   0.072514  \n",
       "282   0.064939  \n",
       "283   0.063331  \n",
       "284   0.063113  \n",
       "285   0.061512  \n",
       "286   0.060417  \n",
       "287   0.055920  \n",
       "288   0.055920  \n",
       "289   0.050328  \n",
       "290   0.050328  \n",
       "291   0.050328  \n",
       "292   0.042993  \n",
       "293   0.037284  \n",
       "294   0.037284  \n",
       "295   0.033894  \n",
       "296   0.033894  \n",
       "297   0.033894  \n",
       "298   0.030505  \n",
       "299   0.030505  \n",
       "300   0.030505  \n",
       "301   0.030505  \n",
       "302   0.030505  \n",
       "303   0.027116  \n",
       "304   0.000000  \n",
       "305   0.000000  \n",
       "306   0.000000  \n",
       "307   0.000000  \n",
       "308   0.000000  \n",
       "\n",
       "[309 rows x 3 columns]"
      ]
     },
     "execution_count": 9,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "tfidf_results = rss_articles.rank_all(train_data, vectorizer='tfidf')\n",
    "tfidf_results"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 2",
   "language": "python",
   "name": "python2"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 2
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython2",
   "version": "2.7.10"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 0
}