-
Notifications
You must be signed in to change notification settings - Fork 1
/
Copy pathrss.xml
64 lines (61 loc) · 13.2 KB
/
rss.xml
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
<?xml version="1.0" encoding="utf-8"?>
<?xml-stylesheet type="text/xsl" href="assets/xml/rss.xsl" media="all"?><rss version="2.0" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Tanya Schlusser</title><link>https://tanyaschlusser.github.io/</link><description>Data-related analyses, tools, and news.</description><atom:link href="https://tanyaschlusser.github.io/rss.xml" rel="self" type="application/rss+xml"></atom:link><language>en</language><copyright>Contents © 2019 <a href="mailto:[email protected]">Tanya Schlusser</a> </copyright><lastBuildDate>Tue, 08 Jan 2019 06:13:15 GMT</lastBuildDate><generator>Nikola (getnikola.com)</generator><docs>http://blogs.law.harvard.edu/tech/rss</docs><item><title>What's so great about Knime?</title><link>https://tanyaschlusser.github.io/posts/whats-so-great-about-knime/</link><dc:creator>Tanya Schlusser</dc:creator><description><div><p>Last March, (for the fifth time, according to
<a href="https://www.forestgt.com.au/latest-news/2018/3/2/knime-2018-gartner-magic-quadrant-market-leader">Forest Grove Technology</a>),
the <a href="https://www.knime.com/">Knime Analytics platform</a> was named a Gartner Magic Quadrant
leader. This year's other leaders are <a href="https://www.alteryx.com/">Alteryx</a>,
<a href="https://www.sas.com/">SAS</a>, <a href="https://rapidminer.com/">RapidMinder</a>,
and <a href="https://www.h2o.ai/">H2Oai</a>.
The best thing I learned from the announcement? Knime is open source,
and free for individual users—I can afford to look at it!</p>
<p>Knime (silent "k"; rhymes with "dime") provides a graphical user interface
to chain together blocks that represent steps in a data science workflow.
(So they're like Pentaho or Informatica but for machine learning.
Or <a href="http://www.ni.com/en-us/shop/labview.html">LabView</a> if you have an
engineering background.)</p>
<p>It has dozens of built-in data access and transformation functions,
statistical inference and machine learning algorithms,
<a href="https://sourceforge.net/projects/pmml/">PMML</a>,
and custom <a href="https://www.knime.com/blog/blending-knime-and-python">Python</a>,
<a href="https://www.knime.com/nodeguide/scripting/java/example-of-java-snippet">Java</a>,
<a href="https://www.knime.com/nodeguide/scripting/r/example-of-r-snippet">R</a>,
<a href="https://informationentropy.wordpress.com/2016/03/24/programming-nodes-in-knime-with-scala-part-i/">Scala</a>,
a <a href="https://www.knime.com/nodeguide">zillion other nodes</a>,
or other community plugins (since it's open source, anyone can
<a href="https://www.knime.com/developer/example/extension-wizard">make a plugin</a>.)
Even better, Knime imposes structure and modularity
on a data science workflow by requiring code fit into specified building blocks.</p>
<p>This post implements the Bayesian NFL model from
<a href="https://tanyaschlusser.github.io/posts/bayesian-updating-and-the-nfl/">last month</a>
in Knime.
It adds the upstream and downstream workflows to pull new data each week and
write the model output to a spreadsheet: enough for a first look at this tool.</p>
<p><a href="https://tanyaschlusser.github.io/posts/whats-so-great-about-knime/">Read more</a> (14 min remaining to read)</p></div></description><category>data science</category><category>knime</category><category>mathjax</category><category>python</category><category>workflow</category><guid>https://tanyaschlusser.github.io/posts/whats-so-great-about-knime/</guid><pubDate>Tue, 08 Jan 2019 05:00:42 GMT</pubDate></item><item><title>Bayesian updating and the NFL</title><link>https://tanyaschlusser.github.io/posts/bayesian-updating-and-the-nfl/</link><dc:creator>Tanya Schlusser</dc:creator><description><figure><img src="https://tanyaschlusser.github.io/posts/bayesian-updating-and-the-nfl/home_spreads.png"></figure> <div tabindex="-1" id="notebook" class="border-box-sizing">
<div class="container" id="notebook-container">
<div class="cell border-box-sizing text_cell rendered"><div class="prompt input_prompt">
</div>
<div class="inner_cell">
<div class="text_cell_render border-box-sizing rendered_html">
<p>It's football season again, hooray! Every year for my friends' football pool I try out a different algorithm. Invariably, my picks are around 60% accurate. Not terrible, but according to NFL Pickwatch (<a href="https://web.archive.org/web/20180811195907/http://nflpickwatch.com/">archive</a>, <a href="https://nflpickwatch.com/">current season</a>), the best pickers get to 68 or 69%. So, an amazing performance—my upper bound—is just under 70%, and the lower bound for a competitive model—the FiveThirtyEight baseline—is 60%.</p>
<p>I've been modeling NFL outcomes for a couple of years, and running linear (predicting point spread) and logistic (predicting win probability) regressions given various team and player data. My best year so far incorporated the Vegas spread into the model, and my biggest disaster so far was an aggressive lasso model on every player in every offensive line, with team defenses lumped as a group. Attempting to track <a href="https://www.pro-football-reference.com/players/injuries.htm">injuries</a>, suspensions, and other changes to the starting lineup was not sustainable for the amount of time I wanted to spend.</p>
<p>Enter Nate Silver's awesome <span class="vocabulary" title="Arpad Elo was a Hungarian-American physics professor who invented the system to rank chess players. Silver adapted it for Football, baseball, and most of the other sports on FiveThirtyEight."><a href="https://fivethirtyeight.com/features/how-our-2017-nfl-predictions-work/">NFL Elo rankings</a></span>, the aspirational target for this year. What's impressive is that he gets something like 60% accuracy out of literally no information but home field advantage and past scores. I particularly love that it updates weekly to incorporate the new information—this immediately says "Bayesian" and in fact is a lot how people using their intuition are making their picks anyway. A system like his—but with a more straightforward Bayesian model—is the goal of this post.</p>
<p><a href="https://tanyaschlusser.github.io/posts/bayesian-updating-and-the-nfl/">Read more</a> (25 min remaining to read)</p></div></div></div></div></div></description><category>a/b testing</category><category>bayesian</category><category>feature engineering</category><category>iterative</category><category>nfl</category><guid>https://tanyaschlusser.github.io/posts/bayesian-updating-and-the-nfl/</guid><pubDate>Sun, 09 Sep 2018 05:00:42 GMT</pubDate></item><item><title>Modeling property tax assessment in Cook County, IL</title><link>https://tanyaschlusser.github.io/posts/property-tax-cook-county/</link><dc:creator>Tanya Schlusser</dc:creator><description><figure><img src="https://tanyaschlusser.github.io/posts/property-tax-cook-county/log_fit.png"></figure> <div tabindex="-1" id="notebook" class="border-box-sizing">
<div class="container" id="notebook-container">
<div class="cell border-box-sizing text_cell rendered"><div class="prompt input_prompt">
</div>
<div class="inner_cell">
<div class="text_cell_render border-box-sizing rendered_html">
<p>The year my Mom moved in down the street from us, my husband tried to get some local property tax appeal company to reduce her assessment. They refused, saying they thought there wasn't a case.</p>
<p>The next year, she got a postcard from that same company: they would appeal her case and split the savings with her 50/50. Who wants to give up 50% of their tax savings? Plus, I was miffed from the prior year. I decided to try and appeal myself. Success!</p>
<p><span class="vocabulary" title="A tool for automated testing of web applications, written in Java. I use the Python bindings."><a href="https://selenium-python.readthedocs.io/">Selenium</a></span> via Python bindings was used to pull the data from the web, and <a href="https://www.statsmodels.org">statsmodels</a>, with an interface that resembles R, was used to make the model.
</p><p><a href="https://tanyaschlusser.github.io/posts/property-tax-cook-county/">Read more</a> (29 min remaining to read)</p></div></div></div></div></div></description><category>civic data</category><category>selenium</category><category>taxes</category><guid>https://tanyaschlusser.github.io/posts/property-tax-cook-county/</guid><pubDate>Sun, 19 Aug 2018 05:00:42 GMT</pubDate></item><item><title>MCMC and the Ising Model</title><link>https://tanyaschlusser.github.io/posts/mcmc-and-the-ising-model/</link><dc:creator>Tanya Schlusser</dc:creator><description><figure><img src="https://tanyaschlusser.github.io/posts/mcmc-and-the-ising-model/spins.png"></figure> <div tabindex="-1" id="notebook" class="border-box-sizing">
<div class="container" id="notebook-container">
<div class="cell border-box-sizing text_cell rendered"><div class="prompt input_prompt">
</div>
<div class="inner_cell">
<div class="text_cell_render border-box-sizing rendered_html">
<p><span class="vocabulary" title="A sequence of statistical outcomes in which each step is statistically independent from all of the prior steps.">Markov-Chain</span>
<span class="vocabulary" title="A computer simulation technique using pseudo-random numbers to simulate random events.">Monte Carlo</span> (MCMC) methods are a category of numerical technique used in Bayesian statistics. They numerically estimate the distribution of a variable (the <span class="vocabulary" title="The prior times the likelihood, normalized, is the posterior distribution: the probability distribution of the target variable after incorporating the observed data.">posterior</span>) given two other distributions: the <span class="vocabulary" title="A distribution that represents existing knowledge of a system. Often people choose a uniform (flat) distribution; or else something that is the known conjugate prior of a desired posterior distribution.">prior</span> and the <span class="vocabulary" title="A special name for the probability mass (or density) function when you fix the random variable (e.g. `x`) and integrate over the parameters (e.g. `mu` and `theta`). It's renamed 'likelihood' just to make that swap explicit when talking about it. The integral over the parameters may not equal one so you have to normalize.">likelihood function</span>, and are useful when direct integration of the likelihood function is not tractable.</p>
<p>I am new to Bayesian statistics, but became interested in the approach partly from exposure to the <a href="https://tanyaschlusser.github.io/posts/mcmc-and-the-ising-model/">PyMC3 library</a>, and partly from FiveThirtyEight's promoting it in a <a href="https://fivethirtyeight.com/features/statisticians-found-one-thing-they-can-agree-on-its-time-to-stop-misusing-p-values/">commentary</a> soon after the time of the p-hacking scandals a few years back (<a href="https://www.ncbi.nlm.nih.gov/pubmed/22006061">Simmons et. al.</a> coin 'p-hacking' in 2011, and <a href="https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4359000">Head et. al.</a> quantify the scale of the issue in 2014).</p>
<p>Until the 1980's, it was not realistic to use Bayesian techniques except when analytic solutions were possible. (Here's Wikipedia's <a href="https://en.wikipedia.org/wiki/Conjugate_prior#Table_of_conjugate_distributions">list of analytic options</a>. They're still useful.) MCMC opens up more options.</p>
<p>The Python library <a href="https://docs.pymc.io/">pymc3</a> provides a suite of modern Bayesian tools: both MCMC algorithms and variational inference. One of its core contributors, Thomas Wiecki, wrote a blog post entitled <a href="https://twiecki.github.io/blog/2015/11/10/mcmc-sampling/">MCMC sampling for dummies</a>, which was the inspiration for this post. It was enthusiastically received, and cited by people I follow as the best available explanation of MCMC. To my dismay, I didn't understand it; probably because he comes from a stats background and I come from engineering. This post is for people like me.</p>
<p><a href="https://tanyaschlusser.github.io/posts/mcmc-and-the-ising-model/">Read more</a> (24 min remaining to read)</p></div></div></div></div></div></description><category>bayesian</category><category>mcmc</category><category>pymc3</category><guid>https://tanyaschlusser.github.io/posts/mcmc-and-the-ising-model/</guid><pubDate>Sun, 29 Jul 2018 05:00:42 GMT</pubDate></item></channel></rss>