Master

.gitignore

@@ -5,3 +5,6 @@ node_modules
 03/js/survey.js
 
 xiaoyunver/ps-03/vendor/jquery.min.js
+*_config.json
+*.pyc
+twitter/client/

odonnel-p/ps-03/spreadsheet.js → 03/js/spreadsheet.js

@@ -11,6 +11,11 @@ window.loadSpreadsheet = function(spreadsheetID, parentCallback) {
   var version = "/1/public/values";
   var url =  baseUrl + spreadsheetID + version + callbackUrl;
 
+  // Google returns an array[] of ugly row objects
+  // Rows values are stored in row.content.$t, as {"columnName1: value1, columnName2: value2}
+  // mapValues turns one row value into an object that is easier to work with.
+  // The return row just looks like {column1: 'value1', column2: 'value2'}
+  // see the [lowdash documentation](https://lodash.com/docs)
   var mapValues = function(value) {
     var stringValues = _.trim(value.content.$t).split(',');
     var arrayValue = _.map(stringValues, function(s) {

03/ps03.html

@@ -31,7 +31,7 @@ <h3 id="reading-">Reading:</h3>
 <li>Anthropology: <a href="https://www.artsy.net/auction/the-algorithm-auction">code at auction</a></li>
 </ul>
 <h3 id="problems-">Problems:</h3>
-<p>On the first day of class, we created data using google spreadsheet survey&#39;s. I demonstrated a very simple and <a href="../survey.html">uninspired D3 plot</a> of our data. This week, I you will revise my work and create two new compositions.</p>
+<p>On the first day of class, we created data using google spreadsheet survey&#39;s. I demonstrated a very simple and <a href="./survey.html">uninspired D3 plot</a> of our data. This week, I you will revise my work and create two new compositions.</p>
 <p>Please choose two radically different approaches in your two solutions.</p>
 <p>Some Ideas: Are you going to show multiple values, or focus on just one? What is the smallest most efficient representation for this data? What is an abstract representation? A text only representation?</p>
 <p>Please create a new folder <code>&lt;username&gt;/ps-03/index.html</code> and have it point to each of your solutions for these problems (a,b):</p>

03/ps03.md

@@ -7,7 +7,7 @@ Concepts, Notations, Software, Art](http://www.netzliteratur.net/cramer/concepts
 * Anthropology: [code at auction](https://www.artsy.net/auction/the-algorithm-auction)
 
 ### Problems:
-On the first day of class, we created data using google spreadsheet survey's. I demonstrated a very simple and [uninspired D3 plot](../survey.html) of our data. This week, I you will revise my work and create two new compositions.
+On the first day of class, we created data using google spreadsheet survey's. I demonstrated a very simple and [uninspired D3 plot](./survey.html) of our data. This week, I you will revise my work and create two new compositions.
 
 Please choose two radically different approaches in your two solutions.
 

05/index.html

@@ -114,7 +114,7 @@ <h3 id="break-8-00-8-10">BREAK  8:00 - 8:10</h3>
 <h3 id="working-questions">Working &amp; Questions</h3>
 <p>Get started on modifications to your project proposal.</p>
 <h3 id="problem-set-05-">Problem set 05:</h3>
-<p>Project Proposal. Bring in 1 or 2 project proposals for next week.  Do the layout for both in HTML / CSS. The purpose of this proposal is to make us believe. It is acceptable at this phase to have large fake images (jpg?). Use &#39;click-handling&#39; fakery to give us a sense of the UI.</p>
+<p>Project Proposal. Bring in 1 or 2 project proposals for next week.  The purpose of this proposal is to make us believe. It is acceptable at this phase to have large fake images (jpg?). Use &#39;click-handling&#39; fakery to give us a sense of the UI if applicable.</p>
 <h2 id="snow-day-slack-links-">Snow Day Slack Links:</h2>
 <h2 id="items-from-last-week-">Items from last week:</h2>
 <ul>

05/index.md

@@ -83,7 +83,7 @@ We need to reschedule all our presentations. New schedule:
 Get started on modifications to your project proposal.
 
 ### Problem set 05:
-Project Proposal. Bring in 1 or 2 project proposals for next week.  Do the layout for both in HTML / CSS. The purpose of this proposal is to make us believe. It is acceptable at this phase to have large fake images (jpg?). Use 'click-handling' fakery to give us a sense of the UI.
+Project Proposal. Bring in 1 or 2 project proposals for next week.  The purpose of this proposal is to make us believe. It is acceptable at this phase to have large fake images (jpg?). Use 'click-handling' fakery to give us a sense of the UI if applicable.
 
 
 ## Snow Day Slack Links:

06/index.html

@@ -0,0 +1,118 @@
+<!doctype html>
+<html class="no-js" lang="">
+
+<head>
+    <meta charset="utf-8">
+    <meta http-equiv="X-UA-Compatible" content="IE=edge,chrome=1">
+    <title>IDV Studio 2</title>
+    <meta name="description" content="">
+    <meta name="viewport" content="width=device-width, initial-scale=1">
+    <link rel="apple-touch-icon" href="./img/apple-touch-icon.png">
+    <link href='https://fonts.googleapis.com/css?family=Source+Sans+Pro:400,700' rel='stylesheet' type='text/css'>
+    <link href='https://fonts.googleapis.com/css?family=Raleway:400' rel='stylesheet' type='text/css'>
+    <link rel="stylesheet" href="../css/normalize.min.css">
+    <link rel="stylesheet" href="../css/boilerplate.css">
+    <link rel="stylesheet" href="../css/main.css">
+    <script src="../js/vendor/jquery.min.js"></script>
+    <script src="../js/solutions.js"></script>
+</head>
+
+<body>
+    <div class="fixed-width">
+        <h1 id="class-06-feb-29-2016-">Class 06 –  Feb 29  2016:</h1>
+<h2 id="project-proposals">Project Proposals</h2>
+<p>For the next two weeks in and out of class we will be working towards our midterm prototypes. We have five weeks before our final projects are due. We will review our proposals in class, to determine a pragmatic approach to get us to great final projects.</p>
+<h3 id="scheduled-presentations-">Scheduled Presentations:</h3>
+<ul>
+<li>Feb 29: Lorzenzo, Sever, and Cara</li>
+<li>Mar 14: June and Andrew</li>
+<li>Mar 28: Kimi and Jiani</li>
+<li>Apr  4: Jessie and Patric</li>
+<li>Apr 11: Ryan and Navi</li>
+</ul>
+<h3 id="study-groups-">Study groups.</h3>
+<p>Everyone should be in a <strong>study group</strong>. Lets try to organize ~3-5 groups of people working on related topics.  Put the group name and member names on the baord.  We should make Slack channels for these groups.</p>
+<h4 id="does-an-online-idv2-makeup-class-work-for-people-tomorrow-">Does an online IDV2 makeup class work for people Tomorrow?</h4>
+<h3 id="presentations-from-lorzenzo-sever-and-cara">Presentations from Lorzenzo, Sever, and Cara</h3>
+<ul>
+<li><a href="http://www.theguardian.com/society/ng-interactive/2015/feb/05/-sp-watch-how-measles-outbreak-spreads-when-kids-get-vaccinated">measles vaccination - cara</a></li>
+</ul>
+<h4 id="the-flikr-search-api-and-data-explorer-">The Flikr SEARCH API and data explorer:</h4>
+<ul>
+<li><a href="https://www.flickr.com/services/api/explore/flickr.photos.search">search</a></li>
+<li><a href="https://www.flickr.com/services/api/flickr.photos.search.html">API Documentation</a></li>
+</ul>
+<h3 id="look-at-project-proposals-">Look at project proposals.</h3>
+<p>Identify intention.</p>
+<p>What phenomenon are you exploring? What features are you expecting to uncover? Who has done related work? If this work is narrative then What is the story you are trying to tell? If the work is editorial: What perspectives are you taking? what are the some alternate perspectives? If the objective is analytical: What is being measured? What is being ignored?</p>
+<p>Start with your ideal visual representation and work backwards towards the data. What would the data need to look like to implement your vision? Think about feature mapping. What features do you care the most about? How are they represented?</p>
+<p>Can you answer:</p>
+<ul>
+<li>Who cares? (iishi)</li>
+<li>Static vs. Interactive</li>
+<li>Exploratory vs. Narrative</li>
+<li>Anecdotal vs. Scientific</li>
+<li>Historic vs. Live</li>
+<li>Related works and precedent?</li>
+<li>Where and how will you publish?</li>
+</ul>
+<h4 id="work-in-class-and-problem-set-06-challenges-">Work in class and Problem Set 06: Challenges.</h4>
+<p>You will be expected to present some challenges in class next week. Your response can be PDF, Text, or Web page. After answering the questions, you prepare another revision of your design, addressing any concerns raised in class.</p>
+<ol>
+<li>Identify next steps in your project. Enumerate and prioritize what you need to complete your project. The biggest challenges and unknowns should be put at the top of the list.</li>
+<li>For each challenge spend 5-10 minutes thinking of a <em>plan-b</em>. Would you be able to rework your project? What would it look like with these change?</li>
+<li>For each challenge, can you identify someone in class, or a close friend outside of class who might be able to help?</li>
+<li>For each challenge, spend up to one hour doing initial research. Does the problem look solvable? What are the biggest &#39;pieces&#39; of the problem? Write down the online resources available to solve this problem.</li>
+</ol>
+<hr>
+<h4 id="questions-to-consider-">Questions to consider:</h4>
+<ul>
+<li>What kind of data are you exploring?<ul>
+<li>Where do you get it?</li>
+<li>What dimensions does it have?</li>
+<li>Is some data missing?</li>
+</ul>
+</li>
+<li>Framing:<ul>
+<li>Over what time period?</li>
+<li>Categorized by what?</li>
+<li>Sorted by what?</li>
+<li>Compared to what?</li>
+<li>Where / who?</li>
+<li>How much data do you have or care to work with?</li>
+<li>Can we &#39;dig in&#39; to find out more?</li>
+<li>Can this visualization be personalized or customized?</li>
+</ul>
+</li>
+</ul>
+<h4 id="data-capture-process-">Data capture process:</h4>
+<ul>
+<li>Collect Data (CSV, XML, JSON) from web services. Archive?</li>
+<li>Combine data (merge multiple records into one): Identify attributes you care about.<ul>
+<li>Add sentiment</li>
+<li>Add image tags</li>
+<li>Dig into responses, likes, retweets … &amp;etc.</li>
+</ul>
+</li>
+<li>Filter. Pluck. Summarize.</li>
+<li>Reshape. Make the data conform to your visualization needs.</li>
+<li>Display in a web browser.</li>
+</ul>
+<h4 id="previous-reading-watching-">Previous Reading / Watching:</h4>
+<ul>
+<li><a href="http://ed.ted.com/lessons/mapping-the-world-with-twitter-jer-thorp">Visualizing the world&#39;s Twitter data – Jer thorp</a></li>
+<li><a href="https://www.mapbox.com/blog/visualizing-3-billion-tweets/">Visualizing 3 billion tweets</a></li>
+<li><a href="https://www.ted.com/talks/blaise_aguera_y_arcas_demos_photosynth?language=en">Microsoft PhotoSynth Ted talk</a></li>
+<li>Read this recent paper by danah boyd. <a href="http://www.danah.org/papers/talks/2015/ParkerLecture.html">What World Are We Building?</a> - danah has been researching online behavior and critiquing social media for more than 10 years. Her primary concern is about online youth, but her work is generally applicable.</li>
+<li>Lev Mannovich has been doing interesting experiments with large volumes of instagram images. See for example <a href="http://manovich.net/index.php/projects/hours-in-kiev-copy">The Exceptional and the Everyday: 144 hours in Kyiv</a></li>
+<li>TODO: Help me review this <a href="http://www.cs.nyu.edu/faculty/davise/papers/BigDataBib.html">big list of recommended journal articles on Big Data</a>. A few papers and sections may be of interest, though I have not vetted any of them yet:</li>
+<li><a href="http://qz.com/279139/the-17-best-bots-on-twitter/">Twitter Bots</a>, especially bots that make images.</li>
+<li><a href="http://www.theguardian.com/artanddesign/2015/may/27/suicide-girls-richard-prince-copying-instagram">Richard Price and the Suicide Grils</a></li>
+<li>[Images, privacy and the abuse(<a href="http://www.nytimes.com/2010/08/12/technology/personaltech/12basics.html?_r=0">http://www.nytimes.com/2010/08/12/technology/personaltech/12basics.html?_r=0</a>) of <a href="https://en.wikipedia.org/wiki/Exchangeable_image_file_format">exif data</a>.</li>
+</ul>
+
+        <div id="dynamic-content"></div>
+    </div>
+</body>
+
+</html>

06/index.md

@@ -0,0 +1,107 @@
+# Class 06 –  Feb 29  2016:
+
+## Project Proposals
+
+For the next two weeks in and out of class we will be working towards our midterm prototypes. We have five weeks before our final projects are due. We will review our proposals in class, to determine a pragmatic approach to get us to great final projects.
+
+
+### Scheduled Presentations:
+* Feb 29: Lorzenzo, Sever, and Cara
+* Mar 14: June and Andrew
+* Mar 28: Kimi and Jiani
+* Apr  4: Jessie and Patric
+* Apr 11: Ryan and Navi
+
+### Study groups.
+Everyone should be in a **study group**. Lets try to organize ~3-5 groups of people working on related topics.  Put the group name and member names on the baord.  We should make Slack channels for these groups.
+
+#### Does an online IDV2 makeup class work for people Tomorrow?
+
+### Presentations from Lorzenzo, Sever, and Cara
+* [measles vaccination - cara](http://www.theguardian.com/society/ng-interactive/2015/feb/05/-sp-watch-how-measles-outbreak-spreads-when-kids-get-vaccinated)
+
+
+#### The Flikr SEARCH API and data explorer:
+* [search](https://www.flickr.com/services/api/explore/flickr.photos.search)
+* [API Documentation](https://www.flickr.com/services/api/flickr.photos.search.html)
+
+### Look at project proposals.
+
+Identify intention.
+
+What phenomenon are you exploring? What features are you expecting to uncover? Who has done related work? If this work is narrative then What is the story you are trying to tell? If the work is editorial: What perspectives are you taking? what are the some alternate perspectives? If the objective is analytical: What is being measured? What is being ignored?
+
+Start with your ideal visual representation and work backwards towards the data. What would the data need to look like to implement your vision? Think about feature mapping. What features do you care the most about? How are they represented?
+
+Can you answer:
+* Who cares? (iishi)
+* Static vs. Interactive
+* Exploratory vs. Narrative
+* Anecdotal vs. Scientific
+* Historic vs. Live
+* Related works and precedent?
+* Where and how will you publish?
+
+
+#### Work in class and Problem Set 06: Challenges.
+You will be expected to present some challenges in class next week. Your response can be PDF, Text, or Web page. After answering the questions, you prepare another revision of your design, addressing any concerns raised in class.
+
+1. Identify next steps in your project. Enumerate and prioritize what you need to complete your project. The biggest challenges and unknowns should be put at the top of the list.
+2. For each challenge spend 5-10 minutes thinking of a _plan-b_. Would you be able to rework your project? What would it look like with these change?
+3. For each challenge, can you identify someone in class, or a close friend outside of class who might be able to help?
+4. For each challenge, spend up to one hour doing initial research. Does the problem look solvable? What are the biggest 'pieces' of the problem? Write down the online resources available to solve this problem.
+
+
+------
+
+#### Questions to consider:
+* What kind of data are you exploring?
+    * Where do you get it?
+    * What dimensions does it have?
+    * Is some data missing?
+* Framing:
+    * Over what time period?
+    * Categorized by what?
+    * Sorted by what?
+    * Compared to what?
+    * Where / who?
+    * How much data do you have or care to work with?
+    * Can we 'dig in' to find out more?
+    * Can this visualization be personalized or customized?
+
+#### Data capture process:
+* Collect Data (CSV, XML, JSON) from web services. Archive?
+* Combine data (merge multiple records into one): Identify attributes you care about.
+    * Add sentiment
+    * Add image tags
+    * Dig into responses, likes, retweets … &etc.
+* Filter. Pluck. Summarize.
+* Reshape. Make the data conform to your visualization needs.
+* Display in a web browser.
+
+
+#### Previous Reading / Watching:
+
+* [Visualizing the world's Twitter data – Jer thorp](http://ed.ted.com/lessons/mapping-the-world-with-twitter-jer-thorp)
+* [Visualizing 3 billion tweets](https://www.mapbox.com/blog/visualizing-3-billion-tweets/)
+* [Microsoft PhotoSynth Ted talk](https://www.ted.com/talks/blaise_aguera_y_arcas_demos_photosynth?language=en)
+* Read this recent paper by danah boyd. [What World Are We Building?](http://www.danah.org/papers/talks/2015/ParkerLecture.html) - danah has been researching online behavior and critiquing social media for more than 10 years. Her primary concern is about online youth, but her work is generally applicable.
+* Lev Mannovich has been doing interesting experiments with large volumes of instagram images. See for example [The Exceptional and the Everyday: 144 hours in Kyiv](http://manovich.net/index.php/projects/hours-in-kiev-copy)
+* TODO: Help me review this [big list of recommended journal articles on Big Data](http://www.cs.nyu.edu/faculty/davise/papers/BigDataBib.html). A few papers and sections may be of interest, though I have not vetted any of them yet:
+* [Twitter Bots](http://qz.com/279139/the-17-best-bots-on-twitter/), especially bots that make images.
+* [Richard Price and the Suicide Grils](http://www.theguardian.com/artanddesign/2015/may/27/suicide-girls-richard-prince-copying-instagram)
+* [Images, privacy and the abuse(http://www.nytimes.com/2010/08/12/technology/personaltech/12basics.html?_r=0) of [exif data](https://en.wikipedia.org/wiki/Exchangeable_image_file_format).
+
+
+
+
+
+
+
+
+
+
+
+
+
+