Brainstorming Topic

[ejcer]

This place is where we'll brainstorm everything

[ejcer]

Practice/Warm up/(not for actual project): https://www.kaggle.com/c/titanic

I'm actually really interested in this one, because of this: http://www.r2d3.us/visual-intro-to-machine-learning-part-1/

and this course actually used the titanic dataset during their decision tree lectures to determine who lives and dies and visualize it: https://www.coursera.org/course/datasci

I feel like it would be a good way to get a feel for how kaggle works

[student-rahul]

Great.. I'll check these out. My account is rahul@vt.edu

[ejcer]

This was posted on the project page: http://www.data.gov/

Inside you can find: http://www.data.gov/education/

in this we could find ways to see what factors impact the performance of students. For example, how much sleep they get, or if they have divorced parents or something of that sort, or how far they live from school

[ejcer]

We could use the presidential campaign data from here: https://www.quora.com/Jeff-Hammerbacher/Introduction-to-Data-Science-Data-Sets

to predict the presidential elections based on polling and how much money they raise for their campaign

[ejcer]

We could use the census data from here: http://aws.amazon.com/public-data-sets/

as a training set and see if a model we create is any good on future values

[ejcer]

Lol, the memetracker dataset from here: http://snap.stanford.edu/data/

[ejcer]

I would be interested in doing something business related. For example, what if we had a data set that included datapoints like the capital a business has on hand, and also a bunch of other factors. We could then model the growth rate of a business on it's other attributes, as well as, market factors, or possibly something funny like how many social media accounts post about it, or how much the business is talked about in the news

[student-rahul]

Yeah, I would like to do something which is business related. Though I am not sure if we can get that kind of financial data. Let's search for that first.

[ejcer]

going with the weather idea that you had, we could do weather + the effect it has on consumer spending vs the effect it has on online consumer spending

[ejcer]

Also, some notes on what we saw today: housing data, crime data, and agricultural production data

[ejcer]

Questions for Dr. Davanloo,
what ratio is he looking for in terms of modeling and visualization?

What external libraries is he looking for? I ask this, because if we're allowed to use an external library like this one: http://spacy.io/ to do the heavy lifting in terms of parsing language, then we might have an easier time using social media data. EX: http://qr.ae/RPhSZX
so like is a classification heavy modeling project okay is what I'm asking?
EX: a classifier to figure out what subreddit a reddit submission should go in:
https://www.reddit.com/r/datasets/top?sort=top&t=all

[ejcer]

The NOAA website has a tool that can extract between two periods of time daily data points http://www.ncdc.noaa.gov/cdo-web/search?datasetid=PRECIP_HLY#

Possibly use in combination with the yelp dataset to predict reviews based on weather conditions in that area

[ejcer]

http://www.huduser.gov/portal/datasets/hads/HADS_doc.pdf

http://www.huduser.gov/portal/datasets/hads/hads.html

[ejcer]

job market data

[ejcer]

transportation airline dataset:

http://stat-computing.org/dataexpo/2009/the-data.html