Context-Strategy for Context Bandits to handle large number of arms

[aicherc]

Bandit:

• Now needs to return a fixed context of arm
• State of world

Strategy: Streaming Regression on Arms

• Linear Regression
• Logistic Regression