Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
54 commits
Select commit Hold shift + click to select a range
a5280fb
first commit, copying most of a3 over as js/css/etc framework. lot to do
hcaouette Sep 25, 2019
551352e
stripping a3 down to build a4
hcaouette Sep 26, 2019
8b6a7e0
trying to setup linter
hcaouette Sep 26, 2019
5b25365
index
hcaouette Sep 26, 2019
bc5d970
testing web audio api example on glitch
hcaouette Sep 26, 2019
7be20b0
moved script in body to scripts.js
hcaouette Sep 26, 2019
31093ce
adding ytdl (youtube downloader) to server to process link to yt vid
hcaouette Sep 26, 2019
6927ee6
morgan declare
hcaouette Sep 26, 2019
04fca2e
change
hcaouette Sep 27, 2019
7c081e3
index
hcaouette Sep 27, 2019
7445478
js
hcaouette Sep 27, 2019
1977e83
sorting out index
hcaouette Sep 27, 2019
682a28d
index
hcaouette Sep 27, 2019
f5fce68
dat.gui
hcaouette Sep 27, 2019
38662f1
gui in head
hcaouette Sep 27, 2019
29d0486
index
hcaouette Sep 27, 2019
523797a
styles
hcaouette Sep 27, 2019
8838315
adding build folder of dat.gui to dir. hoping this fixes
hcaouette Sep 29, 2019
9473930
adding files was dumb. found a cdn
hcaouette Sep 29, 2019
1af2311
retrying adding files
hcaouette Sep 29, 2019
be1c83c
trying to show gui
hcaouette Sep 29, 2019
5fea76e
moving build
hcaouette Sep 29, 2019
4701a39
js in head
hcaouette Sep 29, 2019
e8cb2ce
trying stuff
hcaouette Sep 29, 2019
f02c239
index change
hcaouette Sep 29, 2019
4576512
removed lib
hcaouette Sep 29, 2019
854734c
glitch changes
hcaouette Sep 29, 2019
7903bac
submit yt might work now
hcaouette Sep 30, 2019
e44beb4
script runs maybe
hcaouette Sep 30, 2019
a9f1fdc
plays youtube videos. hallelujah
hcaouette Sep 30, 2019
3236634
changed dat implementation
hcaouette Sep 30, 2019
722fefb
modularized
hcaouette Sep 30, 2019
87b2a0a
pckg
hcaouette Sep 30, 2019
5ccc811
npm your reqs
hcaouette Sep 30, 2019
7deafba
dont break stuff
hcaouette Sep 30, 2019
5bfd4e0
package?
hcaouette Sep 30, 2019
b7f37fb
pkg
hcaouette Sep 30, 2019
78b40c4
pkg
hcaouette Sep 30, 2019
cb48499
bundlejs file
hcaouette Sep 30, 2019
7d9015d
modules hard
hcaouette Sep 30, 2019
ede3a55
modules hard
hcaouette Sep 30, 2019
3a4e509
packages & audio work now
hcaouette Sep 30, 2019
ce2e6e1
breaking up the audio stream
hcaouette Sep 30, 2019
8e05b59
globals need defs
hcaouette Sep 30, 2019
e0f2e19
const->let
hcaouette Sep 30, 2019
7e73694
and the bundle, too
hcaouette Sep 30, 2019
8a838ee
drawing?
hcaouette Sep 30, 2019
16ac0e5
script calling canvas methods
hcaouette Sep 30, 2019
c1216fa
lovin it
hcaouette Sep 30, 2019
6418736
improved bar graph
hcaouette Sep 30, 2019
ae63bea
readme
hcaouette Sep 30, 2019
ae04e4b
finishing touches, including explanation pane
hcaouette Sep 30, 2019
ce7f5d9
salmon
hcaouette Sep 30, 2019
62b1f28
added some classics for recommendations
hcaouette Sep 30, 2019
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
*.DS_Store
node_modules/
70 changes: 11 additions & 59 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,70 +3,22 @@ Assignment 4 - Creative Coding: Interactive Multimedia Experiences

Due: September 27th, by 11:59 PM.

For this assignment we will focus on client-side development using popular audio/graphics/visualization technologies; the server requirements are minimal. The goal of this assignment is to refine our JavaScript knowledge while exploring the multimedia capabilities of the browser.
Professor Roberts gave me, Hunter Caouette, a penalty-free extension for the weekend. If you have any questions please reach out to me and/or Professor Roberts.

Baseline Requirements
---

Your application is required to implement the following functionalities:
## creative coding -- a4-hcaouette -- CS4241 Assignment 4

- A server created using Express (you can also use an alternative server framework such as Koa) for basic file delivery and middleware. Your middleware stack should include the `compression` and `helmet` [middlewares]((https://expressjs.com/en/resources/middleware.html)) by default. You are not required to use Glitch for this assignment (but using Glitch is fine!); [Heroku](https://www.heroku.com) is another excellent option to explore. The course staff can't be resposible for helping with all other hosting options outside of Glitch, but some of us do have experience with other systems. It also never hurts to ask on Slack, as there's 99 other classmates who might have the experience you're looking for!
- A client-side interactive experience using at least one of the web technologies frameworks we discussed in class over the past week.
- [Three.js](https://threejs.org/): A library for 3D graphics / VR experiences
- [D3.js](https://d3js.org): A library that is primarily used for interactive data visualizations
- [Canvas](https://developer.mozilla.org/en-US/docs/Web/API/Canvas_API): A 2D raster drawing API included in all modern browsers
- [SVG](https://developer.mozilla.org/en-US/docs/Web/API/Canvas_API): A 2D vector drawing framework that enables shapes to be defined via XML.
- [Web Audio API](https://developer.mozilla.org/en-US/docs/Web/API/Web_Audio_API): An API for audio synthesis, analysis, processing, and file playback.
- A user interface for interaction with your project, which must expose at least six parameters for user control. [dat.gui](https://workshop.chromeexperiments.com/examples/gui/#1--Basic-Usage) is highly recommended for this. You might also explore interaction by tracking mouse movement via the `window.onmousemove` event handler in tandem with the `event.clientX` and `event.clientY` properties. Consider using the [Pointer Events API](https://developer.mozilla.org/en-US/docs/Web/API/Pointer_events) to ensure that that mouse and touch events will both be supported in your app.
- Your application should display basic documentation for the user interface when the application first loads. This documentation should be dismissable, however, users should be able to redisplay it via either a help buton (this could, for example, be inside a dat.gui interface) or via a keyboard shortcut (commonly the question mark).
- Your application should feature at least two different ES6 modules that you write ([read about ES6 modules](https://www.sitepoint.com/understanding-es6-modules/)) and include into a main JavaScript file. This means that you will need to author *at least three JavaScript files* (a `app.js` or `main.js` file and two modules). We'll discuss modules in class on Monday 9/23; for this assignment modules should contain at least two functions.
- You are required to use a linter for your JavaScript. There are plugins for most IDEs, however it will be difficult to run the linter directly in Glitch. If you haven't moved to developing on your personal laptop and then uploading to Glitch when your project is completed, this is the assignment to do so!
- Your HTML and CSS should validate. There are options/plugins for most IDEs to check validation.
http://a4-hcaouette.glitch.me

The interactive experience should possess a reasonable level of complexity. Some examples:
### Three.js
- A generative algorithm creates simple agents that move through a virtual world. Your interface controls the behavior / appearance of these agents.
- A simple 3D game
- An 3D audio visualization of a song of your choosing. User interaction should control aspects of the visualization.
### Canvas
- Implement a generative algorithm such as [Conway's Game of Life](https://bitstorm.org/gameoflife/) (or 1D cellular automata) and provide interactive controls. Note that the Game of Life has been created by 100s of people using <canvas>; we'll be checking to ensure that your implementation is not a copy of these.
- Design a 2D audio visualizer of a song of your choosing. User interaction should control visual aspects of the experience.
### Web Audio API
- Create a screen-based musical instrument using the Web Audio API. You can use projects such as [Interface.js](http://charlie-roberts.com/interface/) or [Nexus UI](https://nexus-js.github.io/ui/api/#Piano) to provide common musical interface elements, or use dat.GUI in combination with mouse/touch events (use the Pointer Events API). Your GUI should enable users to control aspects of sound synthesis.
### D3.js
- Create visualizations using the datasets found at [Awesome JSON Datasets](https://github.com/jdorfman/Awesome-JSON-Datasets). Experiment with providing different visualizations of the same data set, and providing users interactive control over visualization parameters and/or data filtering. Alternatively, create a single visualization with using one of the more complicated techniques shown at [d3js.org](d3js.org) and provide meaningful points of interaction for users.

Deliverables
---

Do the following to complete this assignment:

1. Implement your project with the above requirements.
3. Test your project to make sure that when someone goes to your main page on Glitch/Heroku/etc., it displays correctly.
4. Ensure that your project has the proper naming scheme `a4-yourname` so we can find it.
5. Fork this repository and modify the README to the specifications below. *NOTE: If you don't use Glitch for hosting (where we can see the files) then you must include all project files that you author in your repo for this assignment*.
6. Create and submit a Pull Request to the original repo. Name the pull request using the following template: `a4-gitname-firstname-lastname`.

Sample Readme (delete the above when you're ready to submit, and modify the below so with your links and descriptions)
---

## Your Web Application Title

your hosting link e.g. http://a4-charlieroberts.glitch.me

Include a very brief summary of your project here. Images are encouraged, along with concise, high-level text. Be sure to include:

- the goal of the application
- challenges you faced in realizing the application
- a brief description of the JS linter you used and what rules it follows (we'll be looking at your JS files for consistency)
-The goal of my application was to create a fun, interactive visual to accompany music, inspired by the deprecated smoke particles effect google music used to have for the browser application. (look it up, it was way cooler than just having album art).
- I had a lot of challenges with implementing just about every part of this project. I only really just figured out the bulk of it towards the end; you can check out the commit history if you want. setting up modules was hard, getting dat.gui to work at all was hard, figuring out how to use the web audio api to process music was hard.
- I tried to use the eslinter plugin for Atom, version 8.5.0, but I'm not sure that it was 100% effective in checking my code. I used similar linter plugins for my css and html as well, to similar results. My best guess is that using a different IDE, at least, would improve my linting experience, but it shouldnt be too bad as is.

## Technical Achievements
- **Tech Achievement 1**: I wrote my own custom GLSL shaders to use as a material for my Three.js objects.
- **Tech Achievement 2**: My audiovisualizer uses both FFT and amplitude analysis to drive visualization.
- **Tech Achievement 3**: I optimized the efficiency of my reaction-diffusion algorithm by...
- **Tech Achievement 4**: I visualized the dataset X using three different visualization technqiues provided by D3, andprovided
- **Tech Achievement 1**: I used the ytdl-core middleware to take a youtube video and pipe it to the client for processing.
- **Tech Achievement 2**: My app uses html canvas and the web audio api to create an audiovisual experience that can be tweaked with dat.gui.
- **Tech Achievement 3**: I implemented both a sine-wave visualization and a bar-graph type visualization, which can be selected in the dat.gui control.

### Design/Evaluation Achievements
- **Design Achievement 1**: I ensured that my application would run on both desktops / mobile devices by changing X
- **Design Achievement 2**: I followed best practices for accessibility, including providing alt attributes for images and using semantic HTML. There are no `<div>` or `<span>` elements in my document.
- **Design Achievement 3**: We tested the application with n=X users, finding that...
- **Design Achievement 1**: the backdrop of the graphs is the RGB inverse of the graph line/bar color, making for a high-contrast graph, at all times.
- If you have any questions about the color palette, I really liked the shade of blue green, tried the 255-R,G,B values and found it too pale, and then recalled one of the great universal truths. https://imgur.com/gallery/ZsZ0j.
Loading