Skip to content

Refactor datahandlers#31

Open
Benjamintdk wants to merge 167 commits intoorcasound:masterfrom
Benjamintdk:refactor-datahandlers
Open

Refactor datahandlers#31
Benjamintdk wants to merge 167 commits intoorcasound:masterfrom
Benjamintdk:refactor-datahandlers

Conversation

@Benjamintdk
Copy link
Copy Markdown
Collaborator

@Benjamintdk Benjamintdk commented Jul 18, 2022

Changes made

  • Created data handlers to handle AWS and local data separately
  • Set up config files to dynamically create the appropriate data handlers at run time
  • Refactored the code to use variables from the config files instead.

Benjamintdk and others added 30 commits March 27, 2022 11:32
@Benjamintdk
added back imports to app and resolved environment variables loading …
ec91d96 
…in conftest
@Benjamintdk
fixed line too long linting issue
f5ca8e3
@Benjamintdk
updated requirements.txt files to fix failing dependencies in Docker …
7561a77 
…environment, and changed webpack config for webapp docker deployment
@Benjamintdk
added dockerignore files for each directory
5884ae3
@Benjamintdk
initial commit for prod compose file
bf956e2
@Benjamintdk
added requirements.in
004546d
@Benjamintdk
resolved flaskd dependency issues
ced678a
@Benjamintdk
refactor test to test getStatistics endpoint first to unlock database…
4f442e6 
… lock
@Benjamintdk
tested cypress webpack testing config in docker-compose setup
ad7cda7
@Benjamintdk
finished docker compose v1 for test
c33c86c
@Benjamintdk
refactored the docker-compose test file a bit
98c1db4
@Benjamintdk
tested ml-endpoint for docker-compose.dev
69e210e
@Benjamintdk
finished dev and test docker-compose files
7a665f8
@Benjamintdk
updated readme for docker compose
3f7f7a4
@Benjamintdk
First test of GH Actions with docker compose up
a276346
@Benjamintdk
Update dockerized-tests.yml
5e20748
@Benjamintdk
made some changes to the docker-compose test file
0e0b0f5
@Benjamintdk
Update dockerized-tests.yml
f17c391 
Trying docker dev first to see if there are any issues with networking or starting containers
@Benjamintdk
Update dockerized-tests.yml
3b4f4d7 
Removed verbose flag
@Benjamintdk
Update docker-compose.dev.yml
da3993a 
Removing health check and dependency to hopefully get more logs
@Benjamintdk
Update Dockerfile
f963b3c
@Benjamintdk
Update train.py
4c7eb0a
@Benjamintdk
Update train.py
6248721
@Benjamintdk
Update dockerized-tests.yml
be033ba
@Benjamintdk
Update train.py
7087a0e
@Benjamintdk
Update train.py
7e5c5e7
@Benjamintdk
Update train.py
c0f6d5c 
Trying to add in region to solve the issue
@Benjamintdk
Update train.py
9872b30
@Benjamintdk
Update docker-compose.dev.yml
397e4c4
@Benjamintdk
Update docker-compose.dev.yml
c806414
Benjamintdk added 28 commits May 16, 2022 13:49
@Benjamintdk
refactored docker files to account for changes in requirements.txt an…
264cf0f 
…d compress images
@Benjamintdk
adding preliminary pre-commit-config and setup cfg files for python
677bf4c
@Benjamintdk
linting and formatting done for python side
6010425
@Benjamintdk
rerun formatting and changed testing workflow to run as well
26b8e44
@Benjamintdk
add cypress linting
cf17eff
@Benjamintdk
cleaned up pre commit config yaml file
201852f
@Benjamintdk
cleaned up some unnecessary files and changes
a2df3aa
@Benjamintdk
Merge branch 'dockerized-tests' into docker-compose-for-dev
6a3da98
@Benjamintdk
Merge branch 'docker-compose-for-dev' into lint-and-format
d9a2d62
@Benjamintdk
refactored linting and testing under one GH Action
671a26b
@Benjamintdk
refactored linting and testing under one GH Action
770b589
@Benjamintdk
refactored GH Actions further by changing run conditions
839f167
@Benjamintdk
Merge branch 'lint-and-format' into refactor-datahandlers
5941864
@Benjamintdk
refactored all code to exclusively use static class data handlers
d24150f
@Benjamintdk
removing AWS secrets and keys, and adding utils volume mounts in dock…
5507d7b 
…er compose test
@Benjamintdk
refactored CI tests into frontend and backend separately
d9364df
@Benjamintdk
created config files for both services using datahandlers
00d7ee0
@Benjamintdk
added in cleaning up of docker compose in github action
973e32a
@Benjamintdk
cleaning up some commented out code
b36100a
@Benjamintdk
trying out refactoring of datahandlers with config files on api side
e8fb52e
@Benjamintdk
refactoring api to use config file instead
0f41760
@Benjamintdk
refactored ml endpoint service to use config file
8b9bfba
@Benjamintdk
fixing backend tests
a92d3c5
@Benjamintdk
refactored variable names to be more generic
12b0984
@Benjamintdk
refactored code to use local data source
de6a1e0
@Benjamintdk
fixed local datahandler issue
07b37ad
@Benjamintdk
modified gitignore to include new data folder and passed all tests
ed0817e
@Benjamintdk
modified readme to include instructions of how to run locally
b186048
@Benjamintdk Benjamintdk marked this pull request as ready for review August 17, 2022 09:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@Benjamintdk