DjangoImageScraper

DjangoImageScraper is a web app that scrapes an inputted URL for images and displays the images.

Click here to try it out!

Or visit: https://566bhzmsq6.execute-api.us-west-2.amazonaws.com/dev

Demo:

DjangoImageScraperDemo.mp4

Motivation

I wanted to play around with python and web development, so I decided to create an image scraper with Django. Then, I decided to deploy the web app using AWS Lambda. Overall, I wanted to play around with python and web development, so I created a Django Image Scraper.

Tech/Framework Used

• Django and Python libraries like BeautifulSoup4, requests, and validators
• HTML, CSS, JavaScript, BootStrap
• The web app is deployed using AWS Lambda and S3 buckets

How to Use?

1. Input a URL (preferably one that contains images)
2. Click on "Scrape URL!"
3. Scroll through the images that were scraped from the inputted URL

Credits

This project would not have been possible without help from the following tutorials, and debugging guides.

Setting up Django: https://www.pythonstacks.com/blog/post/create-single-page-application/

How to use Django: https://www.youtube.com/playlist?list=PL4cUxeGkcC9ib4HsrXEYpQnTOTZE1x0uc

BeautifulSoup4 Scraping: https://www.youtube.com/watch?v=lOzyQgv71_4

Zappa and AWS: https://www.youtube.com/watch?v=WaiL4sbaj_o

https://auth0.com/blog/deploying-django-restful-apis-as-serverless-applications-with-zappa/

https://romandc.com/zappa-django-guide/walk_static/

S3 Bucket permissions: https://stackoverflow.com/questions/54788998/djangoaws-s3-botocore-exceptions-clienterror-an-error-occurred-accessdenied

Status

Further features are unlikely since I mainly created the Image Scraper to play around with technologies. Thank you for taking a look!