Web Scraping Flask

screenshot of Web Scraping Flask

Scrapes Mars Data and serves in a flask app dashboard.

Overview:

The web-scraping-challenge is a Python web scraping app that utilizes the libraries pymongo and Flask. The app consists of two main scripts: scrape_mars.py and app.py. The scrape_mars.py script is responsible for scraping the most current data from four different Mars websites, while the app.py script calls the scrape_mars script using Flask and stores the data in a pymongo database. The data is then retrieved from the database and rendered with Jinja in an HTML template. When the main button is clicked in the index.html file, the end route is changed, and the scrape_mars.py app is called to populate the dashboard with the most current Mars data.

Features:

  • Web Scraping: The app utilizes Python to scrape data from four different Mars websites, ensuring the retrieval of the most up-to-date information.
  • Data Storage: The app uses pymongo to store the scraped data in a database, allowing for easy retrieval and analysis.
  • Flask Integration: By utilizing Flask, the app can call the scrape_mars script and populate the dashboard with the latest Mars data.
  • Dynamic Dashboard: The app generates a dynamic dashboard that showcases the most current Mars data, providing users with a comprehensive view of the planet's information.

Summary:

The web-scraping-challenge app is a Python-based web scraping tool that allows users to retrieve the most current information about Mars from various websites. By using libraries such as pymongo and Flask, the app efficiently scrapes data, stores it in a database, and renders a dynamic dashboard for users to explore. The app's straightforward installation process makes it accessible for users to set up and run on their local machines. With its user-friendly interface and up-to-date data, the web-scraping-challenge app is a valuable tool for those interested in monitoring and learning about Mars.