Skip to content

Mayaaa311/Inci_Web_Scraping

Repository files navigation

Western Forest and Fire Initiative

Introduction

The Western Forest and Fire Initiative seeks to map stakeholder involvement in wildfire management across the western United States. In recent years, decentralized governance networks have emerged to promote ecological and socioeconomic resilience in rural forest regions. However, the participation and interconnectedness of key actors in these networks remain largely unknown.

This project aims to establish a comprehensive database that identifies key stakeholders and their relationships within wildfire management processes, providing policymakers with better insights into governance networks.

Objectives

  1. Collect Data: Gather wildfire-related data from various web sources, including Inciweb and Newsbank, to form a detailed dataset with over 1500 incidents and 250 features.

  2. Organize Data: Create Python scripts to clean and organize data, developing a relational database linking stakeholders in wildfire management.

  3. Analyze Relationships: Build a comprehensive social network graph from the database to visualize stakeholder relationships within the wildfire governance process.

Methods

  • Data Collection from Inciweb:

    • Automated a web scraper using BeautifulSoup to extract detailed wildfire incident data.
    • Collated information into a comprehensive table with relevant features.
  • Data Collection from Newsbank:

    • Queried Newsbank for archived articles, news, and social media, providing additional references for the database.
  • Named Entity Recognition (NER):

    • Leveraged Stanford NER to extract essential keywords for organizations and individuals involved in wildfire incidents.
    • Consolidated information into a relational database.

Results and Conclusion

  • Comprehensive Database:

    • Compiled a detailed database containing data from web sources, social media, newspapers, and articles.
  • Network Diagram Development:

    • Developing a network diagram to visualize stakeholder relationships.
    • This diagram will help identify management networks, reveal potential areas for improvement, and enable further social network analysis of the governance process.

About

Scrapes inciweb data and preprocesses data

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors