Skip to content

cbspears/bitcoin-dev-drama-detector

Repository files navigation

Bitcoin Dev Drama Detector πŸ”₯

License: MIT Python 3.11+ GitHub last commit GitHub stars GitHub issues

A dashboard that tracks controversy and debate intensity across Bitcoin developer communication channels.

Built by Blockspace Media

What It Does

Monitors three primary Bitcoin developer communication channels and calculates "drama scores" based on sentiment analysis, reply velocity, NACK/ACK ratios, and controversial keyword detection:

  • GitHub - bitcoin/bitcoin repository (PRs, issues, comments)
  • Mailing List - bitcoin-dev Google Group
  • IRC - #bitcoin-core-dev logs from gnusha.org

Architecture

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”   β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”   β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚   GitHub    β”‚   β”‚  Mailing    β”‚   β”‚    IRC      β”‚
β”‚    API      β”‚   β”‚   List      β”‚   β”‚   Logs      β”‚
β””β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”˜   β””β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”˜   β””β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”˜
       β”‚                 β”‚                 β”‚
       β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                    β”‚
                    β–Ό
        β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
        β”‚   Daily Scrapers      β”‚
        β”‚   (GitHub Actions)    β”‚
        β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                    β”‚
                    β–Ό
        β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
        β”‚   Drama Analyzer      β”‚
        β”‚   (Claude API)        β”‚
        β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                    β”‚
                    β–Ό
        β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
        β”‚   JSON Data Store     β”‚
        β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                    β”‚
                    β–Ό
        β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
        β”‚   React Dashboard     β”‚
        β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

Project Structure

bitcoin-dev-drama-detector/
β”œβ”€β”€ scrapers/
β”‚   β”œβ”€β”€ fetch_github.py       # GitHub API scraper
β”‚   β”œβ”€β”€ fetch_mailing_list.py # Google Groups scraper
β”‚   β”œβ”€β”€ fetch_irc.py          # IRC log scraper
β”‚   └── utils.py              # Shared utilities
β”œβ”€β”€ analyzer/
β”‚   └── drama_scorer.py       # Claude API analysis
β”œβ”€β”€ data/
β”‚   β”œβ”€β”€ raw/                  # Raw scraped data
β”‚   └── processed/            # Processed drama scores
β”œβ”€β”€ dashboard/
β”‚   └── src/                  # React dashboard
β”œβ”€β”€ .github/
β”‚   └── workflows/
β”‚       └── daily_sync.yml    # GitHub Actions workflow
β”œβ”€β”€ requirements.txt
└── README.md

Setup

Prerequisites

  • Python 3.11+
  • GitHub Personal Access Token (for GitHub API)
  • Anthropic API Key (for drama analysis)

Installation

git clone https://github.com/YOUR_USERNAME/bitcoin-dev-drama-detector.git
cd bitcoin-dev-drama-detector
pip install -r requirements.txt

Environment Variables

export GITHUB_TOKEN="ghp_xxxxxxxxxxxx"
export ANTHROPIC_API_KEY="sk-ant-xxxxxxxxxxxx"

Running Scrapers Locally

# Fetch last 24 hours of data
python scrapers/fetch_github.py
python scrapers/fetch_mailing_list.py
python scrapers/fetch_irc.py

GitHub Actions

The scrapers run automatically via GitHub Actions on a daily schedule. See .github/workflows/daily_sync.yml.

Data Format

daily_scores.json

{
  "date": "2025-01-14",
  "overall": 7.8,
  "github": 5.1,
  "mailing_list": 8.9,
  "irc": 6.2
}

threads.json

{
  "id": "ml-2025-01-14-001",
  "title": "CTV activation discussion",
  "source": "mailing_list",
  "drama_score": 9.2,
  "participants": ["alice", "bob"],
  "ack_count": 7,
  "nack_count": 4
}

License

MIT

Credits

About

πŸ”₯ Dashboard tracking controversy and debate intensity across Bitcoin developer communication channels.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors