We uses Twitter's streaming data to identify trending #tags in the specific topic.
We use following versions of Spark, Hadoop, Python, Java, and Winutils.
| Package | Version | Source |
|---|---|---|
| Spark | 3.1.2 | https://spark.apache.org/downloads.html |
| Hadoop | 3.2 | https://spark.apache.org/downloads.html |
| Python | 3.9.6 | https://www.python.org/downloads/release/python-396 |
| Java | 1.8.0_301 | https://www.oracle.com/sg/java/technologies/javase/javase-jdk8-downloads.html |
| Winutils | 3.1.2 | https://github.com/cdarlint/winutils/blob/master/hadoop-3.1.2/bin/winutils.exe |