[Snyk] Security upgrade org.apache.spark:spark-core_2.12 from 2.4.4 to 3.5.8

[snyk-io]

Snyk has created this PR to fix 1 vulnerabilities in the maven dependencies of this project.

Snyk changed the following file(s):

• pom.xml

Vulnerabilities that will be fixed with an upgrade:

	Issue	Score	Upgrade
	Race Condition SNYK-JAVA-ORGGLASSFISHJERSEYCORE-14049172	249	org.apache.spark:spark-core_2.12: 2.4.4 -> 3.5.8 Major version upgrade No Path Found Proof of Concept

---

Important

• Check the changes in this PR to ensure they won't cause issues with your project.
• Max score is 1000. Note that the real score may have changed since the PR was raised.
• This PR was automatically created by Snyk using the credentials of a real user.

---

Note: You are seeing this because you or someone else with access to this repository has authorized Snyk to open fix PRs.

For more information:
🧐 View latest project report
📜 Customise PR templates
🛠 Adjust project settings
📚 Read about Snyk's upgrade logic

---

Learn how to fix vulnerabilities with free interactive lessons:

🦉 Race Condition

[snyk-io]

This is a major upgrade from Spark 2.4.4 to 3.5.8, introducing significant breaking changes across multiple versions. It requires mandatory dependency updates and includes critical changes to the logging framework and SQL behavior.

Highlights:

• Scala 2.12 Required: Spark 3.x removes support for Scala 2.11 and requires all applications and dependencies to be compiled with Scala 2.12.
• Log4j 2 Migration: Spark 3.3.0 migrated from Log4j 1.x to 2.x. This requires migrating all custom log4j.properties configuration files to the new Log4j2 syntax.
• SQL Date/Time Parsing: The calendar system for parsing and formatting timestamps changed in Spark 3.0. This can cause errors when parsing date strings. To restore the previous behavior, you may need to set spark.sql.legacy.timeParserPolicy to LEGACY.

Source: Apache Spark documentation
Recommendation: A staged upgrade is highly recommended. Developers must recompile applications against Scala 2.12, update logging configurations, and thoroughly validate all SQL queries, especially those involving date/time operations.

Notice 🤖: This content was augmented using artificial intelligence. AI-generated content may contain errors and should be reviewed for accuracy before use.

[snyk-io]

✅ Snyk checks have passed. No issues have been found so far.

Status	Scanner	Critical	High	Medium	Low	Total (0)
✅	Open Source Security	0	0	0	0	0 issues
✅	Licenses	0	0	0	0	0 issues

💻 Catch issues earlier using the plugins for VS Code, JetBrains IDEs, Visual Studio, and Eclipse.