Last Mile: Automate SQL / Charts / Dashboards

[WarningRan]

Background

Our current workflow for data visualization and reporting is largely manual, time-consuming, and inconsistent. This "last mile" of our data pipeline is causing significant inefficiencies:

• Manual process to get data into Lakehouse
• Manual process to produce Excel tables and charts
• Dashboard built with help from Haifa team, but still needs work

Current Pain Points

• Producing visualizations (tables/charts/etc) is a pain. We rarely produce charts, we mostly do tables
• We don't use dashboards as we should
• Develop SQL queries to visualize data in Lakehouse dashboard
• Output folder structure is inconsistent and hard to reproduce across team members

Plan

[eletonia]

I can work on this issue and the subissues

[WarningRan]

@eletonia Thank you! Feel free to add any sub-issues or issues, or change or close any. This is only initial dump. You're the expert