Data missing from CSV incidents download

[jim-mcgowan]

When downloading data as a CSV from the More Incidents... page, the following fields (columns) aren't populated:

• num_adults
• num_children
• num_families
• assistance_given
• incident_verified
• dispatch_relayed
• responders_identified
• dat_on_scene
• dat_departed_scene

[jim-mcgowan]

@frankduncan: Now when I attempt to download incident data (via the Download CSV link), I get a small CSV file titled incidents.csv containing the following:

This remains urgent as Greater New York is trying to complete end-of-FY reporting.

Thanks!

[frankduncan]

It just worked for me, can you try again?

[jim-mcgowan]

@frankduncan: I just tried downloading GNY data from July 2020 - July 2021 and I get the same problem. Interestingly, it takes 60 seconds from the time I click Download CSV to the when the file downloads (I timed it). Also, every time I try, the file overwrites the previous file in my downloads folder (rather than creating a new file).

[jim-mcgowan]

@frankduncan: If this is a more involved fix, it can wait until tomorrow. I'll put off GNY for another day.

[frankduncan]

Yeah, it's timing out. If you do only a month, it works. Something in the code I added to fix this issue (most likely iterating over the timeline for every incident a few times to get those dates) is making it slow down.

So yes, this a more involved fix.

[jim-mcgowan]

@frankduncan: OK. Considering they want data back to January 1, 2018, I think we'll wait for the more involved fix (rather than do 43 individual downloads).

[frankduncan]

I've pushed a fix that lets me get 6 months of data with no problem. Maybe it'll work for longer ones as well, but they may have to piece together a few sheets.