Skip to content

Updating Cancellations Model Preprocessing

Jamie Dunning requested to merge jamie/no_buckets_update_cancellations into no-buckets

NOTE: Tested on a subset of days (not full April-August range) due to slow SharePoint syncing times. It worked on a subset of days and should not have any systemic issues/differences across a longer time period.

  • Moved file output names to _v2 and connected all cancellations ETL and modeling scripts
  • Switched date field to be based off of timestamp_summary and not timestamp_event, to avoid counting overnight flights in two separate days
  • Adjusting is_cancelled field to look at both cancelled_summary and fuser_flight_state_event as an OR condition. This way we look at both summary data and flight data.
  • Small SharePoint path location management changes in config.py. It looks like it had been hardcoded to one users local path.
Edited by Jamie Dunning

Merge request reports