Leo Hemsted 4b61060d32 stream notifications when collating zip files ...

we had issues where we had 150k 2nd class notifications, and the collate
task never ran properly, presumably because the volume of data being
returned was too big.

to try and help with this, we can switch to streaming rather than using
`.all` and building up lists of data. This should help, though the
initial query may be a problem still.

2020-10-23 12:20:26 +01:00

..

__init__.py

…

broadcast_message_tasks.py

celery: broadcast msg create invokes cbc proxy

2020-10-20 11:57:26 +01:00

celery.py

dd sqlalchemy connection metrics for celery tasks

2020-06-12 14:52:22 +01:00

letters_pdf_tasks.py

stream notifications when collating zip files

2020-10-23 12:20:26 +01:00

nightly_tasks.py

…

process_ses_receipts_tasks.py

Add better logging to understand callback delivery cases

2020-06-04 16:00:43 +01:00

process_sms_client_response_tasks.py

Put status codes in logs to see if lack of detailed status is

2020-06-02 13:26:41 +01:00

provider_tasks.py

Log warning for SES send rate throttling rather than exception

2020-08-13 17:51:09 +01:00

reporting_tasks.py

…

research_mode_tasks.py

…

scheduled_tasks.py

Merge pull request #2982 from alphagov/improve-efficiency-of-process-missing-rows

2020-10-02 11:23:35 +01:00

service_callback_tasks.py

…

tasks.py

Reduce logs

2020-09-28 11:53:54 +01:00