Martyn Inglis 832005efef Updates to the delete CSV file job to reduce the number of eligible jobs in any run ...

- previously this was unbounded, so it got all jobs older then 7 days. In excess of 75,000 🔥
- this meant that the job took (a) a long time and (b) a lot memory and (c) doing the same thing every day

These changes mean that the job has a 2 day eligible window for jobs, minimising the number of eligible jobs in a run, whilst still retaining some leeway in event if it failing one night.

In principle the job runs early morning on a given day. The previous 7 days are left along, and then the previous 2 days worth of files are deleted:

so:
runs on
31st
30,29,28,27,26,25,24 are ignored
23,22 jobs here have files deleted
21 and earlier are ignored.

2017-04-05 16:23:41 +01:00

..

__init__.py

Work in progress, skeleton of the api created and testing started. Need to fix authentication tests.

2016-01-08 17:51:46 +00:00

test_api_key_dao.py

refactor authentication code

2016-06-30 10:44:21 +01:00

test_events_dao.py

Endpoint for recording events in api.

2016-04-27 10:36:59 +01:00

test_invited_user_dao.py

Replaced first queries with one queries, which throws a NoResultFound.

2016-03-11 15:34:20 +00:00

test_jobs_dao.py

Updates to the delete CSV file job to reduce the number of eligible jobs in any run

2017-04-05 16:23:41 +01:00

test_notification_dao.py

Remove created notification - not needed for test

2017-02-27 15:01:44 +00:00

test_permissionDAO.py

Cancel job if the service is inactive.

2017-02-02 11:34:00 +00:00

test_provider_details_dao.py

Updates:

2017-03-03 10:54:20 +00:00

test_provider_rates_dao.py

Update now to utcnow. All tests passing.

2016-05-11 10:56:24 +01:00

test_provider_statistics_dao.py

Allow filtering of billing info by financial year

2017-01-27 11:13:22 +00:00

test_service_whitelist_dao.py

Update ServiceWhitelist dao to conform to new data model

2016-09-27 13:45:36 +01:00

test_services_dao.py

Add template type to response and refactor

2017-03-08 12:01:38 +00:00

test_templates_dao.py

Moved the cache key to the utils module.

2017-02-14 14:22:52 +00:00

test_users_dao.py

Changes as per code review comments.

2017-02-15 17:41:07 +00:00