Commit Graph

2308 Commits

Author SHA1 Message Date
Martyn Inglis
c8a26fcd40 Fixed test names 2017-04-05 16:30:53 +01:00
Martyn Inglis
43a31fa497 Removed a stray sleep used for testing. 2017-04-05 15:33:02 +01:00
Martyn Inglis
72ecca4dab Added a 60 second timeout to the MMG and fire text clients.
- This is a CONNECT and a READ timeout.
- Gets wrapped in the standard client exception, with a status code of 504, message Gateway timeout.
- Is quiet noisy in logs to allow us to see it
- Ensures we flick across the provider.

To test change the timeout to 0 and it will timeout.
2017-04-05 15:31:37 +01:00
Martyn Inglis
57bd6494e1 WIP - adding request timeout 2017-04-04 16:05:25 +01:00
minglis
734772c1eb Merge pull request #882 from alphagov/update-scheduled-jobs
Update scheduled jobs
2017-04-04 15:12:13 +01:00
Martyn Inglis
b08ac6eb63 Ensure priority queue read by development machines. It's now a default queue in the config. 2017-04-04 13:53:01 +01:00
Martyn Inglis
ac445114c7 When using a priority template put the notification in the priority queue.
- there is now a dedicated worker to handle priority queues. We don't now bundle this in the default worker.
2017-04-04 13:44:11 +01:00
Martyn Inglis
43bf973b1d A few changes to the celery workers
1) Beat worker now a single instance with 128M memory
2) New worker for periodic tasks. Single worker, 2G ram
3) new worker for priority queues. Standard instance and memory settings.
2017-04-04 13:43:28 +01:00
Martyn Inglis
ce09765dad Turned down the Memory usage on prod. This was bumped to 2G to try and offset memory usage which caused the delivery worker to die.
We are now spinning this periodic worker off into it's own worker, so it's not bundled with the app. this means we can set it's memory usage specifically so we don't need to bump all the workers.
2017-04-04 13:42:21 +01:00
Martyn Inglis
787d0da7db Broke the periodic queue out from the standard worker.
- now has own worker with worker count of 2
- this is too ensure that any issues with scheduled jobs do not affect core applications
2017-04-04 11:23:54 +01:00
Chris Hill-Scott
0ac3bfcb81 Merge pull request #867 from alphagov/bump-utils-lists-as-placeholder-values
Bump utils to allow lists as placeholder values
2017-04-03 17:31:30 +01:00
Chris Hill-Scott
b19486ec99 Include fixes for heading spacing
Brings in
- [x] https://github.com/alphagov/notifications-utils/pull/134
2017-04-03 17:22:34 +01:00
Rebecca Law
ef6b6040d3 Merge pull request #881 from alphagov/fix-timezone
Add fix for bst
2017-04-03 16:46:55 +01:00
Ken Tsang
eef8aceac5 Refactored get utc in bst to use localize 2017-04-03 16:20:54 +01:00
Ken Tsang
817790784f Fix test for utc to bst conversion 2017-04-03 16:02:26 +01:00
Ken Tsang
2b53e14a73 Add fix for bst 2017-04-03 15:49:23 +01:00
minglis
f9264ea399 Merge pull request #879 from alphagov/bump-memory-on-prod
Bump memory on prod
2017-04-03 11:29:43 +01:00
Martyn Inglis
8f5e1318eb Spread out the scheduled jobs.
Before the longer tasks all ran on the hour, at midnight, 1 and 2.

Now we run one at midnight, one at quarter past, half past then at quarter too. Trying to spread the load.
2017-04-03 11:17:27 +01:00
Martyn Inglis
deaaa259f4 Bump the memory on delivery workers on prod to try and avoid memory issues which can cause delivery worker to fail. 2017-04-03 11:16:20 +01:00
Leo Hemsted
99d100c153 Merge pull request #878 from alphagov/fix-config
Can't set environs to nonetype
2017-03-31 17:25:36 +01:00
Leo Hemsted
243c0632ed add test 2017-03-31 17:18:18 +01:00
Leo Hemsted
1c4da5367f Can't set environs to nonetype 2017-03-31 17:10:43 +01:00
Chris Hill-Scott
585ef8e66a Bump utils to allow lists as placeholder values
Brings in:
- [ ] https://github.com/alphagov/notifications-utils/pull/128

Also adds a test to make sure that passing a dictionary as a value in
the `personalisation` argument works.
2017-03-31 17:02:54 +01:00
Leo Hemsted
27e4007fb5 Merge pull request #877 from alphagov/update-daily-performance-job-4am
Update daily performance job 4am
2017-03-31 16:57:16 +01:00
Ken Tsang
d5e8cb3354 Updated cf conf unit tests 2017-03-31 16:50:30 +01:00
Ken Tsang
316d8fdb0d Updated config to cloudfoundry_config 2017-03-31 16:37:04 +01:00
Ken Tsang
c633e193b0 Update config to enable performance platform 2017-03-31 15:54:29 +01:00
Ken Tsang
989713b0f1 Update config for daily perf job to start 4am 2017-03-31 15:33:41 +01:00
Leo Hemsted
c6ba4050fc Merge pull request #876 from alphagov/fix-notify-user
fix notify service user email
2017-03-31 14:21:56 +01:00
Rebecca Law
09cc3071be Merge pull request #875 from alphagov/fix-redis-test-bug
Stop notifications with test api key incrementing the cache
2017-03-30 15:18:56 +01:00
Leo Hemsted
8865f2db82 fix notify service user email 2017-03-30 15:05:03 +01:00
Rebecca Law
3838fb583c The redis cache for daily limits and template usage was being updated for notifications with a test api key.
This PR corrects that.
2017-03-30 13:43:44 +01:00
minglis
afea1f241c Merge pull request #874 from alphagov/revert-db-tasks-from-api
Revert db tasks from api
2017-03-30 13:16:41 +01:00
Martyn Inglis
7dcd3164e2 Revert "Reinstating the 2 task model for API submitted notifications."
This reverts commit 1c154c4113.
2017-03-30 10:46:23 +01:00
Martyn Inglis
5cd0507e99 Revert "Fixed faoiling jenkins tests. Mocked the required functions"
This reverts commit 4b60c8dada.
2017-03-30 10:46:15 +01:00
Martyn Inglis
9ee26e0b67 Revert "update notification rest tests"
This reverts commit 11919d9810.
2017-03-30 10:38:51 +01:00
Martyn Inglis
385a73da2b Revert "ensure we're passing through api keys and key types from notifications"
This reverts commit 25d1777937.
2017-03-30 10:38:41 +01:00
kentsanggds
bf99921cff Merge pull request #872 from alphagov/fix-daterange-bst
Fix daterange in service DAO to work with BST
2017-03-30 10:11:01 +01:00
Ken Tsang
5f945ab30e Refactored code, changed now to utcnow in test 2017-03-29 11:47:41 +01:00
Ken Tsang
c94b4f1b46 Removed unused import 2017-03-29 11:05:31 +01:00
Ken Tsang
af78efd137 Fix get_detailed_services BST 2017-03-29 11:03:28 +01:00
kentsanggds
79025e54b0 Merge pull request #865 from alphagov/add-v2-template-preview
Add v2 template preview endpoint and schema
2017-03-28 18:40:32 +01:00
Leo Hemsted
3b24d6d9be Merge pull request #871 from alphagov/fix-api-keys
ensure we're passing through api keys and key types from notifications
2017-03-28 14:16:39 +01:00
Leo Hemsted
d639aa22df skip failing timezone test
TODO fixme
2017-03-28 14:02:47 +01:00
Leo Hemsted
11919d9810 update notification rest tests 2017-03-28 13:51:42 +01:00
Andras Ferencz-Szabo
ecfe81cb17 Merge pull request #870 from alphagov/paas_final_routes
Add final routes to the Paas app
2017-03-28 13:28:11 +01:00
Leo Hemsted
25d1777937 ensure we're passing through api keys and key types from notifications
when we made the change to async persist notifications, we forgot to
pass through api_key_id and key_type. in send_sms/email, for legacy
reasons, they default to None/KEY_TYPE_NORMAL, so regardless of what
your api key was set up as, we would send real messages!

TODO: Once the PaaS transition is complete and the task changes are
reverted, remove the api_key_id and key_type params from the send_*
tasks entirely, as those are only called from the csv job flow, and
don't need them
2017-03-28 13:14:46 +01:00
bandesz
eaf1e5bb72 Add final routes to the Paas app 2017-03-28 12:24:12 +01:00
Rebecca Law
d5f8b4d80b Merge pull request #869 from alphagov/utils-update
Use 500 for org id
2017-03-27 17:58:56 +01:00
Rebecca Law
31979c3272 Use 500 for org id 2017-03-27 17:49:09 +01:00