Commit Graph

5586 Commits

Author SHA1 Message Date
Leo Hemsted
cb8b17e7d3 Merge pull request #1926 from alphagov/letter-timezone-bug
fix letters being put in the wrong bucket when near midnight cut-off
2018-07-02 14:28:59 +01:00
Leo Hemsted
cb7f5a7166 fix letters being put in the wrong bucket when near midnight cut-off
another day, another timezone bug
2018-07-02 14:16:40 +01:00
Rebecca Law
08dcc920a2 Updated notifications-util to the latest version.
There has been an update to the email validation code.
Added an extra test for email validation.
2018-07-02 13:48:40 +01:00
Rebecca Law
69c01ce8a0 Merge pull request #1924 from alphagov/replay-letters-in-error
Added a method to reply letters that are in the error folder on S3.
2018-07-02 11:05:13 +01:00
Rebecca Law
c1a84fb1c4 Added tests 2018-07-02 10:59:55 +01:00
Rebecca Law
0ede5d7ce9 Merge branch 'master' into replay-letters-in-error 2018-07-02 10:56:07 +01:00
pyup-bot
cb0971dcce Update sqlalchemy from 1.2.8 to 1.2.9 2018-06-29 19:09:51 +01:00
Katie Smith
b4654781be Add schema and validate platform stats requests
Added a schema to check that the start_date and end_date arguments are
both in the date format.
2018-06-29 16:14:48 +01:00
Katie Smith
cbb9f71e61 Fix bug with test notifications not showing
Test notifications are only stored in the notification table, not the
notification_history table. We were deciding which table to query for
the platform admin stats based on the start date passed to the DAO
function. This means that if the start date given was more than 7 days
ago and the end date was within the last 7 days, test notifications were
not being returned. We now use the end date to choose which table to
query which means that test notifications always get returned when they
should.
2018-06-29 16:01:45 +01:00
Katie Smith
4b030b1583 Create platform-stats blueprint
Created a platform-stats blueprint and moved the new platform stats
endpoint to the new blueprint (it was previously in the service
blueprint). Since the original platform stats route and the new platform
stats route are now in different blueprints, their view functions can
have the same name without any issues.
2018-06-29 16:01:45 +01:00
Katie Smith
5381491aae Move DAO function for new platform stats page
Moved the `fetch_new_aggregate_stats_by_date_range_for_all_services`
DAO function from the services DAO to the Notifications DAO since this
function queries the `notification` and `notification_history` tables.

Also added a test to check that the data returned from the function
takes BST into account.
2018-06-29 16:01:45 +01:00
Katie Smith
7e6076a41f Add in new endpoint with data for platform admin stats
Added in a new endpoint and DAO function to provide the data for the new
platform admin statistics page. The DAO method gets different data from
the Notifications / NotificationHistory table and also groups it differently.

The old endpoint has not been deleted yet to allow the numbers on the
old and new pages to be compared.
2018-06-29 16:01:45 +01:00
Rebecca Law
fa4ad93d40 Merge pull request #1920 from alphagov/bulk-invites-to-service
Command to add invited users from a CSV file
2018-06-29 13:20:53 +01:00
Alexey Bezhan
5eef8bb650 Merge pull request #1922 from alphagov/tail-celery-multi-logs
Stream delivery worker logs to stdout when running on PaaS
2018-06-29 12:56:03 +01:00
Alexey Bezhan
676e3ec39a Stream delivery worker logs to stdout when running on PaaS
Our application servers and celery workers write logs both to a
file that is shipped to CloudWatch and to stdout, which is picked
up by CloudFoundry and sent to Logit Logstash.

This works with gunicorn and single-worker celery deployments, however
celery multi daemonizes worker processes, which detaches them from
stdout, so there's no log output in `cf logs` or Logit.

To fix this, we start a separate tail process to duplicate logs written
to a file to stdout, which should be picked up by CloudFoundry.
2018-06-29 11:49:02 +01:00
Rebecca Law
f4846c88c9 Had to move the import to the method rather than the top of the file. 2018-06-29 11:12:54 +01:00
Rebecca Law
a2aa4934fb Merge branch 'master' into bulk-invites-to-service 2018-06-29 10:33:49 +01:00
Rebecca Law
b201711705 Undo the chnages to create_invited_user 2018-06-29 10:26:14 +01:00
Chris Hill-Scott
2ad703b89b Merge pull request #1921 from alphagov/ofgem
Add Ofgem letter logo
2018-06-29 10:21:50 +01:00
Chris Hill-Scott
1c960272a6 Add Ofgem letter logo 2018-06-29 10:09:18 +01:00
Rebecca Law
213e32cf6d Added a one off command to add many invited user to a service.
It would be nice to add something that can do this from the Admin app.
2018-06-28 17:09:45 +01:00
Rebecca Law
5850663ca6 Added a method to reply letters that are in the error folder on S3.
You can replay one at a time by sending in the file name. Or all the messages in the error folder.
2018-06-27 16:40:30 +01:00
Katie Smith
17a971cb77 Merge pull request #1910 from alphagov/summary-complaints-api
Add endpoint to show number of complaints
2018-06-27 09:25:19 +01:00
Katie Smith
8c22a6afda Change schema format name of datetime format
Renamed the 'datetime' format to 'datetime_within_next_day'. This format
is used to validate the date and time of scheduled notifications, not to
check the format of a datetime.
2018-06-27 09:11:38 +01:00
Katie Smith
7f4b828aff Add tests for get_complaint_count endpoint
* Added unit tests for the get_complaint_count endpoint
* Updated the schema to use 'date' format instead of 'datetime'
* Updated the complaint endpoint to convert start_date and end_date to
be dates instead of strings
2018-06-27 09:11:38 +01:00
Rebecca Law
28beeebbf4 Added a query and endpoint to return the count of complaints for a date-range.
Unit tests for complaints_rest.get_complaint_count have yet to be written.
Maybe there is a better name for the new endpoint.
2018-06-27 09:11:38 +01:00
Rebecca Law
e638653f11 When we get complaints we'd like to know how many we get in a day or other date range, so if there is a spike in complaints we can act on it.
Add new endpoint to return the number of complaints in a date range.

Unit tests to follow in the next commit.
2018-06-27 09:11:38 +01:00
Leo Hemsted
639a3f42b2 Merge pull request #1911 from alphagov/pyup-update-pytest-3.6.1-to-3.6.2
Update pytest to 3.6.2
2018-06-26 16:07:22 +01:00
Leo Hemsted
1f2f12238c Merge pull request #1909 from alphagov/pyup-update-flask-migrate-2.2.0-to-2.2.1
Update flask-migrate to 2.2.1
2018-06-26 16:07:10 +01:00
Leo Hemsted
01fbafd41e Merge pull request #1908 from alphagov/pyup-update-psycopg2-binary-2.7.4-to-2.7.5
Update psycopg2-binary to 2.7.5
2018-06-26 16:06:00 +01:00
Sakis
817ae30287 Merge pull request #1917 from alphagov/gunicorn-accesslog
Remove GUNICORN_CMD_ARGS before we start our app
2018-06-25 17:07:55 +01:00
Athanasios Voutsadakis
fb856ffd3b Remove GUNICORN_CMD_ARGS before we start our app
More details: alphagov/notifications-admin#2128
2018-06-25 16:54:33 +01:00
Rebecca Law
7acea653e8 Merge pull request #1915 from alphagov/format-for-csv
Format data for csv
2018-06-25 10:57:11 +01:00
Rebecca Law
6d5eff028e Format the data for the csv. 2018-06-21 17:04:49 +01:00
Sakis
2d82487a7b Merge pull request #1903 from alphagov/syslog-drain-production
Enable syslog drain on all environments
2018-06-21 11:16:26 +01:00
Rebecca Law
d6ce4b8268 Merge pull request #1914 from alphagov/nightly-task-ft_notification_status
Nightly task for updating ft_notification_status
2018-06-21 09:57:26 +01:00
Rebecca Law
1ab4654396 Fix codestyle 2018-06-20 16:54:12 +01:00
Rebecca Law
1363244a2b Added the scheduling for the task 2018-06-20 16:48:03 +01:00
Rebecca Law
709a6c38c7 Created a task to update ft_notification_status for the last three days. 2018-06-20 16:45:20 +01:00
Rebecca Law
5cb5d017b9 Merge pull request #1913 from alphagov/ft_notification_status-migration
Small fix for migration query
2018-06-20 15:05:13 +01:00
Rebecca Law
16bb62e029 Due to a bug in 2016, there are some rows without a template id.
For that case use a default template id.
2018-06-20 14:51:24 +01:00
Rebecca Law
0bba323dba Merge pull request #1912 from alphagov/ft_notification_status-migration
Complete the migration command for ft_notification_status.
2018-06-20 14:12:23 +01:00
Rebecca Law
15e81aa7b3 Update to the command to migrate data for ft_notification_status.
Removed the initial queries - I don't think they are helpful.
2018-06-20 14:04:03 +01:00
pyup-bot
1e196665ff Update pytest from 3.6.1 to 3.6.2 2018-06-20 13:26:32 +01:00
pyup-bot
ffcaded795 Update flask-migrate from 2.2.0 to 2.2.1 2018-06-18 15:29:31 +01:00
pyup-bot
410040461f Update psycopg2-binary from 2.7.4 to 2.7.5 2018-06-17 19:32:28 +01:00
Chris Hill-Scott
44f2d21513 Merge pull request #1907 from alphagov/hmpo-letter-logo
Add letter logo for HM Passport Office
2018-06-15 14:15:25 +01:00
Chris Hill-Scott
ea06316807 Add letter logo for HM Passport Office
`009` matches the ID defined in
https://github.com/alphagov/notifications-template-preview/pull/143
2018-06-15 14:06:16 +01:00
Chris Hill-Scott
d8201298b1 Merge pull request #1906 from alphagov/pyup-update-sqlalchemy-1.2.7-to-1.2.8
Update sqlalchemy to 1.2.8
2018-06-14 13:36:24 +01:00
pyup-bot
3e3d71937a Update sqlalchemy from 1.2.7 to 1.2.8 2018-06-14 13:24:39 +01:00