Commit Graph

148 Commits

Author SHA1 Message Date
Carlo Costino
fd974e1b79 Update no_proxy and S3 error handling
This changeset updates the no_proxy environment variable to allow S3 through.  It also updates our error handling connecting to S3.

Signed-off-by: Carlo Costino <carlo.costino@gsa.gov>
2025-05-08 16:54:50 -04:00
Kenneth Kehl
4cfb980ac6 add debug tag adr 2025-02-27 13:24:32 -08:00
Kenneth Kehl
eb8d18bf6b improve error handling around corrupt csv files 2025-02-20 08:00:39 -08:00
Kenneth Kehl
7fab332ab9 fix isort 2025-01-06 13:50:10 -08:00
Kenneth Kehl
7b5c840107 code review feedback 2025-01-06 13:10:13 -08:00
Kenneth Kehl
0f52efd742 fix BOM issue again 2025-01-03 12:27:00 -08:00
Kenneth Kehl
c2d822b288 add tests 2024-12-17 10:56:27 -08:00
Kenneth Kehl
020af71574 fix census BOM error 2024-12-17 10:50:55 -08:00
Kenneth Kehl
7446aed2d1 remove excess log lines from s3 2024-11-25 07:29:00 -08:00
Cliff Hill
ec8ee67ee9 Logging job_cache actions, to see what's going on.
Signed-off-by: Cliff Hill <Clifford.hill@gsa.gov>
2024-11-05 17:33:30 -05:00
Cliff Hill
5a9b867d7a Sticking the job cache into the flask app's config, in an effort to
improve/fix things.

Signed-off-by: Cliff Hill <Clifford.hill@gsa.gov>
2024-11-05 17:21:14 -05:00
Kenneth Kehl
2344516909 add provider tasks tests 2024-10-22 15:00:09 -07:00
Kenneth Kehl
f4f6312206 Merge pull request #1355 from GSA/notify-api-1351
increase code coverage to 93 percent
2024-10-17 11:49:12 -07:00
Kenneth Kehl
6dfeac93cd fix partitioning 2024-10-16 13:22:36 -07:00
Kenneth Kehl
621770daf0 merge from main and code review feedback 2024-10-08 07:36:17 -07:00
Kenneth Kehl
4abd54094d debug s3 partitioning 2024-10-03 07:00:07 -07:00
Kenneth Kehl
445a462b10 clean up s3 2024-10-02 15:00:03 -07:00
Kenneth Kehl
97ee4fe032 cleanup 2024-10-02 07:31:13 -07:00
Kenneth Kehl
5edf0c7a68 merge from main 2024-10-01 14:38:23 -07:00
Kenneth Kehl
641d168370 fix properly 2024-10-01 12:58:31 -07:00
Kenneth Kehl
c2ed8f1686 fix personalization_bug for one-offs 2024-10-01 10:47:47 -07:00
Kenneth Kehl
544e7e61e4 code review feedback 2024-09-30 09:08:18 -07:00
Kenneth Kehl
6b861f31d7 fix debug 2024-09-30 08:45:15 -07:00
Kenneth Kehl
e99f4bc6b5 suppress warnings 2024-09-27 12:38:27 -07:00
Kenneth Kehl
16b357faa8 add comment 2024-09-27 09:55:08 -07:00
Kenneth Kehl
580885ab0c merge from main 2024-09-27 09:43:10 -07:00
Kenneth Kehl
d3768e3152 Merge pull request #1341 from GSA/shared_memory
use shared memory instead of expiring dict for jobs cache
2024-09-27 09:24:31 -07:00
Kenneth Kehl
b2651864e1 Merge pull request #1336 from GSA/notify-admin-1956
fix phone number lookup
2024-09-27 09:23:59 -07:00
Kenneth Kehl
26ffb931c9 optimize S3 partitioning 2024-09-27 08:38:11 -07:00
Kenneth Kehl
8e6c079c09 fix flake8 2024-09-26 15:22:13 -07:00
Kenneth Kehl
096e3a367d clean up 2024-09-26 15:17:57 -07:00
Kenneth Kehl
c2f2cbc3bb fix tests 2024-09-26 13:18:14 -07:00
Kenneth Kehl
8aae0d59b4 use shared memory instead of expiring dict for jobs cache 2024-09-26 11:56:39 -07:00
Kenneth Kehl
d27d877f68 Merge pull request #1330 from GSA/fix_test_coverage
actually start deleting old s3 objects
2024-09-26 08:13:20 -07:00
Kenneth Kehl
e5ac50b694 add test 2024-09-26 07:17:12 -07:00
Kenneth Kehl
ec6bfd8225 improve report performance 2024-09-25 12:26:01 -07:00
Kenneth Kehl
881a251216 fix phone number lookup 2024-09-24 10:26:01 -07:00
Kenneth Kehl
a3c1663d94 fix phone number lookup 2024-09-24 10:17:02 -07:00
Kenneth Kehl
641b01d094 some cleanup 2024-09-13 11:22:50 -07:00
Kenneth Kehl
64a85868a3 code review feedback and merge from main 2024-09-11 09:39:18 -07:00
Kenneth Kehl
2f9fea909e actually start deleting old s3 objects 2024-09-11 07:31:50 -07:00
Kenneth Kehl
4e9e014a0c add test 2024-09-10 11:12:43 -07:00
Kenneth Kehl
b34012c7c3 log s3 objects we want to delete 2024-09-06 13:15:38 -07:00
Kenneth Kehl
fefdd297ea initial 2024-09-06 11:13:13 -07:00
Kenneth Kehl
db9f2b80a2 merge from main 2024-08-28 11:57:51 -07:00
Kenneth Kehl
aa2c8afefe limit cache download by time 2024-08-27 10:31:58 -07:00
Kenneth Kehl
01fff300f8 merge from main 2024-08-22 08:38:01 -07:00
Kenneth Kehl
baf878158f clean up s3 2024-08-16 11:10:10 -07:00
Kenneth Kehl
88f718a906 fix 2024-08-16 10:24:10 -07:00
Kenneth Kehl
496571686a initial 2024-08-16 09:53:29 -07:00