mirror of
https://github.com/GSA/notifications-api.git
synced 2025-12-24 17:31:34 -05:00
309b4d7d33
add collate-letter-pdfs task (name pending). This retrieves a list of letter pdf files (just the metadata, not the actual data) from s3, and loops through them, calling the ftp task zip-and-send-letter-pdfs. It groups them up by adding them to lists while counting the total filesize, if it gets over a certain filesize (currently set to 500mb) it breaks at that chunk, sends off that list of files to the ftp app, and then starts building up a new list. DVLA have a hard 2gb limit on how big the zip files we can send is - however we're going to be limited by the amount of memory on the ftp app well before we get around to handling 2gb of pdf data - so the limit is 500mb for now. We'll adjust it after we see how ftp performs.