tag/10-16-2024-2/run_celery.py

#!/usr/bin/env python

from flask import Flask

# notify_celery is referenced from manifest_delivery_base.yml, and cannot be removed
from app import create_app, notify_celery  # noqa

application = Flask("delivery")
create_app(application)
application.app_context().push()
Celery tests 2016-02-09 13:31:45 +00:00			`#!/usr/bin/env python`
Create an app context for each celery task run Celery tasks require an active app context in order to use app logger, database or app configuration values. Since there's no builtin support we create this context by using a custom celery task class NotifyTask. However, NotifyTask was using `current_app`, which itself is only available within an app context so the code was pushing an initial context in run_celery.py. This works with the default prefork pool implementation, but raises a "working outside of application context" error with an eventlet pool since that initial application context is local to a thread and eventlet celery worker pool will create multiple green threads. To avoid this, we bind NotifyTask to the app variable with a closure and use that variable instead of `current_app` to create the context for executing the task. This avoids any issues caused by shared initial app context being lost when spawning additional worker threads. We still need to keep the context push in run_celery.py for prefork workers since it's required for logging events outside of tasks (eg logging during `worker_process_shutdown` signal processing). 2018-02-12 15:29:03 +00:00
Remove flask-script, move commands to click click (http://click.pocoo.org/) is used by flask to run its cli args. In removing flask_script (it's unmaintained), we had to migrate all our commands to use click. This is a change for the better in my eyes - you don't need to define the command in several places, and it makes managing options a bit easier. View diff with whitespace turned off unless you're a masochist. 2017-11-06 12:34:29 +00:00			`from flask import Flask`

flake8 - remove unused imports and ensure they're always at the top of the file 2017-11-28 10:35:16 +00:00			`# notify_celery is referenced from manifest_delivery_base.yml, and cannot be removed`
black, isort, flake8 Signed-off-by: Cliff Hill <Clifford.hill@gsa.gov> 2023-12-08 21:43:52 -05:00			`from app import create_app, notify_celery # noqa`
Remove flask-script, move commands to click click (http://click.pocoo.org/) is used by flask to run its cli args. In removing flask_script (it's unmaintained), we had to migrate all our commands to use click. This is a change for the better in my eyes - you don't need to define the command in several places, and it makes managing options a bit easier. View diff with whitespace turned off unless you're a masochist. 2017-11-06 12:34:29 +00:00
reformat 2023-08-29 14:54:30 -07:00			`application = Flask("delivery")`
Remove flask-script, move commands to click click (http://click.pocoo.org/) is used by flask to run its cli args. In removing flask_script (it's unmaintained), we had to migrate all our commands to use click. This is a change for the better in my eyes - you don't need to define the command in several places, and it makes managing options a bit easier. View diff with whitespace turned off unless you're a masochist. 2017-11-06 12:34:29 +00:00			`create_app(application)`
Celery tests 2016-02-09 13:31:45 +00:00			`application.app_context().push()`