You can have a Run Configuration to run your celery workers which then allows you to debug simply by clicking the debug button. Here is how I set that up in PyCharm 2020.1

Module name: celery

Parameters: worker --workdir=/path/to/your_project_dir/ --app=project_name.celery --loglevel=INFO

https://s3-us-west-2.amazonaws.com/secure.notion-static.com/0b27313b-95c9-4250-ac97-ba03b254caa7/2020-10-19_12-23-03.png

You need to set up a remote python interpreter and then set other configs like the image above.