I used NFS to keep some customed code so that each node can access those code. To be flexible, I would like to submit a batch of jobs with on-the-fly PYTHONPATH so that different users can use different code base on NFS, e.g., /data/nfs/james/project1 and /data/nfs/mike/project1. Is there a way to pass environmental variables for each batch of jobs on the fly?


Hi Jackie, thanks for the question! You can use Nanny Plugins to set environment variables for worker processes. There is also the UploadFile Worker Plugin, which allows you to upload a local file to the workers. These can be set via the config to create default settings for different users. Hope that helps!