PYTHONPATH setup

Distributed
#1

Hi,
I used NFS to keep some customed code so that each node can access those code. To be flexible, I would like to submit a batch of jobs with on-the-fly PYTHONPATH so that different users can use different code base on NFS, e.g., /data/nfs/james/project1 and /data/nfs/mike/project1. Is there a way to pass environmental variables for each batch of jobs on the fly?

-Jackie

#2

Hi Jackie, thanks for the question! You can use Nanny Plugins to set environment variables for worker processes. There is also the UploadFile Worker Plugin, which allows you to upload a local file to the workers. These can be set via the config to create default settings for different users. Hope that helps!