Use a private git repo on AWS
To use a private git repo, you'll need to give Meadowrun the name of an AWS secret that contains the private SSH key for the repo you want to use.
We'll assume you have a private git repo at
If you don't already have an SSH key for accessing your private repo, you'll need to set one up with your git hosting provider. For example, see GitHub's instructions for adding a deploy key
Create an AWS Secret
First, create an AWS
my_ssh_key that contains a key-value pair where the key is
the value is the contents of a private SSH key that has permission to read your private
git repo. If you're using the AWS Console, you'll need to use the "Plaintext" view and
use explicit newline characters to create the appropriate line breaks.
Note that the trailing newline is very important!
Grant permission to the secret
Next, the EC2 instances that are running your code (i.e. the role that they run as) will need to access this secret:
meadowrun-manage-ec2 grant-permission-to-secret my_ssh_key
Use your secret
Now you can use the following Deployment with run_function or run_map:
import meadowrun meadowrun.Deployment.git_repo( "firstname.lastname@example.org:my_organization/my_private_repo", interpreter=meadowrun.CondaEnvironmentFile("myenv.yml"), ssh_key_secret=meadowrun.AwsSecret("my_ssh_key") )
Note that we're using the SSH URL. The equivalent https URL (e.g.
https://github.com/my_organization/my_private_repo) will NOT work because we're using
an SSH key.