You can write an S3 object to a Pachyderm repo within a project by performing the following commands:
Tool:
- Create the object:
aws --endpoint-url http://localhost:30600/ s3 cp test.csv s3://master.foo.bar
# upload: ./test.csv to s3://master.foo.bar/test.csv
- Check that the object was added:
aws --endpoint-url http://localhost:30600/ s3 ls s3://master.foo.bar/
# 2021-04-26 12:11:37 2685061 github_issues_medium.csv
# 2021-04-26 12:11:37 62 test.csv
- Create the object:
mc cp test.csv local/master.foo.bar/test.csv
# test.csv: 62 B / 62 B âââââââââââââââââââââââââââââââââââââ 100.00% 206 B/s 0s
- Check that the object was added:
mc ls local/master.foo.bar
# [2021-04-26 12:11:37 PDT] 2.6MiB github_issues_medium.csv
# [2021-04-26 12:11:37 PDT] 62B test.csv
âšī¸
Not all the repositories that you see in the results of the ls
command are repositories that can be written to. Some of them might be read-only. Note that you should have writing access to the input repo in order to be able to add files to it.