transfer files to blacklight 20150607 and 20150608

Sunday 20150607

After VPN into Spelman network, at helen.spelman.edu, scp to data.psc.edu using my xsede login works.

At helen scp test.txt hqin2@blacklight.psc.xsede.org:./.

6pm. Somehow, "mv" and "cp" from the login node to $SCRATCH freezes my shell.


================
Monday 20150608

From http://www.psc.edu/index.php/resources-for-users/computing-resources/blacklight
A sample set of commands on your local machine would be
    tar cf sourcedir.tar sourcedir
    scp sourcedir.tar joeuser@data.psc.xsede.org
For 'joeuser' you substitute your PSC userid. You can compress your tarball before you transfer it to speed up your transfer times. Then you could login to blacklight and issue the commands
    cd $SCRATCH
   tar xf /arc/users/joeuser/sourcedir.tar
Again for 'joeuser' you substitute your userid. This will unroll your tar file in your scratch directory.


On my byte laptop without VPN, try scp transfer which will take ~3.5 minutes.
Byte-2:projects hqin$ scp 0.ginppi.tar.gz hqin2@blacklight.psc.xsede.org:./.hqin2@blacklight.psc.xsede.org's password:
0.ginppi.tar.gz                                                                                               100%  386MB   1.9MB/s   03:23

Byte-2:projects hqin$ scp 0.ginppi.tar.gz hqin2@data.psc.edu:./.hqin2@data.psc.edu's password:
0.ginppi.tar.gz                                                                                               100%  386MB   2.1MB/s   03:02



On blacklight, I found data.psc.edu or data.psc.xsede.org is linked to /arc/users/hqin2
hqin2@tg-login1:/brashear/hqin2> ls -lh /arc/users/hqin2total 2.6G
-rw-r--r-- 1 hqin2 mc48o9p 3.6G 2015-06-07 16:50 0.tar
So, this is an entry and exit point for transferring data between my computer and blacklight.

hqin2@tg-login1:~> cd $SCRATCH  (This is probably is a key step)
hqin2@tg-login1:/brashear/hqin2> ls
qin  test.txt
hqin2@tg-login1:/brashear/hqin2> mkdir tmp
hqin2@tg-login1:/brashear/hqin2> cd tmp/
hqin2@tg-login1:/brashear/hqin2/tmp> tar xf /arc/users/hqin2/0.tar
hqin2@tg-login1:/brashear/hqin2/tmp> ll
total 4
drwxr-xr-x 15 hqin2 mc48o9p 4096 2014-07-20 10:39 0.ginppi.reliability.simulation
hqin2@tg-login1:/brashear/hqin2/tmp> du -sh
3.5G    .
 hqin2@tg-login1:/brashear/hqin2> tar xvfz /arc/users/hqin2/0.ginppi.tar.gz

OK, I now know how to transfer files to blacklight.