ResearchDrive - Connecting From a Linux Computer
This document describes how to a ResearchDrive storage account from a linux computer.
ResearchDrive Account Overview
Account Naming Convention
- ResearchDrive storage accounts are named based on the PI's NetID such as //research.drive.wisc.edu/[PI NetID]
- Restricted ResearchDrive accounts use the naming convention //restricted.drive.wisc.edu/[PI NetID]
- Replace references to [PI NetID] with the PI's NetID username.
- Replace references to [NetID] or [NetID password] with your NetID username and password.
Restricted Data
ResearchDrive aligns with the Secure Storage Request process and compliance requirements on the Cybersecurity Risk Management and Compliance website.
- Any UW–Madison endpoint used to access restricted data must be maintained and supported by trained IT staff to ensure they are secure and not vulnerable to malware.
- External collaborators will need to complete an endpoint security checklist to document the security controls in place at their institution.
- Access to restricted data from any other unauthorized endpoint is prohibited.
- Please refer to the ResearchDrive FAQ for additional details.
Connectivity Options
There are several ways to access ResearchDrive storage from a linux computer.
option | requires campus network or vpn | protocol | comment |
---|---|---|---|
Connect to ResearchDrive with smbclient | yes | smb | Built-in support from most versions of linux. Get and put files like an ftp client. |
Mount ResearchDrive with Autofs | yes | smb | Recommended Option for UW-Madison linux computers |
Access ResearchDrive with Globus | no | gridftp or https | Recommended Option for external collaborators |
Mount ResearchDrive with cifs-utils | yes | smb | Works well for smb but more complicated on multi-user linux systems than Autofs |
Connect to a ResearchDrive with smbclient
- If you are off campus or using wifi then you will need to connect to WiscVPN. before using ResearchDrive.
- Connect to the ResearchDrive share with the smbclient command.
- If your linux account uses NetID authentication then use the "smbclient -k" for kerberos single sign-on.
$ smbclient -k //research.drive.wisc.edu/[pi netid]
- If your linux account does not use NetID authentication then replace the "-k" with -U netid and you will be prompted for your login credentials.
$ smbclient -U [netid]@ad.wisc.edu //research.drive.wisc.edu/[pi netid]
- If your linux account uses NetID authentication then use the "smbclient -k" for kerberos single sign-on.
- Once connected to ResearchDrive, you will see a smb :\> prompt.
Try "help" to get a list of possible commands. smb: \>
- Use smbclient commands "ls" and "cd" to navigate the folder structure on ResearchDrive.
- If you need to transfer a single file then use the smbclient "get" or "put" commands to transfer data.
smb: \>cd [directory] smb: \>put [filename] smb: \>get [filename2]
- If you have multiple files to transfer then use the smbclient command "prompt" along with "mget" or "mput" to transfer files that match a pattern such as "*.tar.gz".
smb: \>prompt smb: \>mget *.tar.gz
- If you need to transfer a single file then use the smbclient "get" or "put" commands to transfer data.
- Refer to the Common Problems / Troubleshooting section if you have problems connecting.
Mount a ResearchDrive with Autofs
These instructions require root or sudo access for initial setup. Mounting a ResearchDrive file share with Autofs requires configuring kerberos authentication with Campus Active Directory to enable NetID login. Refer to Campus Active Directory - Linux Binding and Authentication for instructions. Once autofs is configured then a user can use the kinit command to authenticate with their NetID credentials and obtain a kerberos ticket that can be used to mount the file share.
- If you are off campus or using wifi then you will need to connect to WiscVPN. before using ResearchDrive.
- Install pre-requisite packages autofs and cifs-utils.
#CentOS or Red Hat 7 $ sudo yum install autofs cifs-utils #CentOS or Red Hat 8 $ sudo dnf install autofs cifs-utils #Ubuntu $ sudo apt install autofs cifs-utils
- Create a folder on the local file system for the mount point
$ sudo mkdir -p /mnt/researchdrive
- Create an automount configuration file in /etc/auto.master.d/
$ sudo vi /etc/auto.master.d/researchdrive.autofs /mnt/researchdrive /etc/auto.researchdrive --timeout=120
- Create an auto.researchdrive map in /etc.
$ sudo vi /etc/auto.researchdrive * -fstype=cifs,mfsymlinks,multiuser,cruid=$USER,sec=krb5i,seal ://research.drive.wisc.edu/&
- Start autofs with systemlctl
$ sudo systemctl start autofs
- Get a kerberos ticket then test storage connectivity
$ kinit mplayde Password for mplayde@AD.WISC.EDU:
- Use the klist command to verify the kerberos ticket.
$ klist Ticket cache: KCM:1000:3900 Default principal: mplayde@AD.WISC.EDU Valid starting Expires Service principal 06/17/21 14:23:23 06/18/21 00:23:17 krbtgt/AD.WISC.EDU@AD.WISC.EDU renew until 06/24/21 14:23:17
- Use the ls command to test connectivity to ResearchDrive
$ ls -al /mnt/researchdrive/mplayde total 587038720 drwxr-xr-x 2 mplayde mplayde 0 Apr 14 15:28 . drwxr-xr-x 3 root root 0 Jun 17 17:13 .. -rwxr-xr-x 1 mplayde mplayde 100000000000 Dec 10 2020 100G.dat -rwxr-xr-x 1 mplayde mplayde 100000000 Feb 10 14:41 100M.dat -rwxr-xr-x 1 mplayde mplayde 10000000 Dec 8 2020 10M.dat -rwxr-xr-x 1 mplayde mplayde 1000000000 Feb 10 14:41 1G.dat -rwxr-xr-x 1 mplayde mplayde 500000000000 Nov 19 2020 500G.dat drwxr-xr-x 2 mplayde mplayde 0 Nov 18 2020 500GB-in-large-files drwxr-xr-x 2 mplayde mplayde 0 Nov 27 2020 Climate-Huge -rwxr-xr-x 1 mplayde mplayde 10949064 Apr 14 15:17 GlobusIntro.pdf -rwxr-xr-x 1 mplayde mplayde 0 Jan 27 15:44 hello.txt drwxr-xr-x 2 mplayde mplayde 0 Apr 14 15:28 logs drwxr-xr-x 2 mplayde mplayde 0 Feb 26 14:26 project1 -rwxr-xr-x 1 mplayde mplayde 1506 Oct 20 2020 readme.txt -rwxr-xr-x 1 mplayde mplayde 27765 Jan 6 10:25 smtp-8.x-1.0.tar.gz -rwxr-xr-x 1 mplayde mplayde 8273 Dec 10 2020 test.xlsx -rwxr-xr-x 1 mplayde mplayde 0 Nov 19 2020 timc-test-file drwxr-xr-x 2 mplayde mplayde 0 Feb 12 12:51 'transfer test' drwxr-xr-x 2 mplayde mplayde 0 Dec 10 2020 web
Connect to ResearchDrive with Globus
Please refer to Globus - Access ResearchDrive or SharedDrive Stoage with Globus.
Mount a ResearchDrive with cifs-utils
These instructions require root or sudo access.
- If you are off campus or using wifi then you will need to connect to WiscVPN. before using ResearchDrive.
- Install pre-requisite package cifs-utils.
#CentOS or Red Hat 7 $ sudo yum install cifs-utils #CentOS or Red Hat 8 $ sudo dnf install cifs-utils #Ubuntu $ sudo apt install cifs-utils
- Create a folder on the local file system for the mount point
$ sudo mkdir -p /mnt/researchdrive/mplayde
- Use the mount command to connect to ResearchDrive
$ sudo mount -vvv -t cifs -o user=[netid],domain=ad.wisc.edu,sec=ntlmssp,seal //research.drive.wisc.edu/[pi netid] /mnt/researchdrive/
- Use the ls command to test connectivity to ResearchDrive
$ ls -al /mnt/researchdrive/mplayde total 587038720 drwxr-xr-x 2 mplayde mplayde 0 Apr 14 15:28 . drwxr-xr-x 3 root root 0 Jun 17 17:13 .. -rwxr-xr-x 1 mplayde mplayde 100000000000 Dec 10 2020 100G.dat -rwxr-xr-x 1 mplayde mplayde 100000000 Feb 10 14:41 100M.dat -rwxr-xr-x 1 mplayde mplayde 10000000 Dec 8 2020 10M.dat -rwxr-xr-x 1 mplayde mplayde 1000000000 Feb 10 14:41 1G.dat -rwxr-xr-x 1 mplayde mplayde 500000000000 Nov 19 2020 500G.dat drwxr-xr-x 2 mplayde mplayde 0 Nov 18 2020 500GB-in-large-files drwxr-xr-x 2 mplayde mplayde 0 Nov 27 2020 Climate-Huge -rwxr-xr-x 1 mplayde mplayde 10949064 Apr 14 15:17 GlobusIntro.pdf -rwxr-xr-x 1 mplayde mplayde 0 Jan 27 15:44 hello.txt drwxr-xr-x 2 mplayde mplayde 0 Apr 14 15:28 logs drwxr-xr-x 2 mplayde mplayde 0 Feb 26 14:26 project1 -rwxr-xr-x 1 mplayde mplayde 1506 Oct 20 2020 readme.txt -rwxr-xr-x 1 mplayde mplayde 27765 Jan 6 10:25 smtp-8.x-1.0.tar.gz -rwxr-xr-x 1 mplayde mplayde 8273 Dec 10 2020 test.xlsx -rwxr-xr-x 1 mplayde mplayde 0 Nov 19 2020 timc-test-file drwxr-xr-x 2 mplayde mplayde 0 Feb 12 12:51 'transfer test' drwxr-xr-x 2 mplayde mplayde 0 Dec 10 2020 web
- Refer to the Common Problems / Troubleshooting section if you have problems connecting.
Common Problems / Troubleshooting
Contact researchdrive@wisc.edu to open a support case.
For more information on common problems that can occur when mapping drives and how to troubleshoot them, please refer to the following resources: