Thursday 12 March 2015

How to configure nfs over rdma

Network File System [NFS], is a server-client protocol for sharing files between computers on a common network

RDMA [Remote Direct Memory Access] is a communication technology that allows computers in a network to exchange data in main memory without involving the processor, cache, or operating system of either system, use of RDMA makes higher throughput and lower latency. 
[Note:-RDMA is only possible with network adapters that support RDMA in hardware. Examples of such network adapters are InfiniBand HCAs and 10 GbE network adapters with iWARP support]

First set up the NFS export filesystem on nfs server:-

 # yum install nfs-utils 
#echo "/nfsdir 193.168.0.0/255.255.255.0(fsid=0,rw,async,insecure,no_root_squash)" >> /etc/exports
#exportfs -r
#exportfs -v
#service rpcbind start
#service nfs start

On the NFS server, load the  svcrdma kernel module and start the NFS service.
# modprobe svcrdma
# service nfs restart

verify with showmount command that you have successfully shared /nfsdir folder
#showmount -e
[ Important Note:- configuration file for rdma is /etc/rdma/rdma.conf, Services need to be enable
is rdma & nfs-rdma & Default port for rdma is 2050 ]


Enable RDMA from NFS server:-
First make sure we have installed necessary rdma packages & enable services
# yum install rdma
# chkconfig rdma on
# yum install rdma
#chkconfig nfs-rdma on

If you want to change the default port 2050, open /etc/rdma/rdma.conf file & edit
NFSoRDMA_PORT to the desired port.

Enable RDMA from NFS client:-
# yum install nfs-utils
On the NFS client, load the xprtrdma kernel module and start the NFS service.
# modprobe xprtrdma
# service nfs start

First check rdma rpm is installed or not by using this command:-
# yum install rdma
Make sure rdma service is enabled:-
# chkconfig rdma on
NFS over RDMA

Mount NFS exported directory using rdma:
# mount -o proto=rdma,port=2050 host:/nfsdir /mnt

No comments:

Post a Comment