talos-obmc-linux/include/linux/sunrpc/svc_rdma.h, branch v3.2

svcrdma: Modify the RPC recv path to use FRMR when available

2008-10-06T19:46:01+00:00

RPCRDMA requests that specify a read-list are fetched with RDMA_READ. Using an FRMR to map the data sink improves NFSRDMA security on transports that place the RDMA_READ data sink LKEY on the wire because the valid lifetime of the MR is only the duration of the RDMA_READ. The LKEY is invalidated when the last RDMA_READ WR completes. Mapping the data sink also allows for very large amounts to data to be fetched with a single WR, so if the client is also using FRMR, the entire RPC read-list can be fetched with a single WR. Signed-off-by: Tom Tucker

svcrdma: Add a service to register a Fast Reg MR with the device

2008-10-06T19:45:49+00:00

Fast Reg MR introduces a new WR type. Add a service to register the region with the adapter and update the completion handling to support completions with a NULL WR context. Signed-off-by: Tom Tucker

svcrdma: Add FRMR get/put services

2008-10-06T19:45:18+00:00

Add services for the allocating, freeing, and unmapping Fast Reg MR. These services will be used by the transport connection setup, send and receive routines. Signed-off-by: Tom Tucker

svcrdma: Add Fast Reg MR Data Types

2008-10-03T20:39:58+00:00

Add data types to track Fast Reg Memory Regions. The core data type is svc_rdma_fastreg_mr that associates a device MR with a host kva and page list. A field is added to the WR context to keep track of the FRMR used to map the local memory for an RPC. An FRMR list and spin lock are added to the transport instance to keep track of all FRMR allocated for the transport. Also added are device capability flags to indicate what the memory registration capabilities are for the underlying device and whether or not fast memory registration is supported. Signed-off-by: Tom Tucker

svcrdma: Fix race between svc_rdma_recvfrom thread and the dto_tasklet

2008-08-13T20:57:31+00:00

RDMA_READ completions are kept on a separate queue from the general I/O request queue. Since a separate lock is used to protect the RDMA_READ completion queue, a race exists between the dto_tasklet and the svc_rdma_recvfrom thread where the dto_tasklet sets the XPT_DATA bit and adds I/O to the read-completion queue. Concurrently, the recvfrom thread checks the generic queue, finds it empty and resets the XPT_DATA bit. A subsequent svc_xprt_enqueue will fail to enqueue the transport for I/O and cause the transport to "stall". The fix is to protect both lists with the same lock and set the XPT_DATA bit with this lock held. Signed-off-by: Tom Tucker Signed-off-by: J. Bruce Fields

svcrdma: Change WR context get/put to use the kmem cache

2008-07-02T20:02:02+00:00

Change the WR context pool to be shared across mount points. This reduces the RDMA transport memory footprint significantly since idle mounts don't consume WR context memory. Signed-off-by: Tom Tucker

svcrdma: Remove unused wait q from svcrdma_xprt structure

2008-07-02T20:01:58+00:00

The sc_read_wait queue head is no longer used. Remove it. Signed-off-by: Tom Tucker

svcrdma: Add dma map count and WARN_ON

2008-07-02T20:01:56+00:00

Add a dma map count in order to verify that all DMA mapping resources have been freed when the transport is closed. Signed-off-by: Tom Tucker

svcrdma: Use reply and chunk map for RDMA_READ processing

2008-07-02T20:01:55+00:00

Modify the RDMA_READ processing to use the reply and chunk list mapping data types. Also add a special purpose 'hdr_count' field in in the context to hold the header page count instead of overloading the SGE length field and corrupting the DMA map length. Signed-off-by: Tom Tucker

svcrdma: Add a type for keeping NFS RPC mapping

2008-07-02T20:01:53+00:00

Create a new data structure to hold the remote client address space to local server address space mapping. Signed-off-by: Tom Tucker