Increase the file descriptor limit

Procedure

To achieve efficiency of performance in LSF, follow the instructions in your operating system documentation to increase the number of file descriptors on the LSF master host.
Tip:

To optimize your configuration, set your file descriptor limit to a value at least as high as the number of hosts in your cluster.

The following is an example configuration. The instructions for different operating systems, kernels, and shells are varied. You may have already configured the host to use the maximum number of file descriptors that are allowed by the operating system. On some operating systems, the limit is configured dynamically.

Your cluster size is 5000 hosts. Your master host is on Linux, kernel version 2.6:
  1. Log in to the LSF master host as the root user.

  2. Add the following line to your /etc/rc.d/rc.local startup script:

    echo -n "5120" > /proc/sys/fs/file-max
  3. Restart the operating system to apply the changes.

  4. In the bash shell, instruct the operating system to use the new file limits:

    # ulimit -n unlimited