To optimize your configuration, set your file descriptor limit to a value at least as high as the number of hosts in your cluster.
The following is an example configuration. The instructions for different operating systems, kernels, and shells are varied. You may have already configured the host to use the maximum number of file descriptors that are allowed by the operating system. On some operating systems, the limit is configured dynamically.
Log in to the LSF master host as the root user.
Add the following line to your /etc/rc.d/rc.local startup script:
echo -n "5120" > /proc/sys/fs/file-max
Restart the operating system to apply the changes.
In the bash shell, instruct the operating system to use the new file limits:
# ulimit -n unlimited