I've tried to modified the linux ulimits, not work for me.
Could anyone encounter this problem? And is there some solutions to fix this? Or it's just limited by the hardware.
PS. My server's system is redhat 6.7, and the server is DELL R740.
This indicates that the system you're trying to run on is very different (different version of the C library) from the one you're trying to run it on. Make sure that whatever software you've downloaded is for your system (RedHat 6.7, it seems?) and not generally for Linux/another version of RedHat.