fir matlab coefficient
I used a formula similar to wiki. It is correct. But you must also use the window to control out-of-band radiation. The window also brings ISI, therefore need a compromise between the number of coefficients and the strength of interference.
Result FDAtool or simulink RRC FIR block also correct, perhaps a bad formula in Matlab нelp or you are somewhere wrong. If calculated coefficients correct there would be no ISI in the model of the transmitter-receiver, check it.