Grounds of FPGA do not match

I have two digital FPGA design boards which use digital ground all perfectly designed 4 layer PCB(2 layers for double side ground). These two boards have two major FPGA chip soldered along with some leds and switches. Now the case is that I use to send data(sda) from one to another using one data bus and one clock line(sclk).Along with this a ground and a ready signal is provided(4 wires). Problem here is that the leds in the receiver board flickers when I connect as usually.This should not occur,coz that is not how it's programmed.IC is programed to display received data from sda.When I provided one more 2nd wire for ground, this problem is solved,program works as expected.I get data displayed in led.No flicker.so 2 ground wires are required to solve the case. I use 5V Dc supply seperatly for these 2 boards. When I use same source this prob doesn't happen.Why isn't the ground shorting with one single wire? perfectly when different sources are used. I tried using big wire,fat wire,shielded cable and also measured the resistance between the two boards ground after shorting with 1 wire but it's almost zero.Noise level is under normal level.Please suggest me if there is any way that I can overcome this.It appears so strange and crazy in electronics!.I guess it's not ringing/looping since it's purely digital ground with isolation. My freq is 200KHz.Thanks

The problem is that the 2 device are alimented by different source.
If you've to doing it, you've to ensure that the ground level is the same for the 2 device expecially if they communicate between them.

On the PCB you've to connect the 2 ground together and with more then in one point.
One point mean that current flow from starting to beginning and that give a ddp.

Thanks!, but however I have connected all grounds as you have said. But it requires additional wire since 2 boards act as TX and RX. So we cannot make single PCB for two boards,you know. Anyway Some one I heard saying this couldbe due to "ringing" or "looping" of current.I am not sure but this problem is still the same...