HFSS error - Port refinement: Port 1 has signal conductors with 2 terminals

I am having an HFSS problem and am fairly new at this. I have a pc board with a differential trace. It is a 4 layer board with grounds on the sides and also on the other 3 layers. When I put a radiation boundary around this, the boundary lines straight up with the differential trace and the grounds. It looks like you would take a cross section of the pcb. I assigned a waveport to the face of the boundary where the traces and grounds are. When I check it, it seems to be fine. During the processing though, I am getting an error that says: Port refinement, process hf3d: Port '1' has signal conductors with 2 terminals. More signal conductors than terminals can adversely affect the terminal transformations. Please verify conducting boundaries and objects are correctly assigned and touch the port".

I believe the 7 signal conductors are from the ground planes underneath and on the side, any comments on how to make it work?