Why are you not exchanging and reading displacements in the fluid side?
Note that you need DisplacementDelta (displacements relative to the last coupling time window), in contrast to Displacement (relative to the original reference point).
Which brings me to the question: does the fluid simulation itself (without coupling, since anyway OpenFOAM does not read anything) converge?