We use the same setup and have had the same experience as GoPhoenix. Our memory foam toppers are comfy and not hot (for us).
I kept laying on my side and my hip felt like it was on the board.