“…Too much knowledge incorporation may divert the word vector from original sentence meaning. Therefore, in order to preserve the original information and avoid knowledge noise, we employ gating units to regulate the flow of information, including transform gate [39] and carry gate as shown in Fig. 4.…”