For any graph inverse semigroup G(E) we describe subsemigroups D 0 = D ∪ {0} and J 0 = J ∪ {0} of G(E) where D and J are arbitrary D-class and J -class of G(E), respectively. In particular, we prove that for each D-class D of a graph inverse semigroup over an acyclic graph the semigroup D 0 is isomorphic to a semigroup of matrix units. Also we show that for any elements a, b of a graph inverse semigroup G(E), J a · J b ∪ J b · J a ⊂ J 0 b if there exists a path w such that s(w) ∈ J a and r(w) ∈ J b .