Given a monomial m in a polynomial ring and a subset L of the variables of the polynomial ring, the principal L-Borel ideal generated by m is the ideal generated by all monomials which can be obtained from m by successively replacing variables of m by those which are in L and have smaller index. Given a collection I = {I 1 , . . . , Ir} where I i is L i -Borel for i = 1, . . . , r (where the subsets L 1 , . . . , Lr may be different for each ideal), we prove in essence that if the bipartite incidence graph among the subsets L 1 , . . . , Lr is chordal bipartite, then the defining equations of the multi-Rees algebra of I has a Gröbner basis of quadrics with squarefree lead terms under lexicographic order. Thus the multi-Rees algebra of such a collection of ideals is Koszul, Cohen-Macaulay, and normal. This significantly generalizes a theorem of Ohsugi and Hibi on Koszul bipartite graphs. As a corollary we obtain that the multi-Rees algebra of a collection of principal Borel ideals is Koszul. To prove our main result we use a fiber-wise Gröbner basis criterion for the kernel of a toric map and we introduce a modification of Sturmfels' sorting algorithm. xi xj m ∈ I. In this case we call xi xj m an L-Borel move.The ideal I is a principal L-Borel ideal if its generators are obtained by L-Borel moves from a single monomial, which we call the L-Borel generator of I. For example, if L is the linear ordering on {x 1 , . . . , x 5 } considered above, x 1 , x 3 , x 5 is a principal L-Borel ideal with L-Borel generator x 5 .