We introduce two set cover problems with submodular costs and linear/submodular penalties and offer two approximation algorithms of ratios η and 2η respectively via the primal-dual technique, where η is the largest number of sets that each element belongs to.