Despite the tremendous success of general relativity so far, modified theories of gravity have received increased attention lately, motivated from both theoretical and observational aspects. In particular, gravitational wave observations opened new possibilities for testing the viability of such theories in the dynamical and strong-field regime. One could test each modified theory of gravity against observed data one at a time, though perhaps a more efficient approach would be to first probe gravity in a theory-agnostic way and map such information to that on specific theories afterwards. One example of such model-independent tests of gravity with gravitational waves is the parameterized post-Einsteinian formalism, where one introduces generic parameters in the amplitude and phase that capture non-Einsteinian effects. In this paper, we derive gravitational waveforms from inspiraling compact binaries in various modified theories of gravity that violate at least one fundamental pillar in general relativity, such as the strong equivalence principle, Lorentz and parity invariance and commutativity of spacetime. We achieve this by first deriving relations between corrections to the waveform amplitude/phase and those to the frequency evolution and Kepler's third law, since the latter two have already been (or can easily be) derived in several example modified theories of gravity. In particular, such an analysis allows us to derive corrections to the waveform amplitude, which extends many of previous works that focused on deriving phase corrections only. Moreover, we derive modified gravitational waveforms in theories with varying gravitational constant. In particular, we extend the previous work by introducing two different gravitational constants (the conservative one entering in the binding energy and the dissipative one entering in the gravitational wave luminosity), and allowing masses of binary constituents to also vary with time. We also correct some errors in previous literature. Our results can be used to improve current analyses of testing general relativity with available gravitational wave data, as well as to achieve new projected constraints on various modified theories of gravity with future gravitational wave observations. 1 PPE waveforms due to modifications in the propagation sector can be found in [82,93,94], which have been used for GW150914, GW151226 [82] and GW170104 [56] to constrain the mass of the graviton and Lorentz violation.