If the Higgs vacuum expectation value v in early universe is ∼ 1% higher than its present value v 0 = 246 GeV, the 7 Li puzzle in BBN and the CMB/ΛCDM tension with late-universe measurements on Hubble parameter are mitigated. We propose a model of an axion coupled to the Higgs field, named "axi-Higgs", with its mass m a ∼ 10 −30 −10 −29 eV and decay constant f a ∼ 10 17 −10 18 GeV, to achieve this goal. The axion initial value a ini yields an initial ∆v ini /v 0 ∼ 0.01 throughout the BBNrecombination epoch and a percent level contribution to the total matter density today. Because of its very large de Broglie wavelength, this axion matter density ω a suppresses the matter power spectrum, alleviating the CMB/ΛCDM S 8 /σ 8 tension with the weak-lensing data. It also explains the recently reported isotropic cosmic birefringence by its coupling with photons. Adding the axion (m ∼ 10 −22 eV) in the fuzzy dark matter model to the axi-Higgs model allows bigger ∆v rec and ω a to address the Hubble and S 8 /σ 8 tensions simultaneously. The model predicts that ∆v may be detected by the spectral measurements of quasars, while its oscillation may be observed in the atomic clock measurements.