Due to their advantages—longer internal force delay compared to bulk materials, resistance to harsh conditions, damping of a wide frequency spectrum, insensitivity to ambient temperature, high reliability and low cost—granular materials are seen as an opportunity for the development of high-performance, lightweight vibration-damping elements (particle dampers). The performance of particle dampers is affected by numerous parameters, such as the base material, the size of the granules, the flowability, the initial prestress, etc. In this work, a series of experiments were performed on specimens with different combinations of influencing parameters. Energy-based design parameters were used to describe the overall vibration-damping performance. The results provided information for a deeper understanding of the dissipation mechanisms and their mutual correlation, as well as the influence of different parameters (base material, granule size and flowability) on the overall damping performance. A comparison of the performance of particle dampers with carbon steel and polyoxymethylene granules and conventional rubber dampers is given. The results show that the damping performance of particle dampers can be up to 4 times higher compared to conventional bulk material-based rubber dampers, even though rubber as a material has better vibration-damping properties than the two granular materials in particle dampers. However, when additional design features such as mass and stiffness are introduced, the results show that the overall performance of particle dampers with polyoxymethylene granules can be up to 3 times higher compared to particle dampers with carbon steel granules and conventional bulk material-based rubber dampers.