For nearly 100 years, electronic bee counters have been developed using various technologies to track the foraging activity of mostly honey bee colonies. These counters should enable remote monitoring of the hives without disturbing natural flight behavior while generating precise scientific data. Today, however, there are not many counters on the market, that are able to fulfill this task. One main challenge is the lack of standardized methods to validate a counter's precision, but validation is crucial to categorize and judge the data produced by the counter, especially for scientific purposes. Another challenge is the interpretation of flight data to measure the effects of environmental or anthropogenic sources. Nevertheless, recent developments in the field are promising. This review describes the historic development of automated bee flight measurement and critically compares validation methods to encourage their improvement. Lastly, to increase the comparability of future analyses with bee counters, current advances in data interpretation are also presented.