The development of immunotherapy is an important breakthrough for the treatment of cancer, with anti-tumor efficacy observed in a wide variety of tumors. To optimize immunotherapy use, approaches must be developed to identify which patients are likely to achieve benefit. To minimize therapeutic toxicities and costs, understanding the ideal choice and sequencing of the numerous immuno-oncology agents available for individual patients is thus critical, but fraught with challenges. The immune tumor microenvironment (TME) is a unique aspect of the response to immuno-oncology agents and measurement of single biomarkers does not adequately capture these complex interactions. Therefore, multiple potential biomarkers are likely needed. Current candidates in this area include PD-L1 expression, CD8+ tumor infiltrating lymphocytes, tumor mutation load and neoantigen burden, immune related gene signatures and multiplex immunohistochemical assays that examine the pharmacodynamic and spatial interactions of the TME. The most fruitful investigations are likely to use several techniques to predict response and interrogate mechanisms of resistance. Immuno-oncology biomarker research must employ validated assays to ask focused research questions utilizing clinically annotated tissue collections and biomarker focused clinical trial designs to investigate specific endpoints. Real time input from patients and their advocates into biomarker discovery is necessary to ensure that the investigations pursued will improve both clinical outcomes and quality of life. We herein provide a framework of recommendations to guide the search for immuno-oncology biomarkers of value.