“…Thirty studies reported inter-rater reliability [ 8 , 14 , 15 , 19 , 23 , 51 , 54 , 57 – 59 , 72 , 77 , 80 , 81 , 84 , 85 , 98 , 103 , 106 , 110 – 112 , 115 , 120 – 123 , 133 , 135 , 152 ]; fewer reported test-retest reliability [ 36 , 81 , 98 , 122 ] or internal consistency [ 53 , 81 , 86 , 97 ]. The inter-rater reliability of checklists, when used by professional and lay older adult pairs, was reported in four studies; three showed that professionals identified more hazards than lay older adults [ 23 , 111 , 133 ] and one showed that lay older adults reported more of some hazards, while professionals reported more of other hazards [ 110 ]. Further, the reliability of items on a checklist was often reported as excellent for some but poor for others [ 8 , 19 , 58 , 80 , 103 , 110 , 111 , 115 , 121 ].…”