The Level of Service Inventory Revised (LSI-R), one of the thrid generation of risk assessment tools, is tested in this study for inter-rater reliability by presenting a series of vignettes to 167 trainees in the LSI-R and analyzing them for level of agreement in how they estimated risk.