Using Data from Schools and Child Welfare Agencies to Predict Near-Term Academic Risks

This study provides information to administrators, research offices, and student support offices in local education agencies (LEAs) interested in identifying students who are likely to have near-term academic problems such as absenteeism, suspensions, poor grades, and low performance on state tests. It describes an approach for developing a predictive model and assesses how well the model identifies at-risk students using data from two LEAs in Allegheny County, Pennsylvania. It also examines which types of predictors—including those from school, social services, and justice system data systems—are individually related to each type of near-term academic problem to better understand the causes of why students might be flagged as at risk by the model and how best to support them. The study finds that predictive models which apply machine-learning algorithms to the data are able to identify at-risk students with a moderate to high level of accuracy. Data from schools are the strongest predictors across all outcomes, and predictive performance is not reduced much when excluding social services and justice system predictors and relying exclusively on school data. However, some out-of-school events are individually related to near-term academic problems, including child welfare involvement, emergency homeless services, and juvenile justice system involvement. The models are more accurate in a larger LEA than in a smaller charter network, and they are better at predicting low GPA, course failure, and below basic performance on state assessments in grades 3-8 than they are for chronic absenteeism, suspensions, and below basic performance on end-of-course high-school standardized assessments. Results suggest that many LEAs could apply machine-learning algorithms to existing school data to identify students who are at-risk of near-term academic problems that are known to be precursors to dropout.