Paul is not necessarily saying that the believers in Galatia have left Christ. He is warning them that their desire to keep the law as a means of justification is at odds with faith in Christ, and they will fall from grace if they continue on their course.1
4 You are severed from Christ, you who would be justified by the law; you have fallen away from grace.