Ryder's parents may have wanted things to be as consistent as possible, but they took most of Ryder's support away from him. They left the top of the tower in place, but most of the base was gone, so it's to be expected that Ryder's been unstable since the move. Having Jeremy back is certainly helping, and Callen will hopefully also help, but it's going to take time. On the plus side, it's a chance for Ryder to grow, to become less dependent on others for his emotional well-being. Only time will tell if that happens, though.