If you felt he had let you go, he most probably did.  if you felt left by your own, you probably were. He only says not, because he is scared.  He didn't know how it feels to be really on your own.