Even with a circular orbit, if you’re unbound by gravity you’ll follow a straight path while the Earth curves, resulting in it appearing to accelerate away from you.