Binary sources of gravitational waves in the early inspiral phase are accurately described by a post-Newtonian expansion in small velocity and weak interaction. We compute the conservative dynamics to fifth and partial sixth order using a non-relativistic effective field theory. We give predictions for central observables and determine the required coefficients for the construction of an Effective One-Body Hamiltonian, extending the applicability of our results to the late inspiral and merger phases.