We present ground state spectra of mesons containing a charm and a bottom quark. For the charm quark we use overlap valence quarks while a non-relativistic formulation is utilized for the bottom quark on a background of 2+1+1 flavors HISQ gauge configurations generated by the MILC collaboration. The hyperfine splitting between 1S states of $B_c$ mesons is found to be $56^{+4}_{-3}$ MeV. We also study the baryons containing only charm and bottom quarks and predict their ground state masses. Results are obtained at three lattice spacings.