The Fermi satellite has detected ~60 radio galaxies (RGs). We investigate the difference in the properties of X-ray spectra between GeV-loud RGs and GeV-quiet RGs. Our sample comprises 68 objects: 36 GeV-loud RGs and 32 GeV-quiet RGs. For 68 RGs, we analyzed the X-ray spectra of the XMM-Newton, Chandra, NuSTAR, and Swift. Our results show that most GeV-loud RGs do not exhibit significant absorption, while ~50% of the GeV-quiet RGs exhibit significant absorption. This suggests that the jet of GeV-loud RGs is viewed from a small angle, and thus the radiation from the near to the SMBH is not easily blocked by the torus. Moreover, we reported that RGs with a heavy absorption is mostly in the X-ray luminosity range of 10^43-10^45 erg s^-1; however, few RGs with lower and higher luminosity suffer from heavy absorption. This is the same trend as that of Seyfert galaxies.