Cosmic rays are thought to be efficiently produced in collisionless shocks in high-energy astrophysical sources, where cosmic rays are diffusively scattered by magnetic fluctuations. The magnetic field near the shock decides the maximum energy of cosmic rays accelerated in the shock and the emission by the accelerated particles. However, the magnetic field strength and structure around the shock are not understood yet. Recent magnetohydrodynamics (MHD) simulations of shocks propagating into inhomogeneous media show that the ambient magnetic field is amplified by a turbulent dynamo in the downstream region. According to these simulations, the turbulent dynamo always works as long as the magnetic energy is smaller than the kinetic energy of the downstream turbulence. However, the shocks formed in astrophysical phenomena are often driven by collisionless plasma, where non-thermal particles are generated, so that it is unknown whether or not the MHD approximation is applicable to the downstream flow. In particular, for shocks in gamma-ray bursts, the size of density fluctuations has to be about ten times the gyroradius of the thermal protons to amplify the magnetic field by the downstream turbulence. We perform particle-in-cell simulations of relativistic collisionless shocks propagating into a pair plasma with a density clump whose size is ten times the gyroradius of downstream thermal plasmas. We found that the magnetic field amplification does not work if the amplitude of the upstream density fluctuation is below a critical value.