The proposed high-luminosity high-energy Electron-Ion Collider (EIC) will provide a clean environment to precisely study several fundamental questions in the fields of high-energy and nuclear physics . A low material budget and high granularity silicon vertex/tracking detector is critical to carry out a series of hadron and jet measurements at the future EIC especially for the heavy flavor product reconstruction or tagging. The conceptual design of a proposed forward silicon tracking detector with the pseudorapidity coverage from 1.2 to 3.5 has been developed in integration with different magnet options and the other EIC detector sub-systems. The tracking performance of this detector enables precise heavy flavor hadron and jet measurements in the hadron beam going direction. The detector R$\&$D for the proposed silicon technology candidates: Low Gain Avalanche Diode (LGAD) and radiation hard depleted Monolithic Active Pixel Sensor (MALTA), which can provide good spatial and timing resolutions, is underway. Bench test results of the LGAD and MALTA prototype sensors will be discussed.