Precision measurements of $|V_{ub}|$ and $|V_{cb}|$ play a central role in tests of the CKM sector of the Standard Model and complement direct measurements of CP violation in B meson decays. In this talk, first studies for measuring $|V_{ub}|$ and $|V_{cb}|$ with semi-leptonic decays are presented using collision events recorded at the $\Upsilon(4S)$ resonance by the Belle II experiment. Belle II is located at the SuperKEKB accelerator complex near Tokyo in Japan, and started recording collision data in Spring 2019. We report the status of measuring branching fractions and kinematic properties of inclusive and exclusive decays using untagged and tagged approaches using 36.7 fb$^{-1}$ of Belle II data.