I briefly review several important formal theory developments in quantum field theory and string theory that were reported at ICHEP conferences in past decades, and explain how they underlie a new research area referred to as physical or quantum mathematics. To illustrate these ideas in some specific context, I discuss certain aspects of topological string theory and a recently discovered knots-quivers correspondence.