We investigate the dynamic critical behavior of a relativistic scalar field theory with $Z_2$ symmetry by calculating spectral functions of the order parameter at zero and non-vanishing momenta from first-principles classical-statistical lattice simulations in real-time. We find that at temperatures above the critical point ($T>T_c$), the spectral functions are well described by relativistic quasi-particle peaks. Close to the transition temperature ($T\sim T_c$), we observe strong infrared contributions building up. In the ordered phase at low temperatures ($T<T_c$), in addition to the quasi-particle peak, we observe a soft mode with a dispersion relation indicative of collective excitations. Investigating the spectral functions close to $T_c$, we demonstrate that the behavior in the vicinity of the critical point is controlled by dynamic scaling functions and the dynamic critical exponent z, which we determine from our simulations. By considering the equations of motion for a closed system and a system coupled to a heat bath, we extract the dynamic critical behavior for two different dynamic universality classes (Models A & C) in two and three spatial dimensions.