We study the wavelength scaling of high harmonic generation efficiency with visible driver wavelengths in the transition between the tunneling and the multiphoton ionization regimes where the Keldysh parameter is around unity. Our experiment shows a less dramatic wavelength scaling of efficiency than the conventional case for near- and mid-IR driver wavelengths, and it is well explained by a generalized three-step model for increased Keldysh parameters that employs complex ionization times in addition to the nonadiabatic ionization. The complex ionization time is critical to avoid the divergence when replacing the quasistatic ionization model by the more general nonadiabatic ionization model. Together, the two modifications present a consistent description of the influence of the atomic potential on the rescattering process in the intermediate Keldysh regime.