Molecular dynamics simulations have been widely used to study solute permeation across biological membranes. The potential of mean force (PMF) for solute permeation is typically computed using enhanced sampling techniques such as umbrella sampling (US). For bulky drug-like permeants, however, obtaining converged PMFs remains challenging and often requires long simulation times, resulting in an unacceptable computational cost. Here, we augmented US with simulated tempering (ST), an extended-ensemble technique that consists in varying the temperature of the system along a pre-defined temperature ladder. Simulated tempering-enhanced US (STeUS) was employed to improve the convergence of PMF calculations for the permeation of methanol and three common drug molecules. To obtain sufficient sampling of the umbrella histograms, which were computed only from the ground temperature, we modified the simulation time fraction spent at the ground temperature between 1/K and 50%, where K is the number of ST temperature states. We found that STeUS accelerates convergence, when compared to standard US, and that the benefit of STeUS is system-dependent. For bulky molecules, for which standard US poorly converged, the application of ST was highly successful, leading to a more than fivefold accelerated convergence of the PMFs. For the small methanol solute, for which conventional US converges moderately, the application of ST is only beneficial if 50% of the STeUS simulation time is spent at the ground temperature. This study establishes STeUS as an efficient and simple method for PMF calculations, thereby strongly reducing the computational cost of routine high-throughput studies of drug permeability.