How we manage farming and food systems to meet rising demand is pivotal to the future of biodiversity. Extensive field data suggest impacts on wild populations would be greatly reduced through boosting yields on existing farmland so as to spare remaining natural habitats. High-yield farming raises other concerns because expressed per unit area it can generate high levels of externalities such as greenhouse gas (GHG) emissions and nutrient losses. However, such metrics underestimate the overall impacts of lower-yield systems, so here we develop a framework that instead compares externality and land costs per unit production. Applying this to diverse datasets describing the externalities of four major farm sectors reveals that, rather than involving trade-offs, the externality and land costs of alternative production systems can co-vary positively: per unit production, land-efficient systems often produce lower externalities. For GHG emissions these associations become more strongly positive once forgone sequestration is included. Our conclusions are limited: remarkably few studies report externalities alongside yields; many important externalities and farming systems are inadequately measured; and realising the environmental benefits of high-yield systems typically requires additional measures to limit farmland expansion. Yet our results nevertheless suggest that trade-offs among key cost metrics are not as ubiquitous as sometimes perceived.