The preservation of tropical forests is increasingly at risk, including forests located within human-modified landscapes that retain high conservation value. People modify and interact with these landscapes through a wide range of uses. However, our knowledge of how different forest uses affect biodiversity is limited. Here, we analyse the responses of different taxa to four distinct categories of forest management, namely old-growth forest, Brazil nut extraction areas, reduced impact logging areas, and eucalyptus plantations. Within six independent replicates of each category, we sampled three taxa (fruit-feeding butterflies, dung beetles, and trees) in eastern Amazonia. Forests under moderate use (Brazil nut extraction and reduced-impact logging) had similar, albeit slightly lower, diversity levels relative to old-growth forests, while communities in plantations were significantly less diverse. Only 4%, 20%, and 17%, of the sampled butterfly, dung beetle, and tree species, respectively, were restricted to old-growth forests. This study provides further empirical evidence of the importance of old-growth forest conservation in the context of human-modified landscapes. It also suggests that landscape matrices integrating forest uses at varying intensities are well positioned to reconcile biodiversity conservation with the production of goods that support local livelihoods.