Contextual characteristics influence infant mortality above and beyond family-level factors. The widespread practice of polygyny is one feature of many sub-Saharan African contexts that may be relevant to understanding patterns of infant mortality. Building on evidence that the prevalence of polygyny reflects broader economic, social, and cultural features and that it has implications for how families engage in the practice, we investigate whether and how the prevalence of polygyny (1) spills over to elevate infant mortality for all families, and (2) conditions the survival disadvantage for children living in polygynous families (i.e., compared with monogamous families). We use data from Demographic and Health Surveys to estimate multilevel hazard models that identify associations between infant mortality and region-level prevalence of polygyny for 236,336 children in 260 subnational regions across 29 sub-Saharan African countries. We find little evidence that the prevalence of polygyny influences mortality for infants in nonpolygynous households net of region-level socioeconomic factors and gender inequality. However, the prevalence of polygyny significantly amplifies the survival disadvantage for infants in polygynous families. Our findings demonstrate that considering the broader marital context reveals important insights into the relationship between family structure and child well-being.