The classical Kneser-Milnor theorem says that every closed oriented connected 3-dimensional manifold admits a unique connected sum decomposition into manifolds that cannot be decomposed any further. We discuss to what degree such decompositions exist in higher dimensions and we show that in many settings uniqueness fails in higher dimensions.