I see all sorts of answers online, but am not fully convinced. I tried finding some research on the longevity of clothes between wash and wash + dry. Considering that it dries for hours just the mechanical movement should damage the clothes I would assume?
Something to consider: damage from drying machines is apparently one way we inadvertently injest microplastics (the synthetic materials in the clothing gets broken up and then is ingesting through the skin). Might be something worth avoiding for your baby (though the convenience of a dryer is still hard to argue with).