Do you set white and black points on your image?
I rarely do this directly using Levels or the Blacks/Whites slider Lightroom. Typically in the field I aim to get a histogram that spans the full dynamic range of the sensor, so my black and white points are often established well from the get go. Then during processing I’m always keeping an eye on my histogram to make sure I don’t clip any shadows or highlights. Of course it all depends on the individual images….some that may have been very low contrast in the field will necessitate moving the black and white points in order to draw out all the tones and texture in the photo.