I grew up in a neighborhood that was next to a sand and gravel pit. The biggest take away I can give is that it was a little noisy. at times. You can hear the trucks and equipment. Though it did become background noise eventually and you stop noticing it as much.
I live close enough to hear the noise. My city started promising to develop a park and housing where it sits 25 years ago. It's still there--on prime waterfront real estate.