My yard hydrant line sprang a leak back in March, it's just 1" Polly well line. It was put in by the previous owner; I had no idea where it ran. Thankfully, there was a curb stop inline to cut off the hydrant, so I had an idea how deep, and guessed a relatively straight line from A to B for location. I probed around for the wettest area and dug down about 3 feet to the line, kicked the well back on and looked for water to fill the hole from the left or right. Took 3 tries to get down on it, but it worked, just a little trial and error.
I work for the local water utility, and in the past, when helping out with main breaks, I've seen guys successfully use geophones to listen for where the water sounds loudest, or like NCL suggested, dousing rods.