I've fished a bunch of these ponds in NH.
The ones in the more popular hiking areas are the best known and therefore receive the most pressure, no matter how difficult to get to.
The pond that I fished most often was on a trail that went "nowhere". No special views and no great elevation gain.
At some point when the trail must have been more of a skid road, someone had driven a tin boat up there. All you had to do was find a stout branch to pole around the pond and something to bail with.
Great place to fish.