The wild chestnuts around this leafy college town used to grow in such great numbers that locals collected the nuts by the bushel and shipped them off to New York City for a small fortune.