The Gamma quadrant end of the wormhole is only slightly closer to Ocampa than Earth is (according to most galaxy charts).
Voyager would have only saved a little time heading for the wormhole, and the end of that journey would have been through enemy territory. With the war going on, it would have been a very unsafe bet. They could have gotten there only to find the wormhole collapsed.
Here's a map: