Slow down your outer speed, and maybe have less outer layers. I have a simular issue with ABS as well. I found by slowing down the print speed of the shell, and reducing the outer layers from 3 to 2 helped a lot.
Come to find out that ABS is a bit of a pain as it will go through a wide range of thermal expansion/contraction. So by having more layers on your outer shell by the time your final pass is being done, the first pass will have already be shrinking.
I currently am using Slic3r with repetier-hots. I change my outer speed to 50mm/sec, and layer thickness to 2.