Black Holes ~ Are They "Pulling" Time?

I was thinking about black holes this morning. When matter approaches a black hole time is altered, sped up. So of a human were able to survive a close approach to a black hole, time would speed up for them, while remaining the same for everyone else. 
With that in mind, what if black holes "pull" spacetime forward across the entire fabric of time? Suppose that black holes including the super ones at the center of galaxies, are evenly spaced in the entire Universe? And suppose that that spacing is enough to "pull" the fabric of spactime forward. Something is pulling time forward otherwise we could go backward. So since the pull of black holes is so strong and since time is severely dilated by that pull, could it be that black holes are pulling time in one direction, forward?