Does a quarry keep chunks loaded after it has finished?

Yes, a quarry will keep chunks within its area of operation loaded before and after doing its thing. They will only be unloaded when the Quarry block is removed.

To test this, I simply set up a system that pumps items out of an Ender Chest (from the Ender Storage mod) into a regular chest near a quarry that had reached bedrock.

Then, I went to the Nether, restarted the server for good measure, and put items into the corresponding Ender Pouch. They started disappearing, which means that the chunks in the overworld were still loaded.