You would also need to bring the 4 books of the dead to the golden hand instead of to the loreseekers. Essentially choosing one over the other. I killed the golden hand. The iron golem dropped a pretty sweet 1 hand weapon. (Iron golem's fist).
MOD EDIT (Nov. 26, 2017) This is an old thread so locking it. Also, to access the Library, you don't need to bring ALL four secrets of the dead books to the Golden Hand. You just need 1 or more rep with the Golden Hand, which can be done in several different ways. See wiki for more details.