Hi JimmyK,
There's no key for the library - you'll only be able to enter that room while Nolent is there, so if you're not currently able to gain access, there's something elsewhere in the game that you need to do first. See who's around to talk to - you can check everyone's current location from the character database (I found this feature incredibly useful).