I'm writing a book and refer to quick references to spark creativity but also learn other words to improve my vocabulary. Is this plagiarism?

Simply put, plagiarism is copying someone else's work and trying to pass it off as your own. If you only pull isolated words, you aren't copying anyone's work, because the "work" is deciding to use that word in a given context, and your context isn't the same.