Oh, absolutely. But I find I prefer to bring those sorts of Bible quotes to the discussion when relevant, rather than just saying "Well, I don't believe in that thing you're quoting." Putting them in the position of having to disavow certain parts of the Bible makes for an interesting discussion, especially in the context of...

Deuteronomy 4:2

Do not add to what I command you and do not subtract from it, but keep the commands of the Lord your God that I give you.