The wide range of answers to this has been really helpful. What I'm getting out of it is this: If you're a linked-in refuser (like I've been so far) then it limits you somewhat, filtering out some potential employers, but possibly in a good way.
But you don't HAVE to use it. Good to know!