Lots of good questions! Let me try to reply to all of them:
Yep, you can compile and server your Jekyll pages locally, or you can publish them on something like GitHub pages. I do both.
Yeah, you need a few other things. But most of that is just a one-time installation that you never have to worry about again.
I use both! I generally prefer Windows though.