Saeka Onsen is a very nice onsen close to Nasushiobara. It has a beautiful mountain view from the outside pool. This onsen is recommended.
The view from the bath.
Its open until 10PM so it would be possible to go there after work. I don't think you can stay the night there its just a day visit place.