http://www.yellosoft.us/portable-ruby
Too late for me to test the portability (changes in the registry) because I am already running it.
I should have thought of this before!
Portable Ruby
Re: Portable Ruby
Saves settings to AppData, as far as I can test it.