I haven't got much to add to Z-WAMP
website blurb below, apart from the fact that it is available for 32 and 64 bits Windows and that I haven't tested its portability.
Z-WAMP is a lightweight zero-install Web server package that runs on Windows. The project aims to provide the latest production/stable versions of Apache, MySQL, PHP, Adminer, MiniPerl, MongoDB, SQLite, and Alternative PHP Cache (APC) to boost server performance.
latest version (v2.2.1) from http://sourceforge.net/projects/zwamp/files/latest/download