YAReG - read ReiserFS partitions in Windows
This tool only supports reading, tho that's better than nothing at all.
No installation is necessary, just un-pack and run yareg.exe, it will auto-detect the reiserfs partitions you have on your system.
The only dependency is the .NET framework, which you can also download from the page in case it is missing
And without further ado, the tool:http://yareg.akucom.de/Ext2(3) Installable File System For Windows
This one is also able to access ext3 partitions, full access with read and write on top of that
You need to run the installer for this one, since it is somewhat bigger but offers way more features, too.
Website for Ext2 IFS:http://www.fs-driver.org/
All the tools are free and released under the GPL