Any reasonably modern computer has sufficient resources to run the requisites of most, if not all, CMS's. Heck, if the amount of users that make use of these requisites is low, even older systems (Pentium 4 class) won't have problems. On Windows you have a lot of choice.
XAMPP is one of those solutions. But there are many more and have been discussed previously on the boards here.
When you run such a solution you will have a working Apache web server, a MySQL database server and PHP. These are the building blocks which most CMS's need to function. After that is done, find the CMS you like on this
website.
In my experiences with XAMPP I always liked that by default all is stored in the main folder XAMPP. You usually install it in C:\XAMMP or extract it in such a location (yes, it can be used as a portable app too).
The one thing you should remember though, is that the computer running XAMPP isn't too exposed to the internet. Solutions such as XAMPP are meant for testing and developing and should not be used in a production environment. At least not with their default settings enabled. To my knowledge any of these solutions come with instructions to make them safe for a production environment.
Yes, all of the above will require you to study, but you will be glad that you did in the long run.
