No the CFW is flashed like a normal firmware in the flash. Only games and applications are stored on the harddrive.
Neither the normal update or via Recovery will allow you to "downgrade" any version. Recovery will however allow you to re-flash the current version again. So once you hit 3.56 you can't go back without using a Jig/Service mode/Downgrader method.