Use Tools->Auto Configuration Wizard. This will generate settings suited to the capabilities of your hardware. Although your hardware isn't fit to support a game and at the same time a recording app. Recording is a very resource intensive process, as resource intensive as any game you play, so you try to run double the load on your machine that already can barely keep up with the load of the game alone, I suppose.