for "good" results with less pixelation you need a small resolution with a high bitrate
1060 have relates to the turing nvenc a less eco to quality/bitrate
a "good" value is 720P 60FPS 5000-6000 if your connection is above 12.000 in upload
if you use more then 50% of your avaible upload the up/down bounce from the upload affect negativly your game Ping
if you have only ~ 3000 for upload use 720P 30FPS
with nvenc encoder (GPU) on CBR mode with 3000-6000 at the bitrate from above max quality with preset High and lookahead and psycho disabled with 2 b-frames (for make this settings you need advanced settings mode at settings->output
resolution and framerate you set on setting->Video Base canvas your desktop/game resolution and skale canvas 720P FPS on30/60 related to your upload speed like the bitrate
thats a good base setting