Question / Help Exclude Processes from Game Capture

[Parallax Abstraction]

Hey everyone. I've got what's probably a niche case here but I wanted to ask if there was a way to have OBS exclude applications from hooking into game capture sources? I'll explain my scenario.

I recently built a new dedicated encoding box/home server. I use NDI to send the feed from my main PC to this new machine that does the encoding. It works a jig generally but here's the catch. Due to limited space, I just RDP to this machine, rather than give it its own dedicated monitor. I usually try to leave RDP up so I can monitor the machine as I'm streaming, especially since I have to manually start and stop the stream on that system.

Here's the problem though: RDP detects as a hookable source by OBS' game capture. If I have it open on my second monitor while also playing a game, it causes my game source frame rate to tank in OBS (as low as 40fps.) The game itself runs fine, it's just OBS that loses a ton of frames in encoding. If I close RDP, my frame rate comes back to 60 and stays there. This could be solved by telling OBS to just ignore RDP as a game capture source (I have several video capture applications I use for YouTube that all can exclude by process name) but I didn't see any options to do that. I was wondering if there's some way to do this outside of the normal UI that I don't know about?

If not, this would be a great feature to see added but I know it wouldn't be a high priority. If I have to find another remote management tool to use with the server, I will but I wanted to see if there was something I could do with this first since RDP is very fast and reliable. I can post a log if desired but the one I captured from tonight's streaming session really doesn't show anything that would be valuable here. Thanks!

 

[BornDownUnder]

Instead of 'capture any full screen application' in your source properties settings, target the game executable should solve this.

For example:
Source - Game Capture
Name of Source - Battlefield 4
Properties for Battlefield 4 source:
Mode - Capture specific window
Window - [bf4.exe] Battlefield 4
Window Match Priority - Match title, otherwise find window of same executable

 

[Parallax Abstraction]

Hmm, an interesting idea. Kind of achieving the same goal with the opposite approach of not excluding RDP but specifically including the game processes. I'll give this a try tonight and see what happens. Having the process exclusion would be ideal but this isn't too much extra work. I'm also working on using Unified Remote to control the start and stop of my stream and some other things from my phone, which would eliminate the need to keep RDP open to my server at all times. I'll report on how this works out. Thanks!