If I understand you correctly, you have 2 layers. The bottom layer is your game with the yellow numbers and the tiny icons. Your second layer is an overlay that overlays the numbers and icons with some external images.
Now you want to extract and pull the yellow numbers from the bottom layer and put it as 3rd layer above the overlay.
May be possible, if you capture the game and the overlay with distinct sources within OBS. Not possible, if you just capture everything as one source such as display capture. For some filter in OBS to be able to get the numbers, you need the numbers visible in some source.
This filter should be applied to a duplicate of the game video source and needs to "filter out" the yellow numbers, setting everything else to transparent, then being placed above the overlay source.
However, as you already found out, you want an inverse chroma key filter - keep everything that matches the chroma and remove everything that doesn't match. I only saw similar questions with a forum search, but never a solution.