No chroma key needed. The cleanest way is to export the animated skin as a WebM with alpha (VP9 with transparency) and leave the "windows" fully transparent:
1. Put your video sources (cameras or guests) at the bottom of the Sources list, each positioned where its window will be.
2. Add the skin as a Media Source on top, tick Loop. OBS plays the alpha channel, so the videos show through the holes.
3. For non-rectangular windows (circles, hexagons, tilted shapes), the video itself still needs masking or its corners will stick out past the frame: right-click each video source > Filters > Effect Filters > + > Image Mask/Blend, Type "Alpha Mask (Alpha Channel)", and point it at a PNG that is white/opaque where the video should show and transparent elsewhere, same size as the source.
A PNG sequence works too (Image Slide Show), but WebM alpha is lighter and loops smoothly. Avoid MP4 for the skin, it has no transparency so you'd get a black box.
Disclosure: I made NeonStreamLab (stream overlays). I wrote up the frame-over-camera layering here:
How to add a webcam overlay in OBS