Does a Python/Lua script have access to the main rendered video frames?

[singleballplay]

I'm looking to do some processing with Python on the video frames and rather than create an output plugin like the ndi one I was wondering if it would be possible for a Python or Lua script to access the rendered video frames from the main output? Or would I need to do something like the ndi plugin?