Usability Testing

[bradjensen68]

Hello and thanks for creating such an awesome tool! I have a rather unique use case for OBS studio - I am a usability specialist and was looking for software that I could use to record my usabiity tests on a linux device with multiple cameras as well as the desktop. Though there exists software that is specifically written for this purpose (Morae, Ovo, etc.) they do not run on Linux and are difficult, expensive, or impossible to get working with multiple cameras. So far, I am very happy with the results I have seen with OBS. The difference between what I can get out of OBS and a professional usability software such as Morae is the ability to take notes and set markers during the test. For this, I am currently setting timestamps using the plugin Infowriter and then recording it to the screen using a text field with the chat option. What I would like to be able to do is to customize and have pre-sets available before the tests that I can add instead of just a simple timestamp.

Specifically:

Name of the user (User1, User 2, etc)
Free form notes during the test
Task name and start time
Task end and time
Type of completion (sucessful, sucessful with hint, technical error, failure to complete, etc.)

I am thinking with would have to be a separate window that would run during recording.

I realize that my request does probably not apply to most of the users of OBS studio, but I do have some resources here that I might be able to apply to development of such a plug-in and I am looking for others who might be interested.

 

[Chibikawaii]

I have a very strong interest in this as well, if there has been any movement on this.

 

[Eric T.]

Hi Brad,

Many thanks for the above post. I'm a UX researcher trying to figure out a streaming solution for my studies. I'm currently using 2 iPevo cameras, one for the mobile device and one on the participant. This is displayed using the iPevo split screen function on my monitor. I've been sharing my screen using Adobe Connect, but I think the two video feeds are too much and remote observers are seeing stuttering video. I think OBS might be the solution, but wanted to ask you if you could explain how you set up your current system - and also whether I can continue to use 2 iPevo cameras with OBS. Any help would be much appreciated!

Thanks again,

Eric

 

[Eric T.]

Also, I'm using Display capture, and get the below image. Any idea what might be going on?

 

[teamx123]

I also am interested in this thank you very much

 

[bradjensen68]

So, I have been running tests using our own version of Linux, two Logitech C930e's - one to capture the face and one for the keyboard/ touch screen movements, with OBS. I am also recording the desktop. I use VNC to view the screen and the cameras from a separate laptop during the testing. Because I have a mobile rig, I am sitting in the room with the test subjects and do not need to have a microphone set up for them to hear me, but that might be a consideration for others. The recordings are clear with no stuttering. Better than some commercial usability testing software. I am having some trouble with our version of Linux since it is designed for an industrial product and is using OpenGL 3.0. This causes OBS to crash so getting this upgraded to at least 3.2 is critical for me. Other than that, I am happy.

This setup works well for me since I did not use a lot of the markers and notes, etc. that purpose-designed usability software includes. I simply was not able to follow/conduct the tests and type notes at the same time. I have looked into using closed-captioning software for this purpose, but have not followed up on that since I probably wouldn't use it anyway. The InfoWriter plug-in is available for very simple time stamps. Of course Time on Tasks etc. are also not automatically calculated and reported like purpose-design off the shelf usability software offers.

Eric T. - this is just the screen you get when the test device is also the device running the OBS software. You are capturing the OBS interface with the OBS software causing this infinite mirror image. Just hit record and then let OBS run in the background and run your application on top of it. OBS will be recording your screen even if you cannot see OBS.

By the way, I am not streaming the tests, just recording them directly to the device I use for testing. My environment does not allow for streaming. I wish I could stream it as well so that others could watch the test but my corporate info security will not let me.

*EDIT*: Got OpenGL 3.3 running and no more crashes! Yeah!

 

[bradjensen68]

Just discovered NohBoard for recording keyboard input and mouse tracking. This would be cool if it could be configured to show up in the stream/recording but not on the users screen! (and if it were Linux compatible).

EDIT: It can be configured to record while running in the background. Set it up as a frame capture and make sure aero is turned on for Win 7. Mouse tracking just shows direction and whether the button has been clicked. Keyboard is configurable which is really useful for me. Still can't use it though because I need Linux :(

 

[brewerpe]

I have been reading this thread with interest. I don't run Linux, but I am trying to figure out how to use OBS for remote and f2f usability testing. As I understand it, I can use OBS to stream, record, and make video clips. I can't use it for marking/coding. Do you all know of any basic guides for using it to set up remote usability tests? Many thanks for any info. Pam

 

[uxward]

Brad - we've been using OBS w/ Logitech cams for moderated usability studies almost as long as you (since 2017). Not sure why it took me so long to discover this thread.

I'd love to pow-wow with you about using OBS for usability studies when you've got a few minutes. You can find me on Twitter @uxward

We're to the point now where it feels like we need more than OBS...something like Morae...but I'd love to find a way to stick w/ OBS for a number of reasons.