Question / Help Help getting software to compile from source

[CathodeRayBlues]

Using Linux Mint 18.3 64-bit (originally came with xfce but I retrofitted MATE as the default DE later).
System brandishes an i5-2400, GTX 660, and 8GB RAM.
I have spent the past day trying to get OBS to recognize NVENC as an encoding option, since the software H264 encoder is very unstable and taxing on my aging CPU. Google has pointed me to countless threads on how recompiling FFMPEG with NVENC enabled fixes everything. Running the command "ffmpeg -codecs" shows that all NVENC encoders are enabled. Though my installation of OBS still does not have NVENC as an option. Then I read that you have to also compile OBS itself from source to get it to work, and that's where I had trouble. I made sure to carefully follow the instructions, but it failed to build.
Here is what my terminal says:

~/obs-studio/build $ make -j4
[  3%] Built target jansson
[  3%] Automatic moc for target obs
[  4%] Built target glad
[  5%] Built target media-playback
[  5%] Automatic moc for target frontend-tools
[  5%] Built target ffmpeg-mux
[  5%] Built target obs_automoc
[  5%] Built target frontend-tools_automoc
[ 28%] Built target libobs
[ 29%] Built target file-updater
[ 29%] Built target obs-frontend-api
[ 32%] Built target linux-capture
[ 35%] Built target libobs-opengl
[ 36%] Built target linux-pulseaudio
[ 38%] Built target linux-v4l2
[ 39%] Built target linux-alsa
[ 40%] Built target linux-jack
[ 43%] Built target linux-decklink
[ 44%] Built target vlc-video
[ 45%] Built target obs-x264
[ 47%] Built target image-source
[ 48%] Built target obs-libfdk
[ 50%] Built target obs-ffmpeg
[ 50%] Building C object plugins/obs-outputs/CMakeFiles/obs-outputs.dir/librtmp/rtmp.c.o
[ 55%] Built target obs-filters
[ 58%] Built target obs-transitions
[ 59%] Built target rtmp-services
[ 61%] Built target text-freetype2
[ 64%] Built target obs-scripting
[ 67%] Built target obslua
[ 67%] Built target _obspython
[ 71%] Built target frontend-tools
In file included from /home/blues/obs-studio/plugins/obs-outputs/librtmp/handshake.h:107:0,
                 from /home/blues/obs-studio/plugins/obs-outputs/librtmp/rtmp.c:175:
/home/blues/obs-studio/plugins/obs-outputs/librtmp/dh.h: In function ‘DHComputeSharedSecretKey’:
/home/blues/obs-studio/plugins/obs-outputs/librtmp/dh.h:360:12: warning: variable ‘len’ set but not used [-Wunused-but-set-variable]
     size_t len;
            ^
In file included from /home/blues/obs-studio/plugins/obs-outputs/librtmp/rtmp.c:175:0:
/home/blues/obs-studio/plugins/obs-outputs/librtmp/handshake.h: In function ‘InitRC4Encryption’:
/home/blues/obs-studio/plugins/obs-outputs/librtmp/handshake.h:142:18: warning: variable ‘digestLen’ set but not used [-Wunused-but-set-variable]
     unsigned int digestLen = 0;
                  ^
/home/blues/obs-studio/plugins/obs-outputs/librtmp/handshake.h: In function ‘HMACsha256’:
/home/blues/obs-studio/plugins/obs-outputs/librtmp/handshake.h:301:18: warning: variable ‘digestLen’ set but not used [-Wunused-but-set-variable]
     unsigned int digestLen;
                  ^
/home/blues/obs-studio/plugins/obs-outputs/librtmp/rtmp.c: In function ‘RTMPPacket_Alloc’:
/home/blues/obs-studio/plugins/obs-outputs/librtmp/rtmp.c:245:15: warning: comparison is always false due to limited range of data type [-Wtype-limits]
     if (nSize > SIZE_MAX - RTMP_MAX_HEADER_SIZE)
               ^
In file included from /home/blues/obs-studio/plugins/obs-outputs/librtmp/rtmp.c:32:0:
/home/blues/obs-studio/plugins/obs-outputs/librtmp/rtmp.c: In function ‘RTMP_TLS_Accept’:
/home/blues/obs-studio/plugins/obs-outputs/librtmp/rtmp_sys.h:140:2: error: implicit declaration of function ‘mbedtls_ssl_conf_dh_param_bin’ [-Werror=implicit-function-declaration]
  mbedtls_ssl_conf_dh_param_bin(ctx->conf,\
  ^
/home/blues/obs-studio/plugins/obs-outputs/librtmp/rtmp.c:1005:5: note: in expansion of macro ‘TLS_server’
     TLS_server(srv_ctx, r->m_sb.sb_ssl);
     ^
[ 92%] Built target obs
cc1: some warnings being treated as errors
plugins/obs-outputs/CMakeFiles/obs-outputs.dir/build.make:662: recipe for target 'plugins/obs-outputs/CMakeFiles/obs-outputs.dir/librtmp/rtmp.c.o' failed
make[2]: *** [plugins/obs-outputs/CMakeFiles/obs-outputs.dir/librtmp/rtmp.c.o] Error 1
CMakeFiles/Makefile2:1653: recipe for target 'plugins/obs-outputs/CMakeFiles/obs-outputs.dir/all' failed
make[1]: *** [plugins/obs-outputs/CMakeFiles/obs-outputs.dir/all] Error 2
Makefile:149: recipe for target 'all' failed
make: *** [all] Error 2

Does anyone have a similar problem or know how to fix this? Or am I going to have to wait until NVENC is readily available in a PPA release?
(Or til I can afford a more powerful CPU that can handle software x264 properly for that matter)

 

[Harold]

Do you have an up to date version of the mbedtls dev package installed?

 

[CathodeRayBlues]

Do you have an up to date version of the mbedtls dev package installed?

I don't recall, but I will try updating/installing that and see what happens, thanks.

UPDATE: it says that I am running version 2.2.1-2, and the terminal tells me there isn't any newer version is available.

 

[CathodeRayBlues]

UPDATE: I resolved to completely wipe and fresh-install Linux Mint 19 MATE after having issues with other things, and somehow I am able to compile from source and NVENC works. No problems anymore!