REQ Help AI-Integrated Music Player Project

AhrimanSefid1

AhrimanSefid1

New Member
Seeking Guidance for an AI-Integrated Music Player Project

Project Overview:
I am developing a project on OBS Studio that involves playing songs from YouTube. The core functionalities I aim to integrate are:

1. Automatic Song Information Display: Using AI to fetch and display metadata (like title, artist, album, lyrics) for the currently playing track.
2. Periodic AI Image Generation: During playback, at regular intervals (e.g., every few minutes), an AI model should generate an image inspired by the song's mood, lyrics, or metadata.

Specific Questions:

1. Plugin Recommendation: Given the requirements (YouTube playback, AI metadata fetching, and AI image generation), which plugins available for OBS Studio would be most suitable? I am particularly looking for solutions that can handle these tasks efficiently within the OBS Studio environment.
2. Hardware Requirements: Does the AI image generation component necessitate a dedicated graphics card (GPU)? If so, what are the minimal specifications? This is a critical consideration as the system will be installed on a Vps, so there is no vga card.

Additional Context:

· I have already installed OBS Studio.
· The project needs to run stably on a VPS-backed system.

I would greatly appreciate any advice on plugin selection, hardware considerations, and best practices for implementing this workflow. Thank you in advance for your assistance.
 
AhrimanSefid1 said:
Seeking Guidance for an AI-Integrated Music Player Project

Project Overview:
I am developing a project on OBS Studio that involves playing songs from YouTube. The core functionalities I aim to integrate are:

1. Automatic Song Information Display: Using AI to fetch and display metadata (like title, artist, album, lyrics) for the currently playing track.
2. Periodic AI Image Generation: During playback, at regular intervals (e.g., every few minutes), an AI model should generate an image inspired by the song's mood, lyrics, or metadata.

Specific Questions:

1. Plugin Recommendation: Given the requirements (YouTube playback, AI metadata fetching, and AI image generation), which plugins available for OBS Studio would be most suitable? I am particularly looking for solutions that can handle these tasks efficiently within the OBS Studio environment.
2. Hardware Requirements: Does the AI image generation component necessitate a dedicated graphics card (GPU)? If so, what are the minimal specifications? This is a critical consideration as the system will be installed on a Vps, so there is no vga card.

Additional Context:

· I have already installed OBS Studio.
· The project needs to run stably on a VPS-backed system.

I would greatly appreciate any advice on plugin selection, hardware considerations, and best practices for implementing this workflow. Thank you in advance for your assistance.
Click to expand...
Since you will be using Youtube "Automatic Song Information Display: Using AI to fetch and display metadata (like title, artist, album, lyrics) for the currently playing track." this part is not needed, you can fetch all these details from Youtube API (unless you want something like Shazam does)

For image generation you can use OPEN API or nano banana by sending a prompt based on song title and description. As fallback you can still use the video thumbnail from Youtube API. Seems like you try to overcomplicate something that can already be done without AI.
 
Thank you, but I want the songs to be from one or more folders. The songs are private and do not require copyright.
I want you to guide me from 0 to 100 how to do all the steps and whether it is possible or not.
 
I have an open AI account for image and notification generation but I don't know how to lunch it or which plug-in to add please guide me from scratch.
 
For YouTube playback in OBS, you can use the built-in Browser Source — it can render a YouTube video directly in a scene. No extra plugin needed there.

For displaying song metadata and lyrics, I'd recommend OBS Lua or Python scripting (built into OBS) to pull data from an API like Last.fm, MusicBrainz, or even the YouTube Data API and push it to a Text source in real time. There's no single all-in-one plugin for this, so a small custom script will serve you better and give you full control.

For the AI image generation display, you can write a companion script (outside OBS) that generates images on a schedule and saves them to a local folder, then use an Image Source in OBS pointed at that file — enabling "Monitor File" so it refreshes automatically when the file changes.

Also, Local AI image generation (e.g., Stable Diffusion) definitely requires a GPU. Most consumer-grade models need at least 4–6 GB of VRAM. Running inference on CPU is technically possible but extremely slow (a few minutes per image rather than seconds).
 
You must log in or register to reply here.
Back
Top