Digital music icon Don Diablo is thought for pushing the boundaries of music, visible arts and dwell efficiency — and the music video for his newest single, “BLACKOUT,” explores utilizing generative AIcombining NVIDIA RTX-powered and cloud-based instruments in a hybrid workflow.
Set inside an industrial warehouse, the video options Diablo performing in entrance of an immersive, AI-generated surroundings — mixing stylized results, a cinematic temper and personalised components.
The picture creation and experimentation was completed regionally on a desktop powered by a NVIDIA GeForce RTX 5090 GPU, whereas the ultimate animation was rendered utilizing Sound aia cloud-based generative video instrument. This hybrid method gave the workforce inventive management and high-fidelity outcomes.
CTRL + ALT + Create With RTX
All image-based work within the music video — together with stylization and id modeling — was carried out regionally utilizing Comfyuia visible, node-based interface for constructing and customizing generative AI workflows.
With minimal setup, the workforce might launch preconfigured workflows and experiment freely with completely different fashions and methods. ComfyUI supplied pace, ease of use and assist for a variety of open-source instruments — enabling quick iteration and distinctive visuals that aligned with Diablo’s inventive course.
Diablo wished the visuals to replicate his id — not simply function decor. To realize this, a customized mannequin was educated on a facial dataset of Diablo, utilizing low-rank adaptation within the FLUXGYM person interface.
The ensuing mannequin was then loaded into ComfyUI and built-in right into a Steady Diffusion pipeline for stylized picture technology. An identity-embedding node ensured constant facial options throughout frames, in addition to stylistic cohesion.
As soon as the imagery was locked, the workforce turned to Kling AI within the cloud to animate the visuals into dynamic scenes, harnessing the instrument’s superior physics and cinematic capabilities.
This workflow, all operating regionally on an RTX 5090 GPU, enabled sooner iteration, exact visible management, tighter suggestions loops and full inventive autonomy. It showcases how creators can use native RTX-powered instruments — in addition to cloud-based platforms for pre-defined workloads that require extra compute — to shortly and simply produce high-impact content material on their phrases.
“Working with these new AI instruments actually seems like moving into my very own thoughts,” mentioned Diablo. “We had been capable of creatively elevate the bar, form the visuals in actual time and keep targeted on the story. AI is a robust instrument for creativity.”
Inventive Workflows, Powered by RTX AI
Watch the total “BLACKOUT” music video to see how the workforce introduced their inventive concepts to life with RTX AI.
Artists and builders are already utilizing generative AI to streamline their work and push inventive boundaries, whether or not exploring ideas, designing digital worlds or constructing clever apps. With RTX AI PCs, customers can entry the newest and biggest fashions and instruments, in addition to highly effective AI efficiency.
Study extra in regards to the NVIDIA Studio platform and RTX AI PCs.
Every week, the RTX AI Storage weblog collection options community-driven AI improvements and content material for these trying to study extra about NVIDIA NIM microservices and AI Blueprints, in addition to constructing AI brokersinventive workflows, digital people, productiveness apps and extra on AI PCs and workstations.
Plug in to NVIDIA AI PC on Fb, Instagram, Tiktok and X — and keep knowledgeable by subscribing to the RTX AI PC publication.
