Nvidia has introduced a new tool enabling developers to create AI-generated images starting from 3D models. The oddly named Nvidia AI Blueprint for 3D-guided generative AI is now available for download for computers with an Nvidia RTX 4080 GPU or more. This tool combines Blender’s 3D modeling software with Black Forest Lab’s FLUX.1 image generation technology.
Users can design a scene in Blender using various 3D elements, such as buildings, greenery, animals, and vehicles. These designs serve as references for producing 2D images. The advantage of this approach is that by manually adjusting the viewing angles and object placements, users can exert more precise control over the final details in their 2D outputs, rather than relying solely on text prompts.
For instance, if you envision a specific cityscape—complete with desired building shapes, tree density, and vehicle count—you can use Nvidia’s system to create a basic model in Blender. The FLUX.1 image generator will then utilize this model as the foundation for its output. This method can be less tedious than repeatedly adjusting text descriptions to achieve a close approximation of your vision. The 3D objects crafted in Blender don’t have to be intricately detailed; they simply serve as layout guides.
Nvidia refers to its blueprints as “pre-defined, customizable AI workflows” aimed at assisting developers in creating generative AI applications. In this instance, the AI Blueprint for 3D-guided generative AI includes comprehensive documentation, sample assets, and a preconfigured setup to help users navigate the tool.
This workflow isn’t entirely original; Adobe recently showcased a similar tool named “Project Concept” at its MAX event in October, which also enables users to outline 3D scenes for image generation purposes. However, Adobe’s tool is still in development and may never be made available to the general public.
