NVIDIA’s Crazy New AI Paints With Images!
❤️ Check out Lambda here and sign up for their GPU Cloud:
📝 The paper "Diffusion Texture Painting" is available here:
📝 My paper on simulations that look almost like reality is available for free here:
Or this is the orig. Nature Physics link with clickable citations:
🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible:
Alex Balfanz, Alex Haro, B Shang, Benji Rabhan, Gaston Ingaramo, Gordon Child, John Le, Kyle Davis, Loyal Alchemist, Lukas Biewald, Martin, Michael Albrecht, Michael Tedder, Owen Skarpness, Richard Sundvall, Taras Bobrovytsky, Ted Johnson, Thomas Krcmar, Tybie Fitzhugh, Ueli Gallizzi.
If you wish to appear here or pick up other perks, click here:
My research:
X/Twitter:
Thumbnail design: Felícia Zsolnai-Fehér –
#nvidia
Cool! Smart design workflow
What a time to be alive
What an AI time to be painted alive! 🎉
😂❤
We are seeing progress today that many just a few years ago would believe to be decades away
facts
It’s baffling to me how many think AGI is still 6-10 years away. Although, I’m sure no matter how close we get people will still argue it’s not AGI.
That’s actually sick like wow wow wow.
Mind blown 🤯
I don’t know, a lot of ways AI just feels like Photoshop of the Future… with the same pitfalls as old tech. If you rely too much on a software’s filters and gimmicks, then you can easily run into dead ends where your “I did it” button stops working.
This is absolutely true, it is a good time saver but it can’t replace the fundamentals… A real artist can make the determination on what looks good within their style or in terms of realism that an amateur still couldn’t with the same tools.
R.I.P adobe substance painter
This is absolutely breathtaking. Oh My Graphics
What is name of the 3D texturing software? Is it available for tests?
Why no one uses any nvidia ai powered tool in the gaming and entertainment industry.
Its a pain to set up and the time you would save would be wasted on doing all the exporting between the programs.
We will see a massive surge in usage once it gets implemented into blender or something.
I think big studios already use it/are working on it, but they dont really want us to know – because there is still massive stigma attached to this type of tech.
I have a workflow to mass produce 3D clothing with Comfy UI.
So yes a better texturer to add to the workflow is definitely welcomed also With Adobe being Adome the more alternatives to their software the better.
But when is all this nice stuff actually coming to engines like Unreal or Blender
Something similar, not so advanced is already there for use, Stable ProjectorZ.
😊 This a wonderful use of this technology … Skinning has always been a difficult part of Modeling in 3 Dimensions.
Now a director waves a brush, and AI set decorators sketch the first draft.
Brilliant 👏
Now this is a good application of AI in art, we can use it directly as a tool for texturing digital worlds easier and not always resort to using sctrict asset libraries for textures… this is an excellent tool for game developers and 3D artists alike.
Oh man! It’s amazing seeing technology progress from the Hose tool in Corel Painter to this 😀
As an artist, this is pretty huge, especially if you can use your own textures. Like you said, the textures this method generates will need modification (for now), but you can just draw an image and plaster it onto a model. I see this being implemented in Blender or a dedicated texture editor, and I see myself using it for actual work.
I develop addons for Blender, most notably Drag & Drop Import. If they release the code, I might create the addon for it
If the examples shown aren’t just the cream of the crop, this is quite huge. The blending is outstanding for an automated process.
To improve the seams, you could use a special dedicated texture for them, each half corresponding to their respective texture at each side of the seam. The halves to make the seam texture could be combined in the middle using stable diffusion inpainting (this doesn’t need to be real time because it’s done just one). Extra points if you could feed this inpainting with a real life picture of the seam when possible.
This is the kind of AI image generation that blurs the line between human-created and computer-created.