Generative AI Art Links
Overview
I've spent every day this year learning and using AI tools. They augment and to some extent obsolesce my abilities as a software developer, but I find myself most drawn to AI tools that generate and manipulate images.
Right now you can type a prompt that is a few words and generate an image capable of capturing thousands of words in just a few seconds. You can also use the same prompt to exponentially capture emotions beyond words in moving images in minutes.
I think there is a seismic shift happening in content creation, movie production, and the abilities we all now possess to perform and "do our thing" on the global stage. I'm learning and I'm gaining momentum.
Hopefully these links help you on your journey if you are interested in these things.
Links
Below is a chronological list of links I encountered over the last months as I moved from simply creating images with DALL-E, Midjourney, and Stable Diffusion to animating images, training models, and programmatically creating videos.
Stable Diffusion
DreamBooth Stable Diffusion Google Colab Notebook
A Google Colab Notebook that runs Dreambooth Stable Diffusion. You can generate images for free and start playing around.
The next level if you want to install the Stable Diffusion code on your own computer and start generating images and videos.
Inject Yourself into the AI and Make Any Image With Your Face! (100% FREE Method)
Use Google Colab to train Stable Diffusion on images of your face. Download the resulting model and use it locally or in the cloud. I started going much deeper down the rabbit hole after doing this.
How to Install Deforum in Stable Diffusion (Google CoLab and Locally)
More links around installing Stable Diffusion locally and running in the cloud.
How to run Stable Diffusion on Google Colab (AUTOMATIC1111)
And more links on Stable Diffusion with Google Colab.
Text-to-Video
A great tool for setting text against videos, automatically splicing it up into scenes, and even syncing it with voice overs or music.
Running Stable Diffusion in the Cloud (w/Deforum)
This is an awesome managed service for running Stable Diffusion in the cloud. They offer different machines at different costs preloaded with lots of models, extensions, and file storage. I had to start running my own SD in AWS because I was giving these guys too much money.
Image Tool: Face Swapping (w/Midjourney)
You Can Now Change Faces On An Image with Midjourney!
InsightFace AI swapping bot brought right into Midjourney. Now you can insert anyone's face on any image.
The company behind the AI face swapping tech above.
Video Tool: Talking Heads
Take an image of any face and have them start talking or singing with the audio you upload. I use this for some of my type: entry-hyperlink id: 4HrOfwsIp9FRVjVFvCqQ1n.
Video Tool: Animate
Animate any image, drawing your own flow, adding masks and pinning certain parts of the picture. One of the first apps I actually paid for given the cheap price and coolness of the output.
Video Editing
This is currently my go-to video editing software. I find it extremely easy to use.
I haven't used this yet, but I think it is the best free software and everyone seems to use it. I will be trying it at some point.
Prompting
I go here all the time to look at pictures and see the prompts that generated them.
Similar to Prompt Hero with a slicker UI. I'm using this one more and more.
This is just a text file on Hugging Face with thousands of prompts. There are no images, just the prompts, so there is some rolling of dice here which is fun.
Image Generation
I started here with the free credits. Then I gave them $10 more when I started generating images with their API. The ability to generate images with an API has great use cases in video creation. More to come on this.
The reigning king of image generation. Extremely easy to use with some great customization options built into the prompting. You gotta use Discord to use it which is OK I guess.
I have access to Leo but I haven't yet used it. I'm excited to try it.
Deforum
FizzleDorf's Animation Guide - Deforum
THE resource on all Deforum settings. Exhaustive.
Models to use with Stable Diffusion and Deforum.
The Complete Deforum Masterclass
Awesome video with Matt Wolfe, Revolved and Huemin the creator of Deforum. You will learn the basics and some more advanced settings.
Running Stable Diffusion on AWS
Running SD Automatic1111 on AWS
Step-by-step walkthrough for setting up SD on AWS EC2. This is how I went about doing this.
Create Your Own Stable Diffusion UI on AWS in Minutes
Another way to set things up on AWS using CloudFormation templates. I started down this route, but switched to the manual way above to get things done quicker. I would like to do this all in CDK soon anyway which will handle the Cloud Formation part.
Step by Step Guide to Setup Stable Diffusion on AWS
This way looks easy but is more expensive. It seems TechLatest offers managed instances in AWS with everything configured for you. I did not use this because I wanted to handle everything myself.
That's it. I will keep adding links here as I come across them, so bookmark the page. I hope these links accelerate your learning in AI image and video creation.