Generative Fill WITHOUT Photoshop! A Look at Uncrop & More!

Theoretically Media
9 Jun 202309:27

TLDRIn this video, the presenter discusses Adobe's generative fill feature in Photoshop and introduces two alternative tools, Clip Drop's 'uncrop' module and Leonardo.ai's 'canvas' feature, which offer similar functionalities without the need for an Adobe subscription. The video showcases the capabilities and limitations of these AI-driven tools by applying them to famous images and memes, highlighting the creative potential and occasional oddities of AI-generated content. The presenter also mentions the launch of a Discord community for sharing ideas and feedback on projects.

Takeaways

  • 😀 Adobe introduced generative fill into Photoshop, which is a cool feature but essentially an advanced outpainting tool.
  • 🤔 The world's reaction to Adobe's generative fill was quite intense, which the speaker found surprising.
  • 🎉 For those without an Adobe subscription, Stability AI has released Clip Drop, which includes a module called Uncrop.
  • 🚫 Uncrop has some limitations, but the speaker has a solution for those limitations, which will be discussed.
  • 🖼️ Uncrop was tested against famous images like 'Starry Night' and 'Distracted Boyfriend', showing the potential and some odd results.
  • 🔍 Uncrop's generative process can produce unexpected and sometimes 'weird' results, which is a characteristic of stable diffusion technology.
  • 📏 The speaker demonstrates that with a smaller source image and a larger area to cover, Uncrop can generate 'funky' and absurd results.
  • 💡 Clip Drop is based on stable diffusion, which leads to a comparison with other similar technologies like Firefly and potential future integrations.
  • 🎨 For a fill feature similar to Adobe's generative fill, Leonardo.ai's Canvas feature is suggested as an alternative.
  • 👍 Leonardo.ai's Canvas offers more flexibility and control, allowing users to continue building on generated images.
  • 🆓 There are free or 'free-ish' options available for generative fill without Adobe, such as Clip Drop and Leonardo.ai, which provide a generous number of free generations or credits.

Q & A

  • What is Adobe's Generative Fill feature?

    -Adobe's Generative Fill is a feature in Photoshop that allows users to expand the canvas of an image and fill in the new areas with content that is generated by AI, maintaining the style and context of the original image.

  • What is the significance of the release of Stability.ai's Clip Drop and its 'Uncrop' module?

    -The release of Stability.ai's Clip Drop and its 'Uncrop' module is significant because it offers a similar functionality to Adobe's Generative Fill but is accessible to users who are not Adobe subscribers, making AI-powered image expansion more widely available.

  • What are some limitations of the 'Uncrop' module in Clip Drop?

    -While the 'Uncrop' module in Clip Drop allows for image expansion, it has limitations such as the potential for AI-generated content to result in odd or unrealistic outcomes, especially when dealing with smaller source images and larger areas to cover.

  • Can you provide an example of how the 'Uncrop' module in Clip Drop was used to expand the canvas of a famous painting?

    -An example provided in the script is the expansion of Vincent Van Gogh's 'Starry Night'. The original painting was placed into Clip Drop, and the 'Uncrop' module was used to expand the border, generating new content that matches the style of the original artwork.

  • What is the 'Distracted Boyfriend' meme, and how was it used in the Clip Drop demonstration?

    -The 'Distracted Boyfriend' is a popular internet meme featuring a man looking at another woman while his girlfriend looks on in disapproval. In the Clip Drop demonstration, the original image of the meme was expanded using the 'Uncrop' module, generating new content around the original square image.

  • What is the connection between Clip Drop and the AI model called Stable Diffusion?

    -Clip Drop is based on Stable Diffusion, which is an AI model known for its ability to generate new image content. This connection allows Clip Drop to leverage the capabilities of Stable Diffusion for its 'Uncrop' module's image expansion feature.

  • What is Leonardo.ai's Canvas feature, and how does it differ from Adobe's Generative Fill?

    -Leonardo.ai's Canvas feature is an alternative to Adobe's Generative Fill that focuses on out-painting, allowing users to extend images by providing text prompts. Unlike Adobe's Generative Fill, Canvas offers more flexibility and control by allowing users to continue building out the image through masking and additional prompts.

  • How does the speaker suggest using Leonardo.ai's Canvas feature to improve upon an AI-generated image?

    -The speaker suggests using the Canvas feature to refine AI-generated images by accepting the initial generated content and then using the mask button to continue building out the image with additional prompts and details as needed.

  • What are some of the challenges or 'AI absurdity' that can occur when using AI image generation tools like Clip Drop?

    -Some challenges include receiving unrealistic or bizarre results, such as strange objects or scenarios that were not part of the original image context. This 'AI absurdity' can occur when the AI has too much area to cover or when it struggles to understand the context of the original image.

  • What is the speaker's perspective on the importance of providing value through Patreon and YouTube memberships?

    -The speaker acknowledges the stress and anxiety that can come with providing value through Patreon and YouTube memberships. They prefer to view these memberships as ways to support the channel rather than as a means to provide massive perks, which they feel they do not have the bandwidth for at the moment.

Outlines

00:00

🤖 AI in Photoshop and Beyond

The speaker discusses the reaction to Adobe's introduction of generative fill in Photoshop, expressing a tempered enthusiasm for the feature. They compare it to 'out painting' and predict it will be a time-saver. The speaker also mentions their critical yet loving relationship with Adobe products. They introduce 'Clip Drop' by Stability.ai, which includes a module called 'uncrop', and compare its capabilities to Adobe's generative fill. The speaker demonstrates uncrop with famous images like 'Starry Night' and 'Distracted Boyfriend', noting its limitations and the occasional odd results, but also highlighting its potential as an alternative to Adobe's offering. They also touch on the topic of AI-generated content and its unpredictable nature.

05:02

🎨 Exploring AI Art Generation with Clip Drop and Leonardo.ai

The speaker continues the discussion on AI art generation, focusing on the limitations of uncrop and offering a solution. They introduce 'Leonardo.ai's Canvas feature' as an alternative to Adobe's generative fill, demonstrating its use with the 'Disaster Girl' meme and explaining how it allows for more control and flexibility. The speaker also discusses the process of refining AI-generated images using masking and text prompts. They compare the results with Adobe's Photoshop feature, acknowledging its imperfections, and present 'Clip Drop' and 'Leonardo.ai' as free or low-cost options for exploring generative art. The speaker concludes by mentioning the launch of their Discord community for sharing information and learning, and expresses their intention to keep Patreon and YouTube memberships as simple support mechanisms rather than offering extensive perks.

Mindmap

Keywords

💡AI Wonder

AI Wonder refers to the sense of amazement and curiosity that people experience when encountering advanced artificial intelligence capabilities, especially in creative fields such as image editing. In the video, the term is used to describe the initial reaction to Adobe's generative fill feature in Photoshop, which is seen as a significant advancement in AI-assisted image manipulation.

💡Generative Fill

Generative Fill is a feature in Adobe Photoshop that uses AI to intelligently fill in areas of an image, often extending the background or creating new content based on existing elements. It is highlighted in the video as a time-saving and innovative tool, although the speaker also discusses alternative tools that offer similar functionality without the need for a Photoshop subscription.

💡Uncrop

Uncrop is a module within the Clip Drop software, which is presented as an alternative to Adobe's generative fill. It allows users to expand the canvas of an image, generating new content beyond the original borders. The video demonstrates how Uncrop can be used to create extended versions of famous images, such as Vincent van Gogh's 'Starry Night'.

💡Stable Diffusion

Stable Diffusion is an underlying technology used in AI image generation tools like Clip Drop. It refers to a method of creating stable, coherent images from AI models. The video mentions that Uncrop is based on Stable Diffusion, which can sometimes result in unpredictable or 'absurd' results, as seen in the various examples provided.

💡Distracted Boyfriend

Distracted Boyfriend is a popular internet meme that the video uses as an example to demonstrate the capabilities of AI image generation tools. The meme is shown with an expanded background generated by generative fill technology, illustrating how AI can be used to creatively extend and modify existing images.

💡Leonardo.ai

Leonardo.ai is another AI-based image generation platform mentioned in the video. It offers features like 'Canvas,' which allows users to continue painting or generating images based on text prompts. The platform is highlighted as an alternative to Adobe's generative fill, providing users with more control and flexibility in image creation.

💡Clip Drop

Clip Drop is a software that competes with Adobe Photoshop's generative fill by offering similar AI-based image expansion capabilities. The video discusses how Clip Drop can be used to generate new image content, and it is presented as a more accessible option for those who are not Adobe subscribers.

💡AI Absurdity

AI Absurdity refers to the sometimes bizarre or unexpected outcomes generated by AI image creation tools when they are given too much freedom or an unclear directive. The video uses this term to describe instances where the AI-generated images result in strange or humorous compositions, such as when expanding a small source image into a larger canvas.

💡Stable Effusion

Stable Effusion seems to be a playful or incorrect term used in the video, likely meant to refer to 'Stable Diffusion.' It is used in the context of discussing the occasional oddities and unique results produced by AI image generation tools, which can sometimes be endearing or interesting despite not being what was exactly requested.

💡Free-ish Options

Free-ish Options in the video refers to the limited free uses of AI image generation tools like Clip Drop and Leonardo.ai before they require a subscription or payment. The speaker mentions this as a way for users to explore generative fill capabilities without immediately incurring costs.

Highlights

Adobe's introduction of generative fill in Photoshop has sparked excitement and debate in the design community.

The author expresses mixed feelings about Adobe's generative fill, considering it a cool but not groundbreaking feature.

Stability.ai's release of Clip Drop offers an alternative to Photoshop's generative fill for non-subscribers.

Clip Drop's 'uncrop' module expands the canvas of an image, providing a similar functionality to Adobe's generative fill.

The video compares uncrop's results with famous images like Van Gogh's 'Starry Night' and the 'Distracted Boyfriend' meme.

Clip Drop sometimes generates unexpected or 'weird dumpster fires' due to the nature of stable diffusion technology.

The limitations of Clip Drop are discussed, including issues with smaller source images and wider areas to cover.

Leonardo.ai's Canvas feature is highlighted as an alternative to Adobe's in-painting technology.

The author demonstrates how to use Leonardo.ai's Canvas to continue and expand an image based on a text prompt.

Leonardo.ai's prompting capabilities have improved, offering more flexibility and control over image generation.

The video shows how to use masks in Leonardo.ai to add elements like 'James Bond' into an existing image.

AI generators sometimes produce cool, unintended results that can be a pleasant surprise for users.

The video acknowledges that Photoshop's generative fill is not perfect, showing examples of its imperfections.

Clip Drop and Leonardo.ai are presented as free or low-cost alternatives to explore generative fill without Adobe.

The author launches a Discord community for Patreon and YouTube members to share information and feedback.

The author expresses concerns about providing value through Patreon and YouTube memberships due to bandwidth limitations.

An upcoming video on becoming an AI music composer like Hans Zimmer is teased, promising to be an engaging topic.