Inpainting in Midjourney: A Deep Dive, Secret Commands & Tips for the Long Awaited Feature!

Theoretically Media
22 Aug 202313:58

TLDRThe video explores the new inpainting feature in Midjourney, a tool for image restoration. It demonstrates how to restore or alter parts of images by highlighting areas and re-prompting within them. The host uncovers secrets and limitations, showcasing the feature's power in fixing errors, changing emotions, and adding elements like ninjas or props. The summary also touches on the use of inpainting with zooming, niji, and various commands, highlighting its potential despite occasional challenges.

Takeaways

  • 🎨 Inpainting is a new feature in mid-journey that allows users to restore or modify parts of images by highlighting an area and re-prompting within that area.
  • 🖌️ The 'Very Region' button is the primary tool for inpainting in mid-journey, enabling the AI to reimagine selected areas based on contextual clues.
  • 🔍 Inpainting works best with upscaled images and can be combined with zooming out for effective results, but not after panning.
  • 📝 To use inpainting, 'Remix Mode' must be enabled in the settings, allowing for specific prompts within the selected area.
  • 👤 The AI can change character details, such as removing extra limbs or altering facial expressions, using inpainting.
  • 📏 The 'Free Draw' tool is available for selecting areas to inpaint, but it can be finicky and may require practice to use effectively.
  • 🔄 An 'Undo' function is provided for inpaint adjustments, allowing users to revert changes easily.
  • 🤹‍♂️ Inpainting can be used creatively to change the narrative of an image, such as transforming a character from a victim to an antagonist.
  • 🔄 The 'Lasso' tool can be used for more precise selection in inpainting, though it may be tricky to master.
  • 🐉 Inpainting can add elements like ninjas or props, such as balloons, to an image, enhancing the original scene.
  • 🚫 Sometimes inpainting may not produce the desired result, and techniques like the 'slider method' may be needed to achieve the intended outcome.

Q & A

  • What is inpainting in the context of the video?

    -Inpainting in the video refers to a technique used in image and video processing to restore damaged or deteriorated parts, and in this context, it is used to highlight an area in an image and re-prompt within that area to restore or alter it based on surrounding contextual clues.

  • What is the main purpose of the 'very region' button in mid-journey inpainting?

    -The 'very region' button is used for inpainting in mid-journey, allowing users to select specific areas of the canvas to be reimagined by the system without additional user input, based on the context of the surrounding image.

  • How does the inpainting feature handle the addition of new elements like extra limbs or characters?

    -The inpainting feature in mid-journey can add new elements such as characters or limbs by analyzing the context of the image and generating content that fits seamlessly within the selected area.

  • What is the recommended region size for inpainting according to mid-journey documentation?

    -Mid-journey documentation advises that inpainting works best when covering a region of 20 to 50 percent of the image, although the script mentions successful results with much smaller regions.

  • What is the relationship between inpainting and the 'remix mode' setting?

    -Inpainting requires the 'remix mode' to be turned on to function. This setting allows for specific elements to be altered or added within the selected area of the image.

  • How does the inpainting feature handle changes in lighting and composition?

    -The inpainting feature impressively handles changes in lighting and composition, ensuring that the new elements added match the overall lighting and composition of the original image.

  • What is the 'lasso tool' used for in the inpainting process?

    -The 'lasso tool' is used in the inpainting process to select irregular shapes or areas for re-imagination by the system, allowing for more precise control over the regions being altered.

  • Can inpainting be used in combination with zooming out?

    -Yes, inpainting works well when combined with zooming out, although the script mentions that one cannot impaint after panning, suggesting this might be a temporary limitation.

  • What are some of the commands that can be used in conjunction with inpainting?

    -Some of the commands that can be used with inpainting include 'chaos', 'stylize', 'style', and 'weird'. These commands can influence the style and nature of the inpainted content.

  • How does the inpainting feature handle mistakes or unwanted elements in the image?

    -The inpainting feature can sometimes introduce mistakes such as double limbs, but the 'undo' button allows users to revert changes and try different prompts or selections.

  • What is the 'slider method' mentioned in the script and how is it used?

    -The 'slider method' is a technique where a part of the prompt is repeated with a colon colon separator to influence the inpainting process, allowing for more control over the elements that appear in the final image.

Outlines

00:00

🎨 Introduction to Mid-Journey Inpainting

This paragraph introduces the concept of inpainting in the context of mid-journey image restoration. The speaker explains how inpainting is used to restore damaged images or video, highlighting its evolution from art restoration to digital applications. They discuss the 'very region' button as the primary tool for inpainting, which allows users to select areas of the canvas for the AI to reimagine based on contextual clues. The paragraph also mentions the importance of having 'remix mode' enabled for specific prompts and showcases an example of inpainting in action, correcting an image with extra limbs. The speaker also notes that inpainting works best with upscaled images and provides a brief overview of the inpainting module's interface.

05:01

🖌️ Advanced Inpainting Techniques and Examples

The speaker delves into advanced inpainting techniques, demonstrating how to change lighting, emotions, and add props to images. They show how to use the 'lasso' tool for more precise selections and discuss the challenges of using it. The paragraph includes examples of inpainting to alter a character's pose, expression, and props, such as changing a man's ethnicity or adding a balloon to a scene. The speaker also discusses the limitations of inpainting, such as the inability to use it after panning and the occasional need for multiple attempts to achieve the desired result. They also mention that inpainting works with 'niji' or multi-style images, showcasing its versatility.

10:01

🔍 Exploring Inpainting Commands and Troubleshooting

In this paragraph, the speaker explores various commands that can be used with inpainting, such as 'chaos', 'stylize', 'style', and 'weird', and notes that some commands do not work due to the absence of image prompting. They share a method to overcome the limitations of inpainting when it fails to recognize certain elements, like adding a white wolf to an image, by using the 'slider method' to split the prompt. The speaker also discusses the surprising accuracy of inpainting in maintaining lighting and reflections, even when adding or changing elements in an image. The paragraph concludes with the speaker's thoughts on the potential for future updates to inpainting and an invitation for viewers to share their own tips and experiences.

Mindmap

Keywords

💡Inpainting

Inpainting is a technique used in digital image restoration to fill in missing or damaged parts of an image. In the context of the video, it refers to a feature in the AI art generation tool Midjourney, which allows users to highlight an area of an image and prompt the AI to reimagine that area. This is demonstrated in the video where the AI is used to remove extra fingers or limbs from images, showcasing the power of inpainting in correcting or altering visual elements.

💡Midjourney

Midjourney is an AI art generation tool that uses deep learning models to create images based on textual prompts. The video discusses the new inpainting feature in Midjourney, which is a significant update that allows for more detailed and localized image manipulation. This feature is particularly exciting as it expands the creative possibilities within the platform, enabling users to make precise edits to their generated images.

💡Remix Mode

Remix mode is a setting in Midjourney that, when enabled, allows users to modify specific parts of an image using the inpainting feature. The video explains that to access the inpainting functionality, users need to ensure that remix mode is turned on in their settings. This mode is crucial for the inpainting process as it enables the AI to understand which parts of the image the user wants to be reimagined.

💡Free Draw Tool

The free draw tool is a feature in Midjourney's inpainting module that allows users to manually select areas of the image to be reimagined. The video mentions that this tool can be a bit finicky, indicating that it might require some practice to use effectively. It is used to draw a rectangle or lasso around the area of interest, which the AI then uses as a guide to generate new content within that space.

💡Zooming Out

Zooming out is a technique mentioned in the video that can enhance the inpainting process. It involves reducing the scale of the image to provide more context for the AI when reimagining a specific area. The video suggests that while inpainting works well with zoomed-out images, it cannot be used after the panning process, which might be a temporary limitation of the feature.

💡Backrooms

The Backrooms is a concept from a surreal, existential horror collaborative fiction experiment that has influenced popular media like the TV show Severance. In the video, the term is used in a prompt to generate an image with a Backrooms-style aesthetic. This demonstrates how Midjourney's inpainting feature can be used to create images that align with specific thematic or stylistic concepts.

💡Lasso Tool

The lasso tool is another selection tool in Midjourney's inpainting module that allows for more precise and irregular shapes to be drawn around areas of interest. The video describes the lasso tool as being a bit unusual and tricky to use, but it is essential for selecting complex areas for the AI to reimagine. It is used to create a more natural and less rectangular selection, which can be crucial for certain image edits.

💡Chaos

In the context of Midjourney, 'chaos' is a parameter that can be adjusted to control the level of randomness or unpredictability in the AI's image generation. The video shows how increasing the chaos level can lead to more abstract or unexpected results, such as adding a clown or an alien to an image. This parameter allows users to experiment with different levels of creative disruption in their image edits.

💡Stylize

The 'stylize' command is a feature in Midjourney that can be used to apply a specific artistic style to the generated images. The video mentions that this command works well with the inpainting feature, allowing users to not only edit the content of an image but also its stylistic elements. This can be used to create images that match a desired aesthetic or to experiment with different visual styles.

💡Weird

The 'weird' command in Midjourney is used to generate images with more unusual or unconventional elements. The video cautions that using 'weird' can lead to very unexpected results, as it encourages the AI to create images that deviate significantly from the norm. This command can be used in conjunction with inpainting to add unique and creative twists to images, although it requires careful use to achieve the desired effect.

Highlights

Inpainting feature in Midjourney allows restoring damaged or deteriorated parts of images or videos.

The feature can be used to highlight an area and re-prompt within that area for image restoration.

Inpainting can correct issues like multiple fingers in generated images more easily.

The 'very region' button is used for inpainting in Midjourney.

Remix mode must be turned on to access inpainting features.

Inpainting works best with upscaled images.

Inpainting can reimagine selected areas of the canvas without additional user input.

Inpainting works well when combined with zooming out, but not after panning.

Inpainting can change character details, emotions, and add props in images.

Inpainting can be used to change ethnicities and facial expressions in portraits.

The lasso tool in inpainting can be finicky and requires practice.

Inpainting can ignore prompts sometimes, but the slider method can help achieve desired results.

Commands like 'chaos', 'stylize', 'style', and 'weird' can be used in inpainting, but 'image waiting' does not work.

Inpainting can accurately handle lighting and reflections in images.

Inpainting can be used to add elements like ninjas or change objects in scenes.

Inpainting can transform scenes from victims to potential aggressors by adding elements like red balloons.

Inpainting can be used to create hybrid styles by combining two photographers' styles.