Using AI to Make Composites : Firefly, MidJourney & Generative Fill in Photoshop Beta

John Gress
26 Jun 202320:53

TLDRIn this video, the creator shares his process of using AI tools like vato AI, Firefly, and mid-journey to generate composite images of NFL players. He details how he retouched skin, created backgrounds, and used Photoshop's generative fill to fix them. The video also covers lighting techniques used on set and the artist's journey from collecting trading cards to professional photography, offering insights into his creative and technical process.

Takeaways

  • 🖼️ The video discusses the use of AI to create composite images of NFL football players.
  • 💻 The presenter shares their process of using vato AI for skin retouching and Firefly and mid-journey for generating backgrounds.
  • 🔍 Generative fill in Photoshop Beta is used to fix the backgrounds created by AI.
  • 💡 Photoshop is essential for blending all elements together to create the final composite image.
  • 🏈 The presenter's childhood interest in collecting trading cards and getting autographs influenced their career as a photographer.
  • 📸 The video covers how to photograph multiple athletes in one day for trading cards, using various lighting setups.
  • 💡 The Ellen Chrome mobile app is used to control lighting, allowing for quick changes between setups.
  • 🌆 Firefly is effective for creating cityscapes and landscapes, while mid-journey excels at generating stadium scenes and tunnels.
  • 🖥️ Photoshop Beta's generative fill is used to remove the player from the AI-generated background, which is then merged and upsized using neural filters.
  • 🎨 The final image is refined with color harmonization, edge cleaning, and adding grain and cyan wash for a unified look.
  • 👁️ The video concludes with advice on using catch lights and exposure adjustments to draw the viewer's attention to the player's face.

Q & A

  • What is the main focus of the video?

    -The main focus of the video is to share the process of using AI to generate composite images of NFL football players, including retouching, generating backgrounds, and blending them together in Photoshop.

  • How did the speaker's childhood hobby influence their career as a photographer?

    -The speaker's childhood hobby of collecting trading cards and getting autographs from professional athletes eventually led them to borrow their mom's camera to take photos of these athletes. This experience influenced their decision to become a photographer.

  • What was the speaker's approach to photographing NFL and NBA draft picks for trading cards?

    -The speaker photographed about 40 different athletes in the same day, working with an art director to get all the poses needed for the trading cards. They mixed things up by doing five different setups on the same set in 10 minutes using the Ellen Chrome mobile app to control lighting.

  • Can you describe one of the lighting setups used in the video?

    -One of the lighting setups described was a clamshell lighting setup with a strip soft box in the front vertically. Initially, a small light with a seven-inch reflector was used as fill, but it was later removed to simplify the setup.

  • How did the speaker use AI tools to generate backgrounds for the composite images?

    -The speaker used AI tools like Firefly and mid-journey to generate backgrounds. Firefly was used for cityscapes and landscapes, while mid-journey was used for stadium scenes and tunnels. They input descriptive keywords into these tools to create the desired background images.

  • What role did generative fill play in the process of creating composite images?

    -Generative fill was used in Photoshop to fix the backgrounds by removing the player from the generated background image, allowing the speaker to merge it with the retouched player image.

  • How did the speaker use the neural filters in Photoshop to harmonize the image?

    -The speaker used the neural filters in Photoshop to harmonize the color and contrast of the foreground player image with the background layer, making the composite image look more cohesive.

  • What was the purpose of adding a cyan color layer in the image editing process?

    -Adding a cyan color layer helped to unify the color of the image slightly, giving it a more cohesive look by creating a cyan wash over the entire image.

  • Why did the speaker choose not to use generative fill to create backgrounds?

    -The speaker found that generative fill took too long to generate backgrounds and the results were not always satisfactory. Using Firefly and mid-journey provided quicker and more options for background generation.

  • How did the speaker deliver the raw files to the client?

    -The speaker delivered the raw files to the client almost in real time, allowing the client to make their own selections for their purposes.

Outlines

00:00

🏈 Introduction to AI-Generated Composite Images

The speaker begins by welcoming the audience to the video and announces the topic: using AI to create composite images of NFL football players. They discuss their personal history with photography and sports memorabilia, which led to their career as a photographer. The speaker shares their experience photographing NFL and NBA draft picks for trading cards and describes their unique approach to the photoshoots this year, which involved setting up five different lighting scenarios in a short time using the Ellen Chrome mobile app to control multiple lights. They also touch on their process of selecting and lighting the athletes, and how they used clamshell lighting and other techniques to achieve the desired look for the trading cards.

05:05

🎨 AI Tools for Image Editing and Background Creation

In this paragraph, the speaker delves into the post-production process, explaining how they used AI tools to retouch the athletes' skin and create backgrounds for the composite images. They discuss using vato AI for skin retouching, Firefly and mid-journey for generating backgrounds, and generative fill to fix any issues with the backgrounds. The speaker also mentions using Photoshop to blend all elements together and their approach to lighting the photos. They describe their process of selecting their favorite images from the shoot to use in their portfolio and how they used AI tools to enhance these images, focusing on learning and artistic expression rather than client requirements.

10:07

🖼️ Creating Backgrounds with Adobe Firefly and Mid-Journey

The speaker continues by detailing their process for creating the backgrounds using Adobe Firefly and mid-journey. They explain that Firefly was effective for generating cityscapes and landscapes, while mid-journey was better for stadium scenes and tunnels. The speaker shares the specific prompts they used in each AI tool to generate the desired background images. They also discuss their technique for removing the player from the generated background image using Photoshop's generative fill and then merging the layers. The paragraph concludes with the speaker's process for upscaling the AI-generated backgrounds using Photoshop's neural filters to improve their resolution and quality.

15:08

🌐 Combining Images and Refining Masks in Photoshop

Here, the speaker describes the process of combining the retouched player images with the generated backgrounds in Photoshop. They explain how to use the remove background feature, refine the mask using the select and mask tool, and clean up the edges of the player's hair for a better selection. The speaker also discusses using neural filters to harmonize the color and contrast between the foreground and background layers, creating a more cohesive image. They further enhance the image by adding blue edge lights, adjusting blending modes, and adding grain to unify the image and give it a more realistic look.

20:11

🔍 Final Touches and Conclusion

In the final paragraph, the speaker adds the final touches to the composite image, including adding a cyan overlay, adjusting exposure, and painting in catch lights in the player's eyes to draw the viewer's attention. They explain their reasoning for not using generative fill for backgrounds, citing the time it takes and the limited options it provides compared to using Firefly and mid-journey. The speaker expresses excitement about the growing number of creative options available with AI tools and thanks the audience for watching. They encourage viewers to like, subscribe, and explore more of their content, emphasizing that they were not sponsored by any companies in this video and shared their learnings in the hope that others might find them useful.

Mindmap

Keywords

💡AI

AI stands for Artificial Intelligence, a field of computer science that aims to create machines capable of intelligent behavior. In the context of the video, AI is used to generate composite images and retouch skin, showcasing how AI can be integrated into creative workflows to enhance productivity and achieve specific visual effects.

💡Composite Images

Composite images are created by combining multiple images or elements to form a single, cohesive image. The video discusses the process of generating these images using AI tools, such as Firefly and mid-journey, to create backgrounds and generative fill to fix those backgrounds, demonstrating the creative potential of AI in image composition.

💡Firefly

Firefly is an AI tool mentioned in the video used for generating backgrounds for composite images. It is particularly good at creating heavily blurred images of cityscapes and landscapes. The script describes using Firefly to generate a Malibu Beach scene with specific lighting conditions, highlighting its utility in creating realistic and atmospheric backgrounds.

💡Mid-journey

Mid-journey is another AI tool referenced in the video, which is better suited for creating detailed scenes like stadium or tunnel backgrounds. The video provides an example of using mid-journey to generate a scene for a Detroit Lions player, emphasizing the tool's ability to produce images with specific lighting and perspective that align with the creative vision.

💡Generative Fill

Generative Fill is a feature in Photoshop Beta that can be used to remove elements from an image and replace them with generated content. The video describes using this feature to fix backgrounds by removing the player from the image and merging the layer, illustrating the practical application of generative AI in post-production editing.

💡Photoshop

Photoshop is a widely used image editing software by Adobe. In the video, it is used to blend AI-generated backgrounds with retouched player images to create a cohesive final image. The script mentions using various Photoshop tools, such as neural filters and layer masks, to refine the composite and achieve a polished look.

💡Clamshell Lighting

Clamshell lighting is a specific lighting setup used in photography where a softbox is placed vertically in front of the subject, creating a soft, even light. The video describes using this setup initially and then adjusting it by removing a fill light to create more dramatic lighting, showcasing the importance of lighting in photography.

💡Edge Lights

Edge lights are used in photography to create a rim of light around the subject, separating them from the background. The video discusses using edge lights to add depth and dimension to the player's image, emphasizing the role of lighting in creating a three-dimensional effect in two-dimensional images.

💡Neural Filters

Neural filters are AI-powered tools in Photoshop that can perform tasks like upscaling images or harmonizing color and contrast. The video mentions using the 'harmonize' neural filter to match the color and contrast of the foreground player image with the AI-generated background, demonstrating the integration of AI in enhancing image quality.

💡Batch Processing

Batch processing refers to the ability to process multiple images or tasks simultaneously using preset settings. The video mentions using software like ivato AI for batch processing of retouched images, highlighting the efficiency gains from using AI in handling large volumes of images.

💡Cyan Key

A cyan key is a technique used in video post-production to isolate and adjust specific colors in an image. In the video, the creator adds a cyan color to the highlights of the image and adjusts its blending mode to overlay, creating a more dynamic and visually appealing final image by enhancing the color grading.

Highlights

AI is used to generate composite images of NFL football players.

Vato AI is utilized for skin retouching to remove blemishes and brighten dark circles under the eyes.

Firefly and MidJourney AI tools are employed to create background images.

Generative Fill in Photoshop Beta is used to fix backgrounds.

Photoshop is key in blending AI-generated components into a cohesive final image.

The photographer's childhood hobby of collecting trading cards inspired the project.

Creating images for trading cards involves photographing 40 athletes in a single day.

Ellen Chrome mobile app controls lighting for multiple setups, enhancing efficiency.

Clamshell lighting setup is initially used, then simplified for different effects.

Action shots are lit with edgy effects using a 70 cm OCTA box and strip softboxes.

Neural filters in Photoshop are used for color harmonization between the subject and background.

AI-generated images are upscaled using the Super Zoom filter in Photoshop.

Background plates are upscaled to match the size of the foreground image for composition.

Refine Edge tool in Photoshop is used to perfect the subject selection from the background.

Overlay blending mode and painting on the mask help clean up hair edges.

Adding grain and cyan overlay layers unifies the image and mimics a legitimate photo.

Exposure adjustment layers are used to draw focus to the subject's face.

The use of generative fill for backgrounds was found to be less efficient than using Firefly and MidJourney.

The video shares insights and techniques learned over weeks of experimenting with AI in photography.