New Delhi: Instagram, the popular photo-sharing app owned by Meta, has announced a new feature that uses generative AI to let users change the background of their images with simple text prompts. The feature, called ‘Backdrop’, is the latest example of how Meta is leveraging its expertise in generative AI for mass-market products.
How does Backdrop work?
Backdrop is a new tool that is available to Instagram users in the US as part of the app’s story mode. Users can access it by tapping the dedicated backdrop button at the top of a new story. Then, they can enter any text prompt they can think of, such as “chased by dinosaurs”, “surrounded by puppies”, or “in space”. The tool will then use generative AI to remove the original background of the image and replace it with a new one based on the prompt. The result is a fun and creative way to spice up your photos and stories.
According to Ahmad Al-Dhale, Meta’s lead for generative AI, Backdrop uses a similar approach to other generative AI-based tools like ChatGPT, which can generate text, images, or audio based on prompts. However, Backdrop is optimized for image editing and uses a large dataset of images and captions to generate realistic and diverse backgrounds.
How can you share your Backdrop creations?
Once you are happy with your Backdrop edits, you can share them on your story as usual. However, there is a twist: your followers will see a “Try it” sticker on your image, which will allow them to use the same prompt and apply it to their own images. This way, you can inspire others to try out the feature and see what they come up with.
What is the purpose of the Backdrop?
Backdrop is not only a fun and easy way to enhance your images but also a demonstration of the potential of generative AI for media creation and manipulation. As Al-Dhale said, “Backdrop is a lighthearted glimpse into the possibilities of generative AI moving forward. It also serves as a reminder of how easily images can be altered and professional-looking edits can be made.”
What else is Meta doing with generative AI?
Backdrop is not the only product that Meta is developing with generative AI. Recently, Mark Zuckerberg, Meta CEO, shared a new post on his Instagram account that showed how Meta’s new AI multimodal model can both “see and hear” using the Ray-Ban Meta smart glasses. The model can recognize objects, faces, and sounds in the environment and provide relevant information and suggestions to the user. For example, it can identify a song playing in the background and display the lyrics, or it can recognize a friend and suggest a conversation topic. Meta is introducing this functionality for customers to try through an early access program.