Adobe Firefly

Introduction

Adobe Firefly is a family of generative AI models that have been designed to enhance creativity and improve creative workflows. With Firefly, creators can use everyday language and other inputs to generate custom vectors, brushes, and textures that can be edited and customized using tools they already know and love. Firefly aims to give creators every advantage possible, enabling them to tailor content to fit their vision and style. An important part of this project for Adobe is to develop creative generative AI responsibly with the creative community at the center. The team is dedicated to providing creators with every possible advantage, not only creatively but also practically.

TLDR

Adobe Firefly is a family of generative AI models that aim to revolutionize the creative industry. Firefly offers AI tools made specifically for creative needs, use cases, and workflows, and enables creators to use everyday language and other inputs to generate custom vectors, brushes, and textures. The tool enables instant creation and customization of media, from still images to 3D objects, with context-aware image generation and progressive controllable image synthesis. Firefly is currently available in a beta version and is set to supplement the creative tools Adobe creators know and love with text-based editing and media generation, simplifying the creative process. The tool is also committed to developing creative generative AI models responsibly and is working towards a universal "Do Not Train" Content Credentials tag for transparent, responsible, and creator-first AI. With seamless integration with other Creative Cloud tools, Firefly is a unique generative AI tool that provides new ways to imagine, experiment, and bring creative ideas to life.

Company Overview

Adobe Firefly is a family of generative AI models that will be integrated into Adobe products. The models will focus initially on image and text effect generation to enhance creativity and significantly improve creative workflows. With the potential to generate custom vectors, brushes, textures, and more from simple prompts, Firefly aims to expand upon natural creativity and give creators every advantage possible.

As an embedded model inside Adobe products, Firefly offers AI tools made specifically for creative needs, use cases, and workflows. The model enables creators to use everyday language and other inputs to instantly create and customize media, from still images to 3D objects. Firefly also includes progressive controllable image synthesis, customizable diffusion, and generative image compositing, which saves time in fixing various elements in a photo such as shadows, shades, and color.

Adobe is committed to developing creative generative AI models responsibly, with creators at the center, and is working towards a universal "Do Not Train" Content Credentials tag for transparent, responsible, and creator-first AI. Firefly aims to supplement the creative tools Adobe creators know and love with text-based editing and generation of media, which will change the way content is created and edited in the future.

As part of Creative Cloud, Firefly will give people the tools to generate content quickly and tailor it to fit their unique vision and style. Adobe plans to build the model with the creative community in mind and will continue to work closely with the community for future developments. Firefly is set to revolutionize the creative industry with its generative AI models and is a compelling choice for those looking to achieve the extraordinary through simple prompts.

Features

Beta Version

Text-Based Image Generation

The beta version of Firefly enables users to generate extraordinary new content using everyday language. With context-aware image generation, users can experiment and perfect any concept quickly, saving hours of time.

English Only

Currently, the beta version of Firefly is available in English only. However, the company plans to expand the functionality to other languages in the future.

Image and Graphic Design

Vector, Brush, and Texture Generation

With Firefly, users can generate custom vectors, brushes, and textures using just a few words or a sketch. This feature includes the ability to edit what the user creates using the tools they already know and love.

Context-Aware Image Generation

Firefly is gearing up to include context-aware image generation, making it easier for users to experiment and perfect any concept quickly. This feature is especially useful for those who work with digital imaging and photography.

Video

Text-Based Video Editing

Firefly is exploring the potential of text-based video editing, which allows users to describe the look they want and instantly change the colors, settings, atmosphere, weather, and mood to match. This feature is useful for those who work in the video industry.

Marketing and Social Media

Customizable Content Generation

With Firefly, users can create unique posters, banners, social posts, and other types of content with a simple text prompt. The toolplansto offer more options like uploading a mood board to generate totally original, customizable content.

3D Modeling

Photorealistic Image Generation

With Firefly, users can enable the tool to do fantastic work with 3D modeling, such as turning simple 3D compositions into photorealistic images and quickly creating new styles and variations of 3D objects.

Generative AI Models

Progressive Controllable Image Synthesizer

This feature of Firefly explores how simple marks, like lines with a stylus, paired with AI can produce the desired result in just a few brushstrokes. The feature saves time and effort when it comes to image editing.

Customizable Diffusion

The customizable diffusion feature provides more creative control over individual images and an easier way to apply creative choices to a body of work. Users can select which images inform the generative AI and create an image that meets their specific aesthetic requirements.

Generative Image Compositing

Generating custom vectors, brushes, and textures from just a few words or even a sketch allows users to combine elements from two or more photos. With help from AI, the tool makes a process that used to take many steps easier and straightforward.

Generative AI Technology

Empowering Creativity

Firefly's AI technology gives users new ways to imagine, experiment, and bring their creative ideas to life. The tool allows anyone to create images, videos, documents, digital experiences, and more with simple words and the right AI generators.

Building Blocks

Firefly is unique because it offers not only an AI text-to-image generator but also generates "creative building blocks" like brushes, vectors, and textures that can add to or form the foundation of pieces of content.

Creating and Customizing Content

As part of Creative Cloud, Firefly seamlessly customizes and edits users' creative content. Firefly offers generative AI tools specifically made for creative needs, use cases, and workflows.

Content Authenticity Initiative and Coalition for Content Provenance and Authenticity (CAI & C2PA)

Responsible Generative AI

Adobe is committed to developing creative generative AI responsibly with creators at the center. The company's mission is to give creators every advantage, not just creatively but practically.

Standard for Responsible Generative AI

As part of Adobe's effort to address generative AI-related copyright infringement concerns, the CAI is working toward a universal "Do Not Train" Content Credentials tag that remains associated with a piece of content wherever it is used, published, or stored.

Transparent, Responsible, and Creator-First AI

Through the CAI and supporting standards organization C2PA, Adobe is pushing for open industry standards and transparency around the origins, facts, and creators of digital content.

Integrations

Firefly is a family of creative generative AI models that is set to change the game in a variety of creative fields. The beta version of the first Firefly model is currently available only in English, but the potential to use everyday language to generate extraordinary content is truly exciting. Firefly is initially focused on image and text effect generation for use with Adobe products. However, there are a wide range of possibilities that are being explored, and the vision for Firefly is to offer generative AI tools designed specifically for creative needs, use cases, and workflows.

Digital Imaging and Photography

Imagine being able to save hours by adding what's in your head to a composition instantly. Firefly is starting to include context-aware image generation that will allow you to experiment and improve almost instantly. Firefly is geared to help you perfect any concept quickly and easily.

Illustration, Artwork, and Graphic Design

Think about generating custom vectors, textures, and brushes from just a few words or even sketches. Firefly aims to provide just that, giving you the ability to make creative blocks that can be edited and changed using the tools you love and already know.

Video

Imagine being able to change the mood, weather, or atmosphere of a video quickly and easily. Firefly will provide new ways of text-based video editing, enabling you to describe the look you want and instantly changing the color and video settings to match what you envision in your mind.

Marketing and Social Media

Firefly is about to make your life easier by allowing you to create unique posters, social media posts, banners, and more with just a simple text input prompt. In the future, Firefly plans to let you upload a mood board, generating original and customizable content.

3D Modeling

Firefly hopes to enable you to do amazing work with 3D in the future. With Firefly, you can turn simplistic 3D compositions into photorealistic images and create new styles and variations of 3D objects rapidly.

An important part of this project for Adobe is to develop creative generative AI responsibly with the creative community at the center. The team is dedicated to providing creators with every possible advantage, not only creatively but also practically. As Firefly evolves, the team will continue to work closely with the creative community to build technology that supports and improves the creative process. Adobe is committed to working toward transparency and accountability in generative AI.

Progressive Controllable Image Synthesis

Progressive controllable image synthesis explores how simple marks, like lines with a stylus, can pair with AI to produce the desired result in just a few brushstrokes, making image editing more accessible.

Customizable Diffusion

Customizable diffusion is designed to give creators more control of the aesthetic look of image generation by giving them direct control over image selection. This creatively empowering feature simplifies the application of creative choices across a body of work.

Generative Image Compositing

Generative image compositing helps creators save time by combining multiple elements from two or more photos to generate a unified image. This component removes the need for multiple steps to create the desired image, allowing creators more flexibility in taking their ideas from inception to execution quickly and easily.

Firefly is a unique generative AI tool that will offer multiple ways to imagine, experiment, and communicate with colleagues and stakeholders. With the ability to generate new ideas and edit and customize unique content with seamless integration with other Creative Cloud tools, the potential for use cases is truly exciting. The team behind Firefly is actively researching ways to improve and expand the tool's capabilities, so it can continue to enhance creators' abilities to express their ideas and vision.

FAQ

What is Adobe Firefly?

Adobe Firefly is a new family of creative generative AI models that are designed to generate images and text effects safely. The first model is commercially safe, and it was trained on Adobe Stock images, openly licensed content, and public domain content where copyright has expired. It is available as a standalone beta at firefly.adobe.com.

Can I use Adobe Firefly for commercial purposes?

No, during the beta phase of Adobe Firefly, any assets generated by Firefly cannot be used for commercial purposes. However, based on customer feedback, Adobe intends to bring Firefly to Adobe Express and Adobe AEM next, followed by its creative flagship applications. Adobe is also developing a compensation model for Stock contributors, and details will be shared when Firefly exits beta.

What dataset does Firefly use?

Adobe Stock content is part of the training dataset of Firefly, in accordance with your Stock Contributor license agreement. There is currently no option to opt-out of data set training for content submitted to Stock. However, Adobe is exploring the possibility of an opt-out.

Is generative AI a replacement for artists or Stock contributors?

No, Adobe believes that generative AI is not a replacement for artists or Stock contributors but rather an effective tool they can use. Creating beautiful, commercially relevant imagery takes a certain know-how that Stock contributors have, including knowledge of what sells, spotting trends, crafting text prompts, and often post-production work of the output before submitting. The demand for images (stock and generated) will continue to grow in the years ahead.

Can I use Firefly-generated assets for commercial purposes once Firefly is officially released?

Adobe has not released any information about the use of Firefly-generated assets. However, Adobe Stock currently accepts AI-generated works that meet its requirements. Details about the use of Firefly-generated assets will be shared once Firefly is officially released.