Google outdoes itself with new AI: Imagen can specify the generation of objects, and the style can be converted at will
How powerful can Imagen be when you add the ability to "point and shoot"? Simply upload 3-5 photos of the specified object and describe the background, action or expression you want to generate with text, and the specified object will "flash" into the scene you want, and the action and expression will come to life.
This amazing text-image generation model called DreamBooth is Google's latest research, based on Imagen's tweaks, and has been a hot topic on Twitter since it was released.
Researchers did a comparison, compared to other large-scale text-image models such as DALL-E2, Imagen, etc., only using DreamBooth's method can achieve a faithful restoration of the input image.
And this is the most important feature of DreamBooth - personalized representation. Given 3-5 images of an object taken at random by the user, one can get a novel reproduction of the object in different contexts, while preserving its key features.
Of course, the authors also say that this approach is not limited to a particular model, and that DALL・E2 can also achieve such functionality with some adjustments. Specifically, DreamBooth uses the method of adding a "special identifier" to the object.
In other words, originally, the image generation model received only one type of object, such as [cat], [dog], etc., but now DreamBooth adds a special identifier to this type of object, which becomes [V][object class].
The authors say that, limited by the number of input photos, the model cannot learn the overall features of the objects in the photos well, and may overfit them instead.
OTHER NEWS
-
- AI aids in determining glaucoma, Tencent becomes the first Internet technology company to be approved as an innovative medical device in China
- By 5 Sep,2022
-
- Apple develops GAUDI, an "AI architect" that generates ultra-realistic 3D scenes based on text
- By 5 Aug,2022
-
- What does the intelligent garbage can look like: not only can distinguish metal plastic glass, but also can turn waste into treasure
- By 24 Aug,2022
-
- Meta smart glasses will be secretly shot? Zuckerberg: It's possible
- By 29 Aug,2022
-
- Meta AI bot trolls CEO Zuckerberg: so rich and always wearing the same clothes
- By 9 Aug,2022
-
- Study says wearing VR headsets during surgery may reduce anesthetic use
- By 27 Sep,2022