Facebook Unveils AI Model That Copies Text Style From Images Using a Single Word

The past few years have taught us that our faces, voices, and lips can be copied and replicated with artificial intelligence. Now, an AI model created by Facebook researchers can imitate, edit, and replace handwritten and scene text using just a single word in an image.

Facebook unveiled TextStyleBrush, an AI research project, on Friday. The company points out that while most AI systems can replicate and replace text for well-defined and specialized tasks, TextStyleBrush is different because it can reproduce text in both handwriting and real-world scenes. Doing this is a lot more difficult for an AI model because of the different text options and nuances involved.

“It means understanding unlimited text styles for not just different typography and calligraphy, but also for different transformations, like rotations, curved text, and deformations that happen between paper and pen when handwriting; background clutter; and image noise,” Facebook explained in a news announcement.

TextStyleBrush is the first self-supervised AI model that can replicate and replace text in handwritten and real-world scenes by using just a single example word from an image, according to Facebook. It displayed high accuracy in automated tests and user studies for any type of text, the company said, adding that it intended to submit the work to a peer-reviewed journal.

Leave a Comment