An important update regarding Facebook’s AAT – Automatic Alt Text -was announced by Facebook, the update will ensure that more images on the platform are readable by screen readers, enabling vision-impaired users to get a better experience within Facebook’s apps.

More About Facebook’s AAT:

The first Facebook’s AAT was launched back in 2016, enabling automated identification of objects within posted images via machine learning process, whenever manual alt-text descriptions were not provided. However, in its initial iteration, the process was fairly limited, which Facebook has been working to update ever since.

In light of Facebook’s AAT, Facebook explains: “First and foremost, we’ve expanded the number of concepts that AAT can reliably detect and identify in a photo by more than 10x, which in turn means fewer photos without a description. Descriptions are also more detailed, with the ability to identify activities, landmarks, types of animals, and so forth – for example, “Maybe a selfie of 2 people, outdoors, the Leaning Tower of Pisa.”

Moreover, That provides more capacity for Facebook to provide detailed descriptions of objects within images, including not only what they are, but where they’re placed within the frame.

Facebook adds: “So instead of describing the contents of a photo as “Maybe an image of 5 people,” we can specify that there are two people in the center of the photo and three others scattered toward the fringes, implying that the two in the center are the focus. Or, instead of simply describing a lovely landscape with “Maybe a house and a mountain,” we can highlight that the mountain is the primary object in a scene based on how large it appears in comparison with the house at its base.”

As noted, Facebook has been working to develop its visual recognition tools for years, which includes both still images and video content. Certainly, back in 2017, Facebook shared an overview of its video ID tools, which are not available as yet, but will moreover boost the platform’s capacity to both caters to vision-impaired users, furthermore, gather more data insights about what’s in posted content, what users are watching, what they’re engaging with, and much more.

Regarding the latest update of Facebook’s AAT, Facebook actually utilized Instagram images besides hashtags to map content, which further marks the potential of the process for data collection.

That could have implications beyond assisting differently-abled users. For instance, Facebook could actually look to help advertisers reach users who are interested in coffee by targeting those who’ve posted images of coffee cups or cafes regularly. Note that this could also help to further amplify your messaging because those users are likely to post your offer as well – so you could reach these users with a discount offer, with an increased likelihood of them also sharing that with their followers and friends.

However, note that Facebook is not offering these new image recognition insights as an ad targeting options as yet. Anyhow, the capacity is there, also, it could facilitate new search along with research options to maximize your audience response in the future.

Moreover, Facebook says that the new system is also more culturally and demographically inclusive, due to Facebook using a broader dataset of content, through the translation of hashtags in many languages:
“For example, it can identify weddings around the world based (in part) on traditional apparel instead of labeling only photos featuring white wedding dresses.”

Regarding Facebook’s AAT, the new system can provide more detail for those who want it. For instance, users will be initially presented with a basic description of each image, anyhow they’ll have the option to choose more specific insights, using the expanded data listings.

Facebook’s AAT system is now in operation, and users with screen readers can access the new data within Facebook’s apps.