February 6, 2017
Facebook’s Lumos computer vision platform, which was originally created to help visually impaired members of the social network’s community, is now being used for a more sophisticated image search. It allows users to find images on Facebook via key words that describe content, rather than a search that is limited to tags and captions. “Facebook trained an ever-fashionable deep neural network on tens of millions of photos,” explains TechCrunch. “The model essentially matches search descriptors to features pulled from photos” and “ranks its output using information from both the images and the original search.” Facebook may apply the tech to videos in the future and potentially raise the bar on its targeted ad offerings.