Washington: Scientists, including one of Indian-origin, have developed a new technology which can use photos of a chair, lamp or some other furniture item to tell you who makes it, where to buy it and how it might look in various rooms.
“It seems a lot of people want to buy things they see in someone else’s home or in a photo, but they do not know where to look,” said Sean Bell from Cornell University in the US.
The system relies on “deep learning,” a neural network that enables a computer to match a submitted photo with a vast database of “iconic images” from manufacturers’ catalogues or specialised websites devoted to home furnishings.
A neural network is a computer programme inspired by the working of neurons in the human brain. As data is passed through the network, locations in memory that are activated repeatedly are increased in value, just as a biological brain forms synapses, researchers said.
“Deep learning” combines several layers of neurons that represent different aspects of the data – earlier layers typically represent edges and lines, middle layers represent parts and shapes, and later layers represent entire objects and concepts, they said.
Researchers used crowd sourcing to prepare a collection of images to train the neural network. They showed home workers scene photos and asked them to draw boxes around objects. The resulting collection of boxes, along with their matching iconic images, was used to train the computer.
Rather than force the computer to go through the entire database looking for a match, the system begins by using the neural network to generate a “fingerprint” of a submitted image, based on very broad characteristics of how the pixels are arranged, researchers said.
Then the computer can search just a local area of the database, analogous to searching for a phone number in just one area code.”I am excited by the importance of this for the design industry,” said Kavita Bala, professor at Cornell.
The findings were published in the journal ACM Transactions on Graphics.