The Silicon Trend Tech Bulletin

Icon Collap
Home / AI / ML / A New ML Model Interprets Object Relationships

A New ML Model Interprets Object Relationships

Published Thu, Dec 02 2021 04:46 am
by The Silicon Trend




A New ML Model Interprets Object Relationships

When humans look at a particular scene, they see objects and their relations. At the same time, several ML models find it hard to view the interaction to the world due to the lack of relation understanding between entities. MIT researchers have created a prototype that interprets the entangled relations between objects in a scene to solve this problem.


Also read: Deep Learning AI Revives the 70 years Idea: Neural Network


One Relation at a Time

The models represent and combine these to explain the entire plot. This helps the model to create more precise pictures. The researchers leveraged an ML technique known as energy-based models to portray particular relations simultaneously, encoding each relational explanation and composing it together to infer things and links. The model also works in reverse mode. When an image is given, it can discover the text explanation matching the scene relations.


Also read: Brain-machine Interface Turns Goals into Actions


Interpreting Complex Plots

The models were compared to other ML models that offered text descriptions and created pictures that exhibit the corresponding objects and relations. Finally, the researchers asked people to examine whether the images generated are similar to the original scene. In the most complicated cases, 91% percent of people concluded that the model performed better. They were delighted that the models would interpret the description that the model had never come across.