Here the robot is given a text prompt (bottom left). This is a description of the target shown in the top right. The robot then navigates the building autonomously (left images, showing two experiments), mapping as it goes until it finds the object. An example of zero-shot learning.
This example is running in a simulated environmentÂ
An example with a real robot.
The preprint of Juzhou Chen paper is here: