Title | ||
---|---|---|
Language-Aligned Waypoint (LAW) Supervision for Vision-and-Language Navigation in Continuous Environments. |
Abstract | ||
---|---|---|
In the Vision-and-Language Navigation (VLN) task an embodied agent navigates a 3D environment, following natural language instructions. A challenge in this task is how to handle 'off the path' scenarios where an agent veers from a reference path. Prior work supervises the agent with actions based on the shortest path from the agent's location to the goal, but such goal-oriented supervision is often not in alignment with the instruction. Furthermore, the evaluation metrics employed by prior work do not measure how much of a language instruction the agent is able to follow. In this work, we propose a simple and effective language-aligned supervision scheme, and a new metric that measures the number of sub-instructions the agent has completed during navigation. |
Year | Venue | DocType |
---|---|---|
2021 | EMNLP | Conference |
Volume | Citations | PageRank |
2021.emnlp-main | 0 | 0.34 |
References | Authors | |
0 | 5 |
Name | Order | Citations | PageRank |
---|---|---|---|
Sonia Raychaudhuri | 1 | 0 | 0.34 |
Saim Wani | 2 | 0 | 1.35 |
Shivansh Patel | 3 | 0 | 1.01 |
Unnat Jain | 4 | 1 | 2.72 |
Angel Chang | 5 | 1340 | 58.19 |