Multistep prediction of vehicle states using transformers

Abstract

Multistep prediction is the prediction of states based on initial states and a series of control inputs.This paper focusses on developing transformer models for multistep prediction of vehicle states and testing different modifications of the transformer architecture using the example of the prediction of a ship simulation. Research in NLP promises advantages with regard to training time and prediction accuracy for the transformer architecture compared to a state-of-the-art LSTM model. The author also investigates whether positional encodings are useful in this scenario and if a transformer model can learn the order of the inputs without positional encodings.