loading page

Reinforcement Learning for Systematic FX Trading
  • Gabriel Borrageiro ,
  • Nick Firoozye ,
  • Paolo Barucca
Gabriel Borrageiro
University College London, University College London, University College London, University College London

Corresponding Author:[email protected]

Author Profile
Nick Firoozye
Author Profile
Paolo Barucca
Author Profile


We explore online inductive transfer learning, with a feature representation transfer from a radial basis function network formed of Gaussian mixture model hidden processing units to a direct, recurrent reinforcement learning agent. This agent is put to work in an experiment, trading the major spot market currency pairs, where we accurately account for transaction and funding costs. These sources of profit and loss, including the price trends that occur in the currency markets, are made available to the agent via a quadratic utility, who learns to target a position directly. We improve upon earlier work by learning to target a risk position in an online transfer learning context. Our agent achieves an annualised portfolio information ratio of 0.52 with a compound return of 9.3%, net of execution and funding cost, over a 7-year test set; this is despite forcing the model to trade at the close of the trading day at 5 pm EST when trading costs are statistically the most expensive.
2022Published in IEEE Access volume 10 on pages 5024-5036. 10.1109/ACCESS.2021.3139510