The Frenchman was demoted from third to fourth after exceeding track limits too often but he says he never received a warning