AirHelp itineraries classification - magic or challenge?

One of the things we do in AirHelp is to try to find emails with flight itineraries in people's mailboxes and see if they are entitled for a compensation (delayed or cancelled past flights). This is a short story about how we started with a very simple filtering solution and evolved it to a sophisticated machine learning model.