Paul mentions at the party that he once drank too much and caused a car accident. This fits the story the woman is telling Maurice. Although it is not explicitly mentioned in the movie, it is quite possible that they were in the same car. Since the films overall theme is about Secrets & Lies, it only makes sense that Paul has his own little secret, which would be being responsible for taking away that woman's beauty.