Neural Text d̶e̶Generation with Unlikelihood Training

Introducing a new objective, unlikelihood training, which forces unlikely generations to be assigned lower probability by the model, which improves overall quality of generated text.

Link: https://arxiv.org/pdf/1908.04319.pdf

#NLU #NLP #textgeneration