text: In the prose style transfer task a system, provided with text input and a target prose style, produces output which preserves the meaning of the input text but alters the style. These systems require parallel data for evaluation of results and usually make use of parallel data for training. Currently, there are few publicly available corpora for this task. In this work, we identify a high-quality source of aligned, stylistically distinct text in different versions of the Bible. We provide a standardized split, into training, development and testing data, of the public domain versions in our corpus. This corpus is highly parallel since many Bible versions are included. Sentences are aligned due to the presence of chapter and verse numbers within all versions of the text. In addition to the corpus, we present the results, as measured by the BLEU and PINC metrics, of several models trained on our data which can serve as baselines for future research. While we present these data as a style transfer corpus, we believe that it is of unmatched quality and may be useful for other natural language tasks as well.
  @cite_31: Text simplification (TS) aims to reduce the lexical and structural complexity of a text, while still retaining the semantic meaning. Current automatic TS techniques are limited to either lexical-level applications or manually defining a large amount of rules. Since deep neural networks are powerful models that have achieved excellent performance over many difficult tasks, in this paper, we propose to use the Long Short-Term Memory (LSTM) Encoder-Decoder model for sentence level TS, which makes minimal assumptions about word sequence. We conduct preliminary experiments to find that the model is able to learn operation rules such as reversing, sorting and replacing from sequence pairs, which shows that the model may potentially discover and apply rules such as modifying sentence structure, substituting words, and removing words for TS.
  @cite_14: 
  @cite_20: We present initial investigation into the task of paraphrasing language while targeting a particular writing style. The plays of William Shakespeare and their modern translations are used as a testbed for evaluating paraphrase systems targeting a specific style of writing. We show that even with a relatively small amount of parallel training data, it is possible to learn paraphrase models which capture stylistic phenomena, and these models outperform baselines based on dictionaries and out-of-domain parallel text. In addition we present an initial investigation into automatic evaluation metrics for paraphrasing writing style. To the best of our knowledge this is the first work to investigate the task of paraphrasing text with the goal of targeting a specific style of writing.
  @cite_34: Variations in writing styles are commonly used to adapt the content to a specific context, audience, or purpose. However, applying stylistic variations is still by and large a manual process, and there have been little efforts towards automating it. In this paper we explore automated methods to transform text from modern English to Shakespearean English using an end to end trainable neural model with pointers to enable copy action. To tackle limited amount of parallel data, we pre-train embeddings of words by leveraging external dictionaries mapping Shakespearean words to modern English words as well as additional text. Our methods are able to get a BLEU score of 31+, an improvement of 6 points above the strongest baseline. We publicly release our code to foster further research in this area.
summary: The advances mentioned previously in neural machine translation have only started to be applied to more general stylistic paraphrasing. One approach proposed the training of a neural model which would disentangle'' stylistic and semantic features, but did not publish any results @cite_14 . Another attempt at text simplification as stylistic paraphrasing is @cite_31 . They generate artificial data and show that the model performs well, but do no experiments with human-produced corpora. The Shakespeare dataset @cite_34 recently was used with a Seq2Seq model @cite_20 . Their results are impressive, showing significant improvement over statistical machine translation methods as measured by automatic metrics. They experiment with many settings, but their best models all require the integration of a human-produced dictionary which translates approximately 1500 Shakespearean words to their modern equivalent. None of the models they explore without using this dictionary are able to outperform the statistical model. Since such dictionaries do not exist for most style pairs we show that Seq2Seq can outperform statistical methods without such specialized data. This generality opens up a much broader collection of text as candidates for style transfer using Seq2Seq.