taohu commited on
Commit
71f2493
1 Parent(s): e551237

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +62 -0
README.md ADDED
@@ -0,0 +1,62 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - en
5
+ pipeline_tag: text generation
6
+ tags:
7
+ - non-autoregressive text generation
8
+ - generative model
9
+ - flow matching
10
+
11
+
12
+ ---
13
+ # Flow Matching for Conditional Text Generation in a Few Sampling Steps (EACL2024)
14
+
15
+ This model represents the official checkpoint of the paper titled "Flow Matching for Conditional Text Generation in a Few Sampling Steps (EACL2024)".
16
+
17
+
18
+ [Website](https://taohu.me/project_flowseq)
19
+ [![Paper](https://img.shields.io/badge/arXiv-PDF-b31b1b)](https://aclanthology.org/2024.eacl-short.33.pdf)
20
+ [![Hugging Face Model](https://img.shields.io/badge/🤗%20Hugging%20Face-Model-green)](https://huggingface.co/taohu/flowseq)
21
+ [![License](https://img.shields.io/badge/License-Apache--2.0-929292)](https://www.apache.org/licenses/LICENSE-2.0)
22
+
23
+
24
+ [Vincent Tao Hu](http://taohu.me),
25
+ [Di Wu](),
26
+ [Yuki M Asano](),
27
+ [Pascal Mettes](),
28
+ [Basura Fernando](),
29
+ [Björn Ommer]()
30
+ [Cees G.M. Snoek]()
31
+
32
+ Diffusion models are a promising tool for highquality text generation. However, current models face multiple drawbacks including slow
33
+ sampling, noise schedule sensitivity, and misalignment between the training and sampling
34
+ stages. In this paper, we introduce FlowSeq,
35
+ which bypasses all current drawbacks by leveraging flow matching for conditional text generation. FlowSeq can generate text in a few
36
+ steps by training with a novel anchor loss, alleviating the need for expensive hyperparameter
37
+ optimization of the noise schedule prevalent in
38
+ diffusion models. We extensively evaluate our
39
+ proposed method and show competitive performance in tasks such as question generation,
40
+ open-domain dialogue, and paraphrasing.
41
+
42
+
43
+ ## 🎓 Citation
44
+
45
+ ```bibtex
46
+ @inproceedings{HuEACL2024,
47
+ title = {Flow Matching for Conditional Text Generation in a Few Sampling Steps},
48
+ author = {Vincent Tao Hu and Di Wu and Yuki M Asano and Pascal Mettes and Basura Fernando and Björn Ommer and Cees G M Snoek},
49
+ year = {2024},
50
+ date = {2024-03-27},
51
+ booktitle = {EACL},
52
+ tppubtype = {inproceedings}
53
+ }
54
+ ```
55
+
56
+ ## 🎫 License
57
+
58
+ This work is licensed under the Apache License, Version 2.0 (as defined in the [LICENSE](LICENSE.txt)).
59
+
60
+ By downloading and using the code and model you agree to the terms in the [LICENSE](LICENSE.txt).
61
+
62
+ [![License](https://img.shields.io/badge/License-Apache--2.0-929292)](https://www.apache.org/licenses/LICENSE-2.0)