Ruiyi Zhang @ Adobe Research

Modified: 2014/08/25 22:19 by admin - Uncategorized
Image Ruiyi (Roy) Zhang
Chinese name

Research Scientist
Adobe Research
[Linkedin]
[Google Scholar]
ry[last.name].cs@gmail.com
Image
ImageImage

Edit

About Me

I am currently a Research Scientist at Adobe Research. My research interests include (interactive) machine learning, reinforcement learning (RL) and natural language processing (NLP), especially the intersection of them. More specifically, I focused on the subfields:
  • Interactive NLP: Human-in-the-loop Sequence Labeling and Generation
  • Multimodal Interactive Recommendation and Generation
  • Uncertainty Estimation in Sequential Decision-Making.

Before that, I obtained my Ph.D. from the Department of Computer Science, Duke University. My thesis is about Uncertainty Estimation in Deep Reinforcement Learning and my Ph.D. advisor is Professor Lawrence Carin. I received my B.Sc. degree at Nanjing University in 2016. I was a member of LAMDA Group, led by Dr. Zhi-Hua Zhou.

I worked as a research intern at AWS AI Lab (New York, Summer 2020), Google Brain (Mountain View, Summer 2019), Samsung Research America (Mountain View, Spring 2019 & 2020), Adobe Research (San Jose, Summer 2018), and Alibaba AntAI (Hangzhou, Summer 2016).


Edit

News

  • Apr. 2022: One paper has been accepted to SIGIR 2022.
  • Mar. 2022: One paper has been accepted to CVPR 2022 (SoTA on text-to-image sythesis with 1% DALL-E size).
  • Feb. 2022: Two papers have been accepted to ACL 2022.
  • Nov. 2021: Two papers have been accepted to AAAI 2022 (one with my first intern Yufan).
  • Sep. 2021: Two papers have been accepted to NeurIPS 2021, ENLSP Workshop.
  • Mar. 2021: I am co-organizing IJCAI workshop on Continual and Multimodal Learning.
  • Feb. 2021: I finished my Ph.D. Defense!
  • Jan. 2021: One paper has been accepted to ICLR 2021.
  • Dec. 2020: Two papers (one with Google & ASAPP) have been accepted to AAAI 2021.
  • Sep. 2020: Three papers have been accepted to EMNLP 2020.
  • May 2020: Two papers (one with Google & DeepMind) have been accepted to ICML 2020.
  • Apr. 2020: One paper has been accepted to ACL 2020.
  • Jan. 2020: Two papers have been accepted to AISTATS 2020.
  • Dec. 2019: Two papers (one with Google Brain) have been accepted to ICLR 2020.
  • Sep. 2019: Two papers (one with Samsung Research) have been accepted to NeurIPS 2019.
  • Jun. 2019: Invited talk at Workshop on Stein's Method @ ICML2019 [Slides]

Edit

Selected Publications [Full List]

  • LAFITE: Towards Language-Free Training for Text-to-Image Generation [Paper]
    Yufan Zhou, Ruiyi Zhang, Changyou Chen, Chunyuan Li, Chris Tensmeyer, Tong Yu, Jiuxiang Gu, Jinhui Xu, Tong Sun

    Conference on Computer Vision and Pattern Recognition (CVPR), 2022. 
  • TiGAN: Text-based Interactive Image Generation and Manipulation [Paper]
    Yufan Zhou, Ruiyi Zhang, Jiuxiang Gu, Chris Tensmeyer, Tong Yu, Changyou Chen, Jinhui Xu, Tong Sun

    AAAI Conference on Artificial Intelligence (AAAI), 2022. 
  • Text-based Interactive Recommendation via Offline Reinforcement Learning [Paper]
    Ruiyi Zhang, Tong Yu, Yilin Shen, Hongxia Jin

    AAAI Conference on Artificial Intelligence (AAAI), 2022. 
  • Improving Adversarial Text Generation by Modeling the Distant Future [Paper]
    Ruiyi Zhang, Changyou Chen, Zhe Gan, Wenlin Wang, Zheng Wen, Lawrence Carin

    Annual Conference of the Association for Computational Linguistics (ACL), 2020. 
    Abridged in ICML 2019, Real-World Sequential Decision-Making Workshop
  • Text-based Interactive Recommendation via Constraint Augumented Reinforcement Learning [Paper]
    Ruiyi Zhang, Tong Yu, Yilin Shen, Hongxia Jin, Changyou Chen, Lawrence Carin
    Neural Information Processing Systems (NeurIPS), 2019. 
  • GenDICE: Generalized Offline Estimation of Stationary Values (Oral) [Paper]
    Ruiyi Zhang, Bo Dai, Lihong Li, Dale Schuurmans
    International Conference on Learning Representations (ICLR), 2020. 
  • Improving Zero-Shot Voice Style Transfer via Disentangled Representation Learning [Paper]
    Siayng Yuan, Pengyu Cheng, Ruiyi Zhang, Weituo Hao, Zhe Gan, Lawrence Carin
    International Conference on Learning Representations (ICLR), 2021. 
  • Unsupervised Abstractive Dialogue Summarization for Tete-a-Tetes [Paper]
    Xinyuan Zhang, Ruiyi Zhang, Manzil Zaheer, Amr Ahmed
    AAAI Conference on Artificial Intelligence (AAAI), 2021. 
  • Scalable Thompson Sampling via Optimal Transport [Paper] [Poster] [Code]
    Ruiyi Zhang, Zheng Wen, Changyou Chen, Chen Fang, Tong Yu, Lawrence Carin
    Artificial Intelligence and Statistics (AISTATS), 2019. 
    Abridged in NeurIPS 2018, Workshop on Infer to Control
  • Topic-Guided Variational Auto-Encoders for Text Generation (Oral) [Paper]
    Wenlin Wang, Zhe Gan, Hongteng Xu, Ruiyi Zhang, Dinghan Shen, Guoyin Wang, Changyou Chen, Lawrence Carin
    North American Chapter of the Association for Computational Linguistics (NAACL), 2019. 
  • Improving Sequence-to-Sequence Learning via Optimal Transport [Paper] [Code]
    Liqun Chen, Yizhe Zhang, Ruiyi Zhang, Chenyang Tao, Zhe Gan, Bai Li, Dinghan Shen, Changyou Chen, Lawrence Carin
    International Conference for Learning Representations (ICLR), 2019. 
  • Policy Optimization as Wasswerstein Gradient Flows [Paper] [Poster] [Appendix] [Demo]
    Ruiyi Zhang, Changyou Chen, Chunyuan Li, Lawrence Carin
    International Conference on Machine Learning (ICML), 2018. 
    Abridged in NIPS 2017, Workshop on Deep Reinforcement Learning

Edit

Professional Sevices

  • Senior Program Committee & Area Chair: IJCAI'21-22, AAAI'22
  • Program Committee & Reviewer: AAAI'19-21, NeurIPS'19-21, ICLR'21, ACL'20-21, EMNLP'20-21, CVPR'19-21, ICCV'19-21, ICML'20-21
  • Workshop on Continual and Multimodal Learning @ Ubicomp'19 and IJCAI'21

Edit

Awards & Honors

  • Outstanding Graduate Student of Nanjing University, Rank 1st/143 in CS, 2016
  • CCF (China Computer Federation) Outstanding Undergraduate Award 2015
  • Microsoft Young Fellowship by Microsoft Research Aisa 2015
  • Pacemaker of Outstanding Student of Nanjing University (30/12000+) 2014
  • National Undergraduate Scholarship for consecutive three years. 2013

Miscellaneous

Outside of research, I enjoy reading, traveling and cooking. I put some of my photos on 500px .

The end