Ruiyi Zhang @ Adobe Research

Modified: 2014/08/25 22:19 by admin - Uncategorized
Image Ruiyi (Roy) Zhang
Chinese name

Research Scientist
Adobe Research
San Jose, CA

[Linkedin]
[Google Scholar]


ry[last.name].cs@gmail.com
Image
ImageImage



Edit

About Me

I am currently a Research Scientist at Adobe Research. My research interests include (interactive) machine learning, reinforcement learning (RL) and natural language processing (NLP), especially the intersection of them. More specifically, I focused on the subfields:
  • Interactive NLP: Human-in-the-loop Sequence Labeling and Generation
  • Multimodal Interactive Recommendation and Generation
  • Uncertainty Estimation in Sequential Decision-Making.

Before that, I obtained my Ph.D. from the Department of Computer Science, Duke University. My thesis is about Uncertainty Estimation in Deep Reinforcement Learning and my Ph.D. advisor is Professor Lawrence Carin. I received my B.Sc. degree at Nanjing University in 2016. I was a member of LAMDA Group, led by Dr. Zhi-Hua Zhou.

I worked as a research intern at Google Brain (Mountain View, Summer 2019), Samsung Research America (Mountain View, Spring 2019 & 2020), Adobe Research (San Jose, Summer 2018), and Alibaba AntAI (Hangzhou, Summer 2016).


[Internship] I am hiring self-motivated research interns (Ph.D. student preferred) for Summer 2022. Feel free to contact me if you are interested in working with me. The topics to explore in Summer 2022 include (but not limited to) human-in-the-loop NLP (e.g., entity retrieval/recognition, text generation, etc) and multimodal learning (e.g., interactive retrieval and generation with CLIP).

Edit

News

  • Nov. 2021: Two papers have been accepted to AAAI 2022 (one with my first intern Yufan).
  • Sep. 2021: Two papers have been accepted to NeurIPS 2021, ENLSP Workshop.
  • Apr. 2021: Joined Adobe Research as a Research Scientist
  • Mar. 2021: I am co-organizing IJCAI workshop on Continual and Multimodal Learning.
  • Feb. 2021: I finished my Ph.D. Defense!
  • Jan. 2021: One paper has been accepted to ICLR 2021.
  • Dec. 2020: Two papers (one with Google & ASAPP) have been accepted to AAAI 2021.
  • Oct. 2020: Invited talk at INFORMS Annual Meeting 2020.
  • Sep. 2020: Three papers have been accepted to EMNLP 2020.
  • May 2020: Two papers (one with Google & DeepMind) have been accepted to ICML 2020.
  • Apr. 2020: One paper has been accepted to ACL 2020.
  • Jan. 2020: Two papers have been accepted to AISTATS 2020.
  • Dec. 2019: Two papers (one with Google Brain) have been accepted to ICLR 2020.
  • Sep. 2019: Two papers (one with Samsung Research) have been accepted to NeurIPS 2019.
  • Jun. 2019: Invited talk at Workshop on Stein's Method @ ICML2019 [Slides]

Edit

Selected Publications [Full List]

  • LAFITE: Towards Language-Free Training for Text-to-Image Generation [Paper]
    Yufan Zhou, Ruiyi Zhang, Changyou Chen, Chunyuan Li, Chris Tensmeyer, Tong Yu, Jiuxiang Gu, Jinhui Xu, Tong Sun

    arXiv:2111.13792, 2021. 
  • Interactive Image Generation with Natural-Language Feedback [Paper]
    Yufan Zhou, Ruiyi Zhang, Jiuxiang Gu, Chris Tensmeyer, Tong Yu, Changyou Chen, Jinhui Xu, Tong Sun

    AAAI Conference on Artificial Intelligence (AAAI), 2022. 
  • Offline Interactive Recommendation with Natural-Language Feedback [Paper]
    Ruiyi Zhang, Tong Yu, Yilin Shen, Hongxia Jin

    AAAI Conference on Artificial Intelligence (AAAI), 2022. 
  • Improving Adversarial Text Generation by Modeling the Distant Future [Paper]
    Ruiyi Zhang, Changyou Chen, Zhe Gan, Wenlin Wang, Zheng Wen, Lawrence Carin

    Annual Conference of the Association for Computational Linguistics (ACL), 2020. 
    Abridged in ICML 2019, Real-World Sequential Decision-Making Workshop
  • Text-based Interactive Recommendation via Constraint Augumented Reinforcement Learning [Paper]
    Ruiyi Zhang, Tong Yu, Yilin Shen, Hongxia Jin, Changyou Chen, Lawrence Carin
    Neural Information Processing Systems (NeurIPS), 2019. 
  • GenDICE: Generalized Offline Estimation of Stationary Values (Oral) [Paper]
    Ruiyi Zhang, Bo Dai, Lihong Li, Dale Schuurmans
    International Conference on Learning Representations (ICLR), 2020. 
  • Improving Zero-Shot Voice Style Transfer via Disentangled Representation Learning [Paper]
    Siayng Yuan, Pengyu Cheng, Ruiyi Zhang, Weituo Hao, Zhe Gan, Lawrence Carin
    International Conference on Learning Representations (ICLR), 2021. 
  • Unsupervised Abstractive Dialogue Summarization for Tete-a-Tetes [Paper]
    Xinyuan Zhang, Ruiyi Zhang, Manzil Zaheer, Amr Ahmed
    AAAI Conference on Artificial Intelligence (AAAI), 2021. 
  • Scalable Thompson Sampling via Optimal Transport [Paper] [Poster] [Code]
    Ruiyi Zhang, Zheng Wen, Changyou Chen, Chen Fang, Tong Yu, Lawrence Carin
    Artificial Intelligence and Statistics (AISTATS), 2019. 
    Abridged in NeurIPS 2018, Workshop on Infer to Control
  • Topic-Guided Variational Auto-Encoders for Text Generation (Oral) [Paper]
    Wenlin Wang, Zhe Gan, Hongteng Xu, Ruiyi Zhang, Dinghan Shen, Guoyin Wang, Changyou Chen, Lawrence Carin
    North American Chapter of the Association for Computational Linguistics (NAACL), 2019. 
  • Improving Sequence-to-Sequence Learning via Optimal Transport [Paper] [Code]
    Liqun Chen, Yizhe Zhang, Ruiyi Zhang, Chenyang Tao, Zhe Gan, Bai Li, Dinghan Shen, Changyou Chen, Lawrence Carin
    International Conference for Learning Representations (ICLR), 2019. 
  • Policy Optimization as Wasswerstein Gradient Flows [Paper] [Poster] [Appendix] [Demo]
    Ruiyi Zhang, Changyou Chen, Chunyuan Li, Lawrence Carin
    International Conference on Machine Learning (ICML), 2018. 
    Abridged in NIPS 2017, Workshop on Deep Reinforcement Learning

Edit

Professional Sevices

  • Senior Program Committee & Area Chair: IJCAI'21-22, AAAI'22
  • Program Committee & Reviewer: AAAI'19-21, NeurIPS'19-21, ICLR'21, ACL'20-21, EMNLP'20-21, CVPR'19-21, ICCV'19-21, ICML'20-21
  • Workshop on Continual and Multimodal Learning @ Ubicomp'19 and IJCAI'21

Edit

Awards & Honors

  • Outstanding Graduate Student of Nanjing University, Rank 1st/143 in CS, 2016
  • CCF (China Computer Federation) Outstanding Undergraduate Award 2015
  • Microsoft Young Fellowship by Microsoft Research Aisa 2015
  • Pacemaker of Outstanding Student of Nanjing University (30/12000+) 2014
  • National Undergraduate Scholarship for consecutive three years. 2013

Miscellaneous

Outside of research, I enjoy reading, traveling and cooking. I put some of my photos on 500px .

The end