Ilya Sutskever

Ilya Sutskever is a person.

• Example(s):
  • Ilya Sutskever, 2013, when Google acquired DNNResearch.
  • Ilya Sutskever, 2015, when he cofounded OpenAI.
  • Ilya Sutskever, 2020.
  • Ilya Sutskever, 2023.
  • ...
• See: word2vec, Word Embedding Algorithm, Text Sequence Probability Function, bAbI Project, Neural Sequence-to-Sequence Learning.

---

---

References

• Google Scholar Author Page: https://scholar.google.com/citations?user=x04W_mMAAAAJ
• https://wikipedia.org/wiki/Ilya_Sutskever

2023

• Bing Chat
  • Ilya Sutskever is a computer scientist who has made several major contributions to the field of deep learning ¹. He was born in Gorky, Russian SFSR, Soviet Union in 1985 or 1986 ¹. At age 5, he immigrated with his family to Israel and spent his formative years in Jerusalem ¹. Sutskever attended the Open University of Israel between 2000 and 2002 ¹. After that, he moved to Canada with his family and transferred to the University of Toronto in Ontario ¹. From the University of Toronto, Sutskever received a Bachelor of Science in mathematics in 2005, a Master of Science in computer science in 2007, and a Doctor of Philosophy in computer science in 2013 ¹. His doctoral supervisor was Geoffrey Hinton ¹.
  • In 2012, Sutskever built AlexNet in collaboration with Hinton and Alex Krizhevsky ¹. To support the computing demands of AlexNet, Sutskever bought many GTX 580 GPUs online ¹. From November to December 2012, Sutskever spent about two months as a postdoc with Andrew Ng at Stanford University ¹. He then returned to the University of Toronto and joined Hinton's new research company DNNResearch, a spinoff of Hinton's research group ¹. Four months later, in March 2013, Google acquired DNNResearch and hired Sutskever as a research scientist at Google Brain ¹. At Google Brain, Sutskever worked with Oriol Vinyals and Quoc Viet Le to create the sequence-to-sequence learning algorithm, and worked on TensorFlow ¹. At the end of 2015, he left Google to become cofounder and chief scientist of the newly founded organization OpenAI ¹. In 2023, he announced that he will co-lead OpenAI's new "Superalignment" project, which tries to solve the alignment of superintelligences in 4 years ¹.
  • Source: Conversation with Bing, 11/27/2023
    1. Ilya Sutskever - Wikipedia. https://en.wikipedia.org/wiki/Ilya_Sutskever.
    2. Who is Ilya Sutskever, the AI scientist ousted from OpenAI board and .... https://indianexpress.com/article/technology/artificial-intelligence/who-is-ilya-sutskever-sceptical-about-ai-9042098/.
    3. Ilya Sutskever's home page - Department of Computer Science, University .... https://www.cs.utoronto.ca/~ilya/.
    4. Ilya Sutskever,Networth, wife, full Bio of his life in 2023.. https://busistory.com/ilya-sutskevernetworth-wife-bio-of-his-life-in-2023/.
    5. OpenAI Chief Scientist Dr Ilya Sutskever - Life Architect. https://lifearchitect.ai/ilya/.

2023

• (Lightman et al., 2023) ⇒ Hunter Lightman, Vineet Kosaraju, Yura Burda, Harri Edwards, Bowen Baker, Teddy Lee, Jan Leike, John Schulman, Ilya Sutskever, and Karl Cobbe. (2023). “Let's Verify Step by Step.” In: arXiv preprint arXiv:2305.20050. doi:10.48550/arXiv.2305.20050

2021

• (Chen, Tworek et al., 2021) ⇒ Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde de Oliveira Pinto, Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman, Alex Ray, Raul Puri, Gretchen Krueger, Michael Petrov, Heidy Khlaaf, Girish Sastry, Pamela Mishkin, Brooke Chan, Scott Gray, Nick Ryder, Mikhail Pavlov, Alethea Power, Lukasz Kaiser, Mohammad Bavarian, Clemens Winter, Philippe Tillet, Felipe Petroski Such, Dave Cummings, Matthias Plappert, Fotios Chantzis, Elizabeth Barnes, Ariel Herbert-Voss, William Hebgen Guss, Alex Nichol, Alex Paino, Nikolas Tezak, Jie Tang, Igor Babuschkin, Suchir Balaji, Shantanu Jain, William Saunders, Christopher Hesse, Andrew N. Carr, Jan Leike, Josh Achiam, Vedant Misra, Evan Morikawa, Alec Radford, Matthew Knight, Miles Brundage, Mira Murati, Katie Mayer, Peter Welinder, Bob McGrew, Dario Amodei, Sam McCandlish, Ilya Sutskever, and Wojciech Zaremba. (2021). “Evaluating Large Language Models Trained on Code.” arXiv preprint arXiv:2107.03374.
• (Radford et al., 2021) ⇒ Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, Gretchen Krueger, Ilya Sutskever. (2021). "Learning Transferable Visual Models From Natural Language Supervision.” In: Proceedings of Machine Learning Research, PMLR 139:8748-8763.
• (Ramesh et al., 2021) ⇒ Aditya Ramesh, Mikhail Pavlov, Gabriel Goh, Scott Gray, Chelsea Voss, Alec Radford, Mark Chen, and Ilya Sutskever. (2021). “Zero-shot Text-to-image Generation.” In: International Conference on Machine Learning.

2020

• (Brown et al., 2020) ⇒ Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeffrey Wu, Clemens Winter, Christopher Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. (2020). “Language Models Are Few-Shot Learners.” In: Advances in Neural Information Processing Systems 33 (NeurIPS 2020).

2019

• (Radford et al., 2019) ⇒ Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. (2019). “Language Models Are Unsupervised Multitask Learners.” In: OpenAI Blog Journal, 1(8).

2018

• (Radford et al., 2018) ⇒ Alec Radford, Karthik Narasimhan, Tim Salimans, and Ilya Sutskever. (2018). “Improving Language Understanding by Generative Pre-Training.”

2017

• (Radford et al., 2017) ⇒ Alec Radford, Rafal Jozefowicz, and Ilya Sutskever. (2017). “Learning to Generate Reviews and Discovering Sentiment.” doi:10.48550/arXiv.1704.01444

2016

• (Silver et al., 2016) ⇒ David Silver, Aja Huang, Chris J. Maddison, Arthur Guez, Laurent Sifre, George van den Driessche, Julian Schrittwieser, Ioannis Antonoglou, Veda Panneershelvam, Marc Lanctot, Sander Dieleman, Dominik Grewe, John Nham, Nal Kalchbrenner, Ilya Sutskever, Timothy Lillicrap, Madeleine Leach, Koray Kavukcuoglu, Thore Graepel, and Demis Hassabis. (2016). “Mastering the Game of Go with Deep Neural Networks and Tree Search.” In: Nature, 529(7587). doi:10.1038/nature16961
• (Neelakantan et al., 2016) ⇒ Arvind Neelakantan, Quoc V. Le, and Ilya Sutskever. (2016). “Neural Programmer: Inducing Latent Programs with Gradient Descent.” In: Proceedings of International Conference on Learning Representations (ICLR 2016).
• (Luong et al., 2016) ⇒ Minh-Thang Luong, Quoc V. Le, Ilya Sutskever, Oriol Vinyals, and Lukasz Kaiser. (2016). “Multi-task Sequence to Sequence Learning.” In: Proceedings of 4th International Conference on Learning Representations (ICLR-2016).
• (Abadi et. al., 2016a) ⇒ Martín Abadi, Ashish Agarwal, Paul Barham, Eugene Brevdo, Zhifeng Chen, Craig Citro, Greg S. Corrado, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Ian Goodfellow, Andrew Harp, Geoffrey Irving, Michael Isard, Yangqing Jia, Rafal Jozefowicz, Lukasz Kaiser, Manjunath Kudlur, Josh Levenberg, Dan Mane, Rajat Monga, Sherry Moore, Derek Murray, Chris Olah, Mike Schuster, Jonathon Shlens, Benoit Steiner, Ilya Sutskever, Kunal Talwar, Paul Tucker, Vincent Vanhoucke, Vijay Vasudevan, Fernanda Viegas, Oriol Vinyals, Pete Warden, Martin Wattenberg, Martin Wicke, Yuan Yu, Xiaoqiang Zheng. (2016). “TensorFlow - Large-Scale Machine Learning on Heterogeneous Distributed Systems.” In: arXiv 1603.04467 Journal.
• (Luong, Sutskever et al., 2015) ⇒ Minh-Thang Luong, Ilya Sutskever, Quoc V. Le, Oriol Vinyals, and Wojciech Zaremba. (2014). “Addressing the Rare Word Problem in Neural Machine Translation.” In: Proceedings of ACL (ACL-2015)

2015

• (Vinyals et al., 2015) ⇒ Oriol Vinyals, Lukasz Kaiser, Terry Koo, Slav Petrov, Ilya Sutskever, and Geoffrey Hinton. (2015). “Grammar As a Foreign Language.” In: Proceedings of the 28th International Conference on Neural Information Processing Systems - Volume 2.

2014

• (Sutskever et al., 2014) ⇒ Ilya Sutskever, Oriol Vinyals, and Quoc V. Le. (2014). “Sequence to Sequence Learning with Neural Networks.” In: Advances in Neural Information Processing Systems (NIPS 2014).
• (Srivastava et al., 2014) ⇒ Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. (2014). “Dropout: A Simple Way to Prevent Neural Networks from Overfitting.” In: The Journal of Machine Learning Research, 15(1).

2013

• (Mikolov et al., 2013c) ⇒ Tomáš Mikolov, Ilya Sutskever, Kai Chen, Greg S Corrado, and Jeff Dean. (2013). “Distributed Representations of Words and Phrases and their Compositionality.” In: Advances in Neural Information Processing Systems 26 (NIPS 2013).

2012

• (Krizhevsky et al., 2012) ⇒ Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. “Imagenet Classification with Deep Convolutional Neural Networks.” In: Advances in Neural Information Processing Systems (NIPS 2012).
• (Hinton et al., 2012) ⇒ Geoffrey E. Hinton, Nitish Srivastava, Alex Krizhevsky, Ilya Sutskever, and Ruslan R. Salakhutdinov. (2012). “Improving Neural Networks by Preventing Co-adaptation of Feature Detectors.” arXiv preprint arXiv:1207.0580

---