The Story of Ilya Sutskever - From AlexNet to ChatGPT
I came across this really high quality video about Ilya Sutskever and history of OpenAI.
- History of neural network and the stagnation it had for decades
- Right from how Ilya started interacting with Geoffrey Hinton, Alex Krizhevsky to presenting AlexNet which was trained using GPU and how it outperformed all the image recogination models at that time. And it was the breakthrough at that time.
- His Google days
- Starting OpenAI as a non-profit company which was funded by Elon and it’s culture
- Building GPT model as PoC
- How OpenAI was struggling to raise money because of non profit structure. And how Elon wanted to merge OpenAI with Tesla because of the cash crunch.
- Why Google didn’t take any action with Attention is all you need paper (conflict of interest with Ad revenue)
- OpenAI getting funding from Microsoft (who had became a majority share holder)
- Sam Altman’s way of running OpenAI - Like a traditional startup. Ship fast break things!
- How ChatGPT (which used GPT-3 model) got exploded in few days
- The drama which lead to Sam’s firing at OpenAI and reinstating with more power
- Ilya leaving OpenAI to starting Safe Superintelligence Inc