30s Summary
Ilya Sutskever, a founding member of OpenAI, hints at the end of AI’s early phase which relies on pre-training. He argues we’re improving computing capabilities faster than expanding learnable data for AI, likening data to AI’s “fossil fuel”. He suggests the future of AI includes autonomous AI, artificial data generation, and inference time computing. This could potentially lead to superintelligent AI. Sutskever also mentions the rise of AI in finance and tech, specifically with AI-driven cryptocurrencies. Google’s AI lab, DeepMind, is working on Gemini 2.0, an autonomous AI model to perform complex tasks and improve system performance.
Full Article
Ilya Sutskever, one of the founding members of OpenAI, recently spoke at a conference called NeurIPS 2024, which was held in Vancouver, Canada. His talk had a central theme: we’re living in the final days of AI’s early phase, which relies on pre-training. He also hinted about the arrival of an extremely smart AI technology.
Sutskever said that the era marked by AI learning from gallons of data might be coming to a conclusion. This, he explained, is because we’re improving our computing capabilities faster than we are increasing our stock of learnable data for AI models. He even went on to call data the “fossil fuel” of AI.
He pointed out, “Data is not growing because we have but one internet. You could even say that data is the fossil fuel of AI. It was created somehow, and now we use it, and we’ve achieved peak data, and there will be no more — we have to deal with the data that we have.”
According to Sutskever, the future of AI will involve autonomous AI, artificial data generation, and inference time computing – developments that could eventually lead to the creation of a superintelligent AI.
In the broader realm of tech and online finance, AI has been stirring up quite the storm. For instance, artificially intelligent systems are now capable of making decisions on their own. They’re becoming so popular that they’ve entered into the world of cryptocurrencies, partly driving the growth of AI-inspired digital currencies and big language models like “Truth Terminal.”
Truth Terminal went viral when it backed a crypto coin named Goatseus Maximus (GOAT). This coin managed to hit the 1 billion dollars market cap, grabbing attention from regular investors and well-known startup investors.
Google’s AI lab, known as DeepMind, has announced Gemini 2.0 – a model that will drive these autonomous AI systems. The tech giant mentioned that these AI-powered agents would help perform complex tasks like coordinating between different websites and logical reasoning.
Such improvements in AI agents that can work on their own and reason marks a significant step towards moving beyond data hallucinations. This is a challenge in the current AI realm, where poor datasets and a reliance on older models to train newer ones are causing system performance to decrease over time.