Join us in exploring the evolving space of GenAI tools and infrastructure, featuring Rajat Monga, Co-Founder of TensorFlow and Google Brain.

A good power tool can make the difference of easily six to seven hours of work when you’re doing woodworking. And the world of AI is no different. The types of tools and infrastructure that are developed to help you as enterprise leaders build artificial intelligence products and features are very, very important. In this episode, with our guest’s help, we will unpack the infrastructure that surrounds you and the tooling that will help you as enterprise leaders build AI products and services.

However, you can also tell it, you know what? I don’t want you to do the math instead generate code that will do the math for me or use this certain calculator to do the math for me, and it can do that really, and you’ll get the right answers. And that’s basically what prompted generating has been about.

– Rajat Monga

We will look at how tooling and infrastructure needs are changing in the world of AI with the increasing adoption of GenAI. One key change that emerged from the talk is that now things have evolved to the extent that we don’t need to train the models from scratch. We already have foundation models available that know our world up to some level, reducing the burden of training the model with tonnes of data. However, models today have become so large that they sometimes don’t fit in a single machine.

As connecting your database with these models is very important, we also discussed the trade-offs between the open-source and private libraries. Should companies manage data on their own or outsource it? When you are not training your model, the easiest and fastest way is to use API, and if you want your data on-prem, then it will mostly cost you more. In the end, it boils down to what core to you is, and often, not all part of the infrastructure is core to companies. So, if your data is not your core strength, then better outsource it.

This episode also uncovered the current tools and infrastructure available for GenAI. The current tools and infrastructure available for large-level deployments are going through a rapid evolution; they are not very hard to rebuild or replace, and new companies are emerging in the tooling and infrastructure for GenAI space.

Now what’s going away in some sense is perhaps the lead you might have where your beta model was ready two years ago and you were doing something interesting. Now you know what? Unless that model had some proprietary data and you can continue to leverage that, that’s gone.

– Rajat Monga

When looking at the talent and skills needed for GenAI implementation in your organization, it is important to have technically sound people with domain expertise in the organization’s particular area.

For the differentiation in the market domain knowledge in your area, relationship with the customers, distribution channel, your execution, etc., today plays an even bigger role. However, in this data-driven world, having proprietary data and knowing how to leverage it can be an added advantage. To find out more, tune in to the full podcast.

Production Team
Arvind Ravishunkar, Ankit Pandey, Chandan Jha

This podcast offers valuable insights about the limitations of current AI reasoning, including common sense reasoning, and debunks the hype around AGI, which viewers can apply in their field.

In this podcast, Arvind interviews Dr. Srinivas Padmanabhuni, who has a PhD in common sense reasoning from the University of Alberta and is a founder of an AI startup testAIng.com.

Dr. Srinivas explains that the concept of the old Aristotelian logic is just not enough to capture human-level reasoning. The traditional logic that is taught in schools is based on zero one, which is just one part of our reasoning. Human beings reason a lot more than that, and the way AI reasons today is a very narrow, myopic way of reasoning.

Dr. Srinivas then shares his thoughts on AGI (Artificial General Intelligence). He thinks that it is too premature to talk about AGI, and it’s only marketing. He says that AI is not able to invent anything new unless it is actually coming from somewhere, some large corpus existing somewhere. He says that unless you really have a common sense level agent, which can think about reasoning, you cannot just think about AGI.

The podcast also discusses the limitations of AI and what we can expect from it in the future. Dr. Srinivas explains that AI is not capable of inventing anything new, but is only capable of processing information and making predictions based on existing data. He suggests that AI is best used for tasks that involve large amounts of data processing, such as financial analysis, medical diagnosis, and weather forecasting.

Dr. Srinivas also talks about the importance of common sense reasoning and how it is an essential part of human-level reasoning, which is missing in AI today. He explains that common sense reasoning is necessary for tasks such as understanding jokes, sarcasm, and metaphors.

Towards the end of the podcast, Arvind and Dr. Srinivas discuss the future of AI and its potential applications. They suggest that AI has the potential to revolutionize industries such as healthcare, retail, and transportation. However, they also caution that the development of AI should be done in an ethical and responsible manner, with consideration for the potential risks and consequences.

Overall, the podcast is very informative for anyone who wants to learn about the field of AI. It gives a good understanding of the limitations of AI and what we can expect from it in the future. The podcast also highlights the importance of common sense reasoning and how it is an essential part of human-level reasoning, which is missing in AI today. Lastly, the podcast emphasizes the need for ethical and responsible development of AI, with consideration for the potential risks and consequences.

Production Team
Arvind Ravishunkar, Ankit Pandey, Chandan Jha

Explore the vital link between AI and sustainability as we discuss strategies for eco-conscious AI deployment with Dr. Eng Lim Goh, Senior vice president of Data & AI at Hewlett Packard Enterprise

In this episode of Unpacked, Arvind introduces Dr. Eng Lim Goh, SVP of Data and AI at Hewlett Packard Enterprises, to discuss the topic of sustainable AI. They agree on the importance of being conscious of the planet's well-being while charting business growth and profitability. 

Dr. Goh explains the need for corporations to consider sustainability due to their net-zero goals, the conscious younger generation of employees, and the economic implications of power consumption in supercomputing. He shares his experience of working on the International Space Station and how he realized the importance of a sustainable approach to technology. 

Similarly, he suggests that businesses should consider long-term goals while investing in AI and related technologies, adding that it is important to measure the impact of such efforts quantitatively. He also talks about the importance of collaboration between businesses, governments, and academia to achieve sustainable progress. The conversation then moves on to the topic of energy consumption in AI, and Dr. Goh explains how the power consumption of large models has been a challenge in the supercomputing industry. He suggests that businesses should consider using more efficient hardware and software to reduce energy consumption and how they can approach this. He also mentions the importance of using renewable energy sources to power data centers. 

The conversation concludes with Dr. Goh’s vision for the future of AI and sustainability. Dr. Goh emphasizes the need for businesses to consider the long-term impact of their actions and to invest in sustainable technologies. He believes that AI can play a crucial role in achieving sustainability goals and that it is important for businesses to collaborate and share knowledge to achieve sustainable progress. 

Overall, the conversation highlights the need for businesses to consider sustainability while investing in AI and related technologies. It emphasizes the importance of transparency, collaboration, and measurement in achieving sustainable progress.

Production Team
Arvind Ravishunkar, Ankit Pandey, Chandan Jha