Join us in this episode featuring Ankur Taly, Staff Research Scientist, Google, as we explore the concept of grounding of LLMs!

Machines are supposed to work without mistakes, just like a calculator does math correctly. But in the world of artificial intelligence, errors, often called ‘AI hallucinations,’ are common. This makes us wonder about these mistakes and the computer programs behind them. For businesses that use AI in their work, especially when dealing with customers, making sure AI works without errors is very important.

Grounding requirement is that not only that you should not have any made up stuff, but everything that you output should be grounded in some knowledge source and the knowledge source is something that I control.

– Ankur Taly

Understanding how AI makes decisions and being clear about its processes is very important. Business leaders need to be able to watch and explain how AI makes decisions. This will be crucial for using AI in their companies in the future.

To fight AI hallucinations, grounding is important. Grounding means making sure AI answers are based on real facts. This involves teaching AI systems using correct and reliable information and making them give answers that can be proven. Grounding stops AI from making things up or giving wrong information.
When businesses use LLMs (large language models) in their work, they should think about some important things. First, they need to use good data to teach AI because bad data can lead to wrong or unfair results. It’s also important to have rules about how AI is used in the company to avoid causing harm or misusing AI information.

While you can use this in a very creative way, this next word prediction is also ultimately to be blamed for hallucinations because what it’s doing is basically it looks at what it recently said and then tries to predict what will likely come right after.

– Ankur Taly

Businesses also need to keep an eye on AI’s results to fix mistakes or wrong information. Having people check and filter AI’s work ensures that it’s correct and consistent. It’s also important to teach employees and users about what AI can and can’t do to avoid misunderstandings or misuse.

Even though AI hallucinations can be a problem, they can also have some positives. They can make people think creatively and find new solutions to tough problems. AI’s imaginative ideas can be fun, offering new types of art and media. Plus, AI hallucinations can help with learning by making people think and talk about interesting topics.

Production Team
Arvind Ravishunkar, Ankit Pandey, Chandan Jha

Join us in this episode featuring Anupam Datta, Co-founder and Chief Scientist, TruEra, as we dive into the evolution of LLMs and what they hold for the future!

This world of generative AI has caught us by storm. And as enterprise leaders in your companies, understanding the technology behind generative AI will give you a competitive advantage as you plan your companies and businesses. And to help you do this, we will unpack a technology, large language models (LLMs), that powers AI today and represent a paradigm shift in this field of Artificial Intelligence.

LLMs can craft meaningful responses across many domains. Their performance has notably improved recently thanks to the substantial increase in model size and data volume.

With the increasing acceptance of this technology, numerous companies are unveiling various Large Language Models (LLMs). It's important to recognize that opting for the largest or highest-performing LLM isn't always the most suitable approach. Instead, one might prefer LLMs that excel in specific tasks relevant to their application. As a leader in the enterprise, it's crucial to integrate this understanding into your company's strategy, aiding in identifying the appropriate LLMs to match and adapt for your applications. Achieving equilibrium between LLM selection, cost considerations, and latency considerations stands as a pivotal concern for enterprises. Equally essential is the thorough validation and assessment of generative outputs, serving as a safeguard prior to embarking on consequential choices. Hence, the undertaking of reliability testing at this current juncture is paramount.

Furthermore, enterprises need to consider a few other key aspects in this evolving landscape of LLMs as they build out LLMs. Starting with a well-defined business use case that offers real value is crucial. As LLMs move from development to production, it's important to establish thorough evaluations and observability throughout their lifecycle. Education across the organization is vital to implement LLMs effectively. Companies should train their workforce to adapt to this changing technology stack. Fostering a community around responsible AI development and evaluation can contribute to a better understanding and management of LLMs. With these steps, enterprises can navigate the complexities of LLMs and harness their potential for positive impact.

Production Team
Arvind Ravishunkar, Ankit Pandey, Chandan Jha

"AI Transformation – the new paradigm" with UC Berkeley Professor and AI Startup Expert, Greg La Blanc. Get ready to dive into the future of AI!

For some people, transformation is exciting and challenging. Curiosity and excitement about learning, drew Greg to into the field of strategy and transformation and all the other topics that he has been teaching throughout his career. 

Every time you learn something, you are displacing or changing some previous notion of how the world works. For some people, this is disturbing. But for others, it is a thrill and really exciting. It's how you approach the transformation is the beginning of how you deal with transformation, and curiosity is such a powerful, such a powerful human trait.

Some people would emphasize what they call long-term trends. And then others would be more inclined to say everything's new. Similarly, with the digital and AI transformations taking place, you can say, everything's new, everything has to be changed. This is something that we've never seen before, or you can say this is not that much different from the sorts of things that we have seen and happened to us in the past. 

As humans, we are in the entropy reduction business. We are trying to create order. We're trying to make sense of our world. We're trying to put in place practices that we can automate. We're trying to create routines and subroutines, and indeed, this is how efficiency happens. Efficiency happens when you realize, you start to recognize patterns, and you start to engage in repetitive action. 

The problem with that is that the circumstances and the environment changes. And so, the routines that you've established, they need to be changed at some point. And that requires a bit of work. So, sometimes, there's a couple different ways we can respond to that. One is to say, okay, the world's changed, so we got to change the way we're doing things. The other is to say, well, let's try to change the world so that we don't have to change. And that often means trying to shape the behavior of your customers or your employees or try to use regulation or market power to hold off the onslaught of change.

The third way is to say, let's change. 

Too much flexibility means that nothing ever gels, too little flexibility means that, you get stuck. And so, it is needed to figure out what that optimal amount of flexibility is, and then figuring out a way to routinize change. That sounds paradoxical. It means creating systems, which are designed right intentionally to respond to the, the changing environment. If you can routinize change, you can routinize curiosity. If you can create a standard operating procedure for discovery, then in some ways you can have your cake and eat it too. And that’s what all really good dynamic businesses are, are trying to do.

Every time there's a new discovery in the world of artificial intelligence, people say, now's the time. This is AI, it's this. Back in 2015 with neural nets, everyone's like, yes, AI finally. The possibilities of AI and each one of these sorts of punctuated discoveries are a continuation of series of discoveries that have been happening right in the world of artificial intelligence for the last couple of decades.

The technology diffuses rapidly. What doesn't diffuse as rapidly are managerial techniques, organizational, architectural innovations. And that's also the reason why older companies have a tough time adapting. They resist change and the kinds of transformations that they would need to undertake in order to enable new technologies.

There is the immune system of the organization, but the immune system of all of the individuals within the organization Natural propensity for many people is to fight new ideas when they encounter them as individuals. And then if you take that and you combine it into a big organization, you can often have an organization where every individual's open to new ideas, but the organization is not because it has its own logic.

Fear plays a role, but it's not the complete story. It's not always that they're afraid. They feel fairly confident that they can keep this at bay. And this is why leadership is so critical. You need carrots and sticks, but you also need your, your, your vision and, and your messaging.

Even before generative ai, more primitive forms of machine learning and the ones that have been the easiest to adopt are the ones that perform some relatively narrow tasks. Suppose you are in HR and you're doing hiring, and someone comes up with a product that helps you to process more applications more quickly. You can see how that is going to save you money. You can see if you are in marketing and someone comes along and says, I got this great tool that'll help you to figure out who you should be targeting with your marketing. You will think, I am a revenue center, I've just boosted my revenue. So, all of those specific applications are actually relatively unproblematic. 

Just setting aside AI for a second, if we look at the automotive industry. Look at a company like Ford or GM that has tier one suppliers, tier two suppliers, tier three suppliers, and son on. If there is an innovation in the steering column, the tier one supplier makes steering, they'll figure it out and they'll start selling it. But the challenge is when you want to figure out a way to connect those things.

The current supply chain architecture makes it very difficult, because you need to adjust the design elements of the brake to coordinate better with the design elements of the, the steering column. And when you have everything set up in this, then it becomes tough. Whereas with Tesla, which has an integrated, much more integrated production process and design process, it is super easy. To make those kinds of shifts. So, the reason the car companies are struggling is because they've tried to incorporate a lot of these new technological innovations into the pre-existing business architecture, supply chain, and value chain architecture, which was optimized for the internal combustion engine. Which is why someone like Tesla can just leapfrog.

Your competitive advantage is always going to come from the data. It is never going to come from your analytics tools. 

If I have access to unique data, then I can take cutting edge algorithms and train them on that data it can give competitive edge.

There will be companies that can they live without a solid data strategy, but for the vast majority of companies, if you do not have a data strategy, you're toast.

There are two major takeaways. The first one is in this transformation; your organizational structure is super important. How you organize your company so that data is democratised. And then the second one is having high quality unique data. Not just the quality of data, it is the uniqueness of the data is what's going to differentiate you going forward, at least in the next couple of years.

How do you make a balance between flexibility and order is also going to be an important skill for all leaders. All our education systems have to teach flexibility, adaptability, how to learn and how to learn fast.

With artificial intelligence in all of our jobs, we have to develop higher order thinking skills.

Production Team
Arvind Ravishunkar, Ankit Pandey, Chandan Jha