Assume that everyone is dressed casually at a party, except for one person who is wearing a superhero outfit. You notice that person right away since they do not fit in the crowd. This superhuman visitor is referred to as an outlier in data analysis. They could be...
As AI agents become increasingly prevalent in software applications, it's essential to ensure they're performing optimally. But how do you measure their success? The answer lies in evaluations (evals). In this post, we'll explore the importance of evals for...
Ever since OpenAI introduced ChatGPT UI in November 2022, the way we interact, process and consume information has changed drastically. It was science fiction to have a long and meaningful conversation with a machine until this point. ChatGPT, which is based...
In 2015, one of the largest e-commerce companies built an automated hiring tool to review and filter resumes based on skill sets and job descriptions. However, this project had to be halted after it was noticed that the hiring tool showed significant...
In our previous post, we introduced Linear Regression, a fundamental technique used to predict outcomes based on a single factor—such as estimating house prices based on square footage. We also discussed essential performance metrics like Mean Squared Error (MSE) and...
In today's data intensive world, data scientists play a crucial role. Their main job is to make sense of large amounts of data, turning it into useful information that can guide decisions. This involves both creative and technical skills, using a range of methods and...
Large Language Models (LLMs) are revolutionizing the AI domain at an incredible pace. The diffusion of such powerful models is happening across various domains, from education to entertainment to healthcare. Although the flexibility of this technology is laudable, the...
In a world where data availability is becoming increasingly abundant, how can we leverage multiple data sources to answer questions of scientific interest? This matter is a perfect spot to use the entity resolution. What is entity resolution? Why does it...
ChatGPT was introduced in November 2022, sparking a revolution of generative AI adoption. Before its publication, only academia-related people, researchers, and experts in the field knew about GenAI and the myriad possibilities it brings. By August 2023, McKinsey...
The main difference between data science and business analytics is their focus and application. Data science involves the extraction, analysis, and interpretation of large datasets to gain insights and make data-driven decisions. Recent studies show an...