Get ahead of the curve with the latest insights, trends, and analysis in the tech world.
Some rough guidelinesContinue reading on Towards Data Science »
Part 1: Leverage linear regression and decision trees to impute time-series gaps.Continue reading on Towards Data Science »
And it is not always simply ordering by highest to lowestContinue reading on Towards Data Science »
What can we say about the mean of data distributed in an interval [a, b]?Continue reading on Towards Data Science »
Structured generation is fundamental to building complex, multi-step reasoning agents in LLM evaluations—especially for open sourcemodelsSource: Generated with SDXL1.0Disclosure: I am a maintainer of Opik, one of the open source projects used later in thisarticle.For the past few months, I’ve been working on LLM-based evaluations (“LLM-as-a-Judge” metrics) for language models. The results have so far been extremely...
Take your machine learning skills to the healthcare sector with KDnuggets' free sponsored eBook "Ship Health AI Products Faster: Strategies to Deploy with Quality and Speed"
Keep your ML workflow organized! Pipelines are like a checklist you don’t have to keep track of—Scikit-Learn handles it all for you.
Popular MLOps Python tools that will make machine learning model deployment a piece of cake.
Lessons Learned After the AI Nobel DebateContinue reading on Towards Data Science »
A worked example using Python and the chat completion APIContinue reading on Towards Data Science »
Three Zero-Cost Solutions That Take Hours, NotMonthsA ‘data quality’ certified pipeline. Source: unsplash.comIn my career, data quality initiatives have usually meant big changes. From governance processes to costly tools to dbt implementation—data quality projects never seem to want to besmall.What’s more, fixing the data quality issues this way often leads to new problems. More complexity, higher costs, slower data...
Testing new Snowflake functionality with a 30k recordsdatasetImage created with DALL·E, based on author’spromptWorking with data, I keep running into the same problem more and more often. On one hand, we have growing requirements for data privacy and confidentiality; on the other—the need to make quick, data-driven decisions. Add to this the modern business reality: freelancers, consultants, short-term projects.As a...
MODEL EVALUATION & OPTIMIZATION7 basic classifiers reveal their prediction confidence mathClassification models don’t just tell you what they think the answer is—they also tell you how sure they are about that answer. This certainty is shown as a probability score. A high score means the model is very confident, while a low score means it’s uncertain about its prediction.Every classification model calculates these...
Here’s why and howContinue reading on Towards Data Science »
Why tailored, decentralized data quality trumps the medallion architectureContinue reading on Towards Data Science »
A deep dive into EnbPI, a Conformal Prediction approach for time series forecastingContinue reading on Towards Data Science »
Evaluation of language-specific LLM accuracy on the global Massive Multitask Language Understanding benchmark in PythonContinue reading on Towards Data Science »
The Science Behind Better GuessesContinue reading on Towards Data Science »
Learn these things to become a more well-rounded data scientistContinue reading on Towards Data Science »
Understanding key concepts such as Monte Carlo Methods, Bayes’ Theorem or Gradient Descent can be overwhelming for beginners…Continue reading on Towards Data Science »
Looking for DIY examples for acquiring a foundation for efficiently visualizing data in Python? Then this tutorial is for you.
Evaluating the current LLM landscape based both benchmarks and real-world insights to help you make informedchoices.Image generated by Flux.1 -SchnellThe landscape of Large Language Models (LLMs) for coding has never been more competitive. With major players like Alibaba, Anthropic, Google, Meta, Mistral, OpenAI, and xAI all offering their own models, developers have more options than everbefore.But how can you choose...
Are LLMs Better at Generating SQL, SPARQL, Cypher, or MongoDBQueries?Our NeurIPS’24 paper sheds light on this underinvestigated topic with a new and unique public dataset and benchmark.(Image byauthor)Many recent works have been focusing on how to generate SQL from a natural language question using an LLM. However, there is little understanding of how well LLMs can generate other database query languages in a direct...
Modern challenges in data science need modern data scientist solutions.
Imagine controlling your computer, running code, and fetching data, all by simply typing out natural language commands. Open Interpreter makes it possible!
OpinionWhat should be done when an AI accuses a student of misconduct by usingAI?Anti-cheating tools that detect material generated by AI systems are widely being used by educators to detect and punish cheating on both written and coding assignments. However, these AI detection systems don’t appear to work very well and they should not be used to punish students. Even the best system will have some non-zero false...
Finding customer segments for optimal retargetting using LLM embeddings and MLmodelIntroductionIn this article, we are talking about a method of finding the customer segments within a binary classification dataset which have the maximum potential to tip over into the wanted class. This method can be employed for different use-cases such as selective targetting of customers in the second round of a promotional campaign,...
This article provides a comprehensive step-by-step guide designed to help you navigate the challenge of optimizing your machine learning (ML) models for production, by looking at all stages in their development lifecycle, i.
Python code to create folders and Word documents for research papers in biomedical sciences—all in one go with only two inputsContinue reading on Towards Data Science »
How I used AI and Streamlit to create a festive and fun gift recommendation appContinue reading on Towards Data Science »
A discussion of the latest research suggesting that LLMs do work like the human brain—with some substantial differencesContinue reading on Towards Data Science »
30 Days, 30 Maps: My November Adventure in Digital CartographyContinue reading on Towards Data Science »
My top tips to smash your next data science behavioural interviewContinue reading on Towards Data Science »
Let’s see how many stars we’ll collect.Continue reading on Towards Data Science »
How to predict DAU using Duolingo’s growth model and control the prediction1. IntroductionDoubtlessly, DAU, WAU, and MAU—daily, weekly, and monthly active users—are critical business metrics. An article “How Duolingo reignited user growth” by Jorge Mazal, former CPO of Duolingo, is #1 in the Growth section of Lenny’s Newsletter blog. In this article, Jorge paid special attention to the methodology Duolingo used to...