Stay Updated with the Latest Tech News
Get ahead of the curve with the latest insights, trends, and analysis in the tech world.
Browse by Category
Journey to Full-Stack Data Scientist: Model Deployment
An introduction to productionizing machine learning models using APIs andDocker.Growing Responsibilities of Data ScientistsThe title of data scientist is ever-changing and often vague. It usually involves one who is fluent in mathematics, programming, and machine learning. They spend time cleaning data, building models, fine-tuning, and conducting experimentation. They must also have great communication skills, a good...
Published on: January 04, 2025 | Source:
Share on Facebook
Share in Tweet (rip twitter)
Share on LinkedIn
Share on Reddit
Share on Threads
Share on Bluesky
The Next Frontier in LLM Accuracy
Exploring the Power of Lamini MemoryTuningImage generated by DALL-E3Accuracy is often critical for LLM applications, especially in cases such as API calling or summarisation of financial reports. Fortunately, there are ways to enhance precision. The best practices to improve accuracy include the following steps:You can start simply with prompt engineering techniques—adding more detailed instructions, using few-shot...
Published on: January 04, 2025 | Source:How to Tell Among Two Regression Models with Statistical Significance
Diving into the F-test for nested models with algorithms, examples and codeContinue reading on Towards Data Science »
Published on: January 03, 2025 | Source:The Cultural Impact of AI Generated Content: Part 2
What can we do about the increasingly sophisticated AI generated content in ourlives?Photo by Meszárcsek Gergely onUnsplashIn my prior column, I established how AI generated content is expanding online, and described scenarios to illustrate why it’s occurring. (Please read that before you go on here!) Let’s move on now to talking about what the impact is, and what possibilities the future mighthold.Social and Creative...
Published on: January 03, 2025 | Source:Chi-Squared Test: Comparing Variations Through Soccer
Understanding Different Types of Chi-Squared Tests: A/B Testing for Data Science Series (8)Continue reading on Towards Data Science »
Published on: January 03, 2025 | Source:Non-Technical Principles All Data Scientists Should Have
Making you a better data scientist, and enhancing your career.Continue reading on Towards Data Science »
Published on: January 03, 2025 | Source:What I’m Updating in My AI Ethics Class for 2025
What happened in 2024 that is new and significant in the world of AI ethics? The new technology developments have come in fast, but what has ethical or values implications that are going to matter long-term?I’ve been working on updates for my 2025 class on Values and Ethics in Artificial Intelligence. This course is part of the Johns Hopkins Education for Professionals program, part of the Master’s degree in Artificial...
Published on: January 03, 2025 | Source:10 GitHub Repositories to Master Math
Learn math through roadmaps, courses, tutorials, Python frameworks for solving equations, guides, exercises, textbooks, and more.
Published on: January 03, 2025 | Source:Predictive Maintenance Models with a Focus on Class Balancing — Complete Notebook
From Model Creation to Deployment: Building a Predictive Maintenance System with StreamlitContinue reading on Towards Data Science »
Published on: January 03, 2025 | Source:Getting Started with Building RAG Systems Using Haystack
Retrieval augmented generation (RAG) is altering the way we use large language models, but building these systems can be hectic. In this article, you will learn how to build RAG systems using Haystack.
Published on: January 03, 2025 | Source:Learning ML or Learning About Learning ML?
Pragmatism versus (over-)planningContinue reading on Towards Data Science »
Published on: January 03, 2025 | Source:Deep Learning for Outlier Detection on Tabular and Image Data
The challenges and promises of deep learning for outlier detection, including self-supervised learning techniquesIn the last several years, deep-learning approaches have proven to be extremely effective for many machine learning problems, and, not surprisingly, this has included several areas of outlier detection. In fact, for many modalities of data, including image, video, and audio, there’s really no viable option...
Published on: January 03, 2025 | Source:Integrating Feature Selection into the Model Estimation
Combining mixture of normal regressions with in-built feature selection into powerful modelingtoolFeature selection is usually defined as the process of identifying the most relevant variables in a dataset to improve model performance and reduce complexity of thesystem.However, it often has limitations. The variables can be interdependent. When we remove one variable, we might weaken the predictive power of those that...
Published on: January 03, 2025 | Source:Harnessing Polars and Geopandas to Generate Millions of Transects in Seconds
Making the bears playniceManhattan with transects spaced every 100ft. If you can transect here you can transect anywhere!The Problem:I needed to generate a transect every 10 feet across every street in New York City, and I had to do it in a New York Minute. The Generate Transects Along Lines tool built into ArcGIS Pro was going to take multiple days to run, so I had to come up with something at least slightlyfaster.To...
Published on: January 03, 2025 | Source:Demand Forecasting with Darts: A Tutorial
A hands-on tutorial with Python and Darts for demand forecasting, showcasing the power of TiDE andTFTPhoto by Victoriano Izquierdo onUnsplashDemand forecasting for retailing companies can become a complex task, as several factors need to be considered from the start of the project to the final deployment. This article provides an overview of the main steps required to train and deploy a demand forecasting model,...
Published on: January 02, 2025 | Source:The Fallacy of Complacent Distroless Containers
Making containers smaller is the most popular practice when reducing your attack surface. But how real is this sense of security?Continue reading on Towards Data Science »
Published on: January 02, 2025 | Source:Mastering Sensor Fusion: Color Image Obstacle Detection with KITTI Data — Part 2
Mastering Sensor Fusion: Color Image Obstacle Detection with KITTI Data—Part2How to use color image data for object detection in the context of obstacle detectionThe concept of sensor fusion is a decision-making mechanism that can be applied to different problems and using different modalities. We mentioned in the previous post that in this Medium blog series, we will analyze the concept of sensor fusion for obstacle...
Published on: January 02, 2025 | Source:Sensor Fusion — KITTI — ‘Lidar-based Obstacle Detection’ — Part-1
Mastering Sensor Fusion: LiDAR Obstacle Detection with KITTI Data—Part1How to use Lidar data for obstacle detection with unsupervised learningSensor fusion, multi-modal perception, autonomous vehicles—if these keywords pique your interest, this Medium blog is for you. Join me as I explore the fascinating world of LiDAR and color image-based environment understanding, showcasing how these technologies are combined to...
Published on: January 02, 2025 | Source:How to Stand Out in The Data Science Job Market
How to have the edge in your data science applicationContinue reading on Towards Data Science »
Published on: January 02, 2025 | Source:Data Engineering — ORM and ODM with Python
Manipulate database data leveraging an object-oriented programming paradigmContinue reading on Towards Data Science »
Published on: January 02, 2025 | Source:Develop a Stand-out Data Science Portfolio with GitHub
Improve your chances of getting noticed with these tips.
Published on: January 02, 2025 | Source:Start a New Year of Learning on the Right Foot
Feeling inspired to write your first TDS post? We’re always open to contributions from newauthors.Happy new year! Welcome back to the Variable!The ink has barely dried on our 2024 highlights roundup (it’s never too late to browse it, of course), and here we are, ready to dive headfirst into a fresh year of learning, growth, and exploration.We have a cherished tradition of devoting the first edition of the year to our...
Published on: January 02, 2025 | Source:How I Built a Real-Time Weather Data Pipeline Using AWS—Entirely Serverless
A practical guide to leveraging AWS Lambda, Kinesis, and DynamoDB for real-time insightsContinue reading on Towards Data Science »
Published on: January 02, 2025 | Source:10 Pandas One-Liners for Quick Data Quality Checks
Want to run some quick data quality checks? Here are 10 pandas one-liners that'll come in handy.
Published on: January 02, 2025 | Source:How to Process 10k Images in Seconds
Efficient image operations with multiprocessing in PythonContinue reading on Towards Data Science »
Published on: January 02, 2025 | Source:5 Simple Projects to Start Today: A Learning Roadmap for Data Engineering
Start with 5 practical projects to lay the foundation for your data engineering roadmap.Continue reading on Towards Data Science »
Published on: January 02, 2025 | Source:LLM Evaluation Metrics Made Easy
Metrics are a cornerstone element in evaluating any AI system, and in the case of large language models (LLMs), this is no exception.
Published on: January 02, 2025 | Source:7 Machine Learning Trends to Watch in 2025
Machine learning is now the cornerstone of recent technological progress, which is especially true for the current generative AI stampede.
Published on: January 01, 2025 | Source:AI-Powered Information Extraction and Matchmaking
Developing an application for extracting key profile information from CVs and recommending jobs aligned with the profileContinue reading on Towards Data Science »
Published on: January 01, 2025 | Source:Scaling Statistics: Incremental Standard Deviation in SQL with dbt
Why scan yesterday’s data when you can increment today’s?Image by theauthorSQL aggregation functions can be computationally expensive when applied to large datasets. As datasets grow, recalculating metrics over the entire dataset repeatedly becomes inefficient. To address this challenge, incremental aggregation is often employed—a method that involves maintaining a previous state and updating it with new incoming data....
Published on: January 01, 2025 | Source:GDD: Generative Driven Design
Reflective generative AI software components as a development paradigmNowhere has the proliferation of generative AI tooling been more aggressive than in the world of software development. It began with GitHub Copilot’s supercharged autocomplete, then exploded into direct code-along integrated tools like Aider and Cursor that allow software engineers to dictate instructions and have the generated changes applied live,...
Published on: January 01, 2025 | Source:Transforming Data into Solutions: Building a Smart App with Python and AI
Some financial analysts worry that artificial intelligence may not justify the massive investments being made in the field. While I understand their concerns, I see things differently. I’m neither an AI Boomer nor an AI Doomer—I believe AI has the potential to drive innovation, enhance productivity, and deliver measurable business outcomes.In my last article, I explored how Large Language Models (LLMs) can be used to...
Published on: January 01, 2025 | Source:Multi-Agentic RAG with Hugging Face Code Agents
Using Qwen2.5–7B-Instruct powered code agents to create a local, open source, multi-agentic RAGsystemPhoto by Jaredd Craig onUnsplashLarge Language Models have shown impressive capabilities and they are still undergoing steady improvements with each new generation of models released. Applications such as chatbots and summarisation can directly exploit the language proficiency of LLMs as they are only required to...
Published on: December 31, 2024 | Source:Stop the Count! Why Putting A Time Limit on Metrics is Critical for Fast and Accurate Experiments
Why your experiments might never reach significancePhoto by Andrik Langfield onUnsplashIntroductionExperiments usually compare the frequency of an event (or some other sum metric) after either exposure (treatment) or non-exposure (control) to some intervention. For example: we might compare the number of purchases, minutes spent watching content, or number of clicks on a call-to-action.While this setup may seem plain,...
Published on: December 31, 2024 | Source:Partial Dependence Plots: How to Discover Variables Influencing a Model
Have you ever wondered how machine learning models are constructed? ‘Explainability of machine learning models’ and ‘machine learning…Continue reading on Towards Data Science »
Published on: December 31, 2024 | Source: