Snowflake announced on June 2022 that they are offering Python support with Snowpark! 🎉 What does that mean, you ask? Well, that means that now we can do all sorts of things with Python on Snowflake ecosystem, even some machine learning 🦾. "How?!?!", you ask? Short answer is: UDFs and stored procedures. Long answer is, as you could've guessed, a bit longer. What is Snowflake? If you're new to Snowf▋

Face masks are crucial in minimizing the propagation of Covid-19, and are highly recommended or even obligatory in many situations. In this project, we develop a pipeline to detect unmasked faces in images. This can, for example, be used to alert people that do not wear a mask when entering a building. We recorded a YouTube video to explain the general pipeline of this project. Our pipeline consists of three steps: 1. We detect all human faces in an image 2. W▋

With the Energy crisis, it is even more blatant that we need to work on reducing our carbon footprint and better use the planet's resources. Earlier this year, I wrote an article about the impact that AI has on energy and how much smart implementation of algorithms we need. I discussed the race of big models and the negative impact they can have on energy consumption and thus carbon emissions. I also listed a couple of solutions from the software and hardware perspective that are active area o▋

Joining the bandwagon Recently, text-to-image models have been sprouting all around the internet. It started with the release of DALL-E 2, a model created by OpenAI. > DALL·E 2 is a new AI system that can create realistic images and art from a description in natural language Many other similar models were released quickly after DALL-E. It went so fast that I'm not even sure which models were released when. The most famous ones are probably DALL-E, obviously, Midjourney, a model developed by Mid▋

A brief tutorial for using Great Expectations , a python tool providing batteries-included data validation. It includes tooling for testing, profiling and documenting your data and integrates with many backends such as pandas dataframes, Apache Spark, SQL databases, data warehousing solutions such as Snowflake, and cloud storage offerings (S3, Azure Blob Storage, GCS). This tutorial covers the main concepts you'll need to know to use Great Expectations, gently walk▋

It’s March 2020 and suddenly we’re all forced to spend time at home and because restaurants and bars are closed, all together we rediscover our kitchen and our passion for banana bread. We’re forced to learn how to cook and are eager to make healthy lifestyle changes by cooking healthy and exercising more. Fast forward to February 2022 and our passion for banana bread is being threatened by a war causing a sudden increase in the price of flour. What do we have to do now? Are there other alterna▋

Is AI for you? You don't really know how to start?  then Tremplin IA is spot on You probably have heard already a lot about AI and how it gives a competitive advantage to many companies. Yet, you don't really know where to start and how to test whether AI can bring value to your company. Tremplin IA is a program held by Digital Wallonia to help companies start a Proof of Concept (POC) in AI. Dataroots as a member of the AI experts of▋

Last September, we started to regularly write blog posts. Everyone within Dataroots has been participating to this endeavour. People write about their job, about a conference, a new technology or simply they write about their passion. Thus since September, we have been publishing one post a week, without failing, sometimes even 2 posts per week! Creating the content is probably the hardest, you need to find an interesting topic, have a creative angle, a pinch of opinion and mash this into a st▋

Welcome back! If you remember from last time I told you we would continue with matrix factorisations, more specifically dive into some dimensionality reduction techniques! Hope you're ready! This blogpost will give you a comparison of two specific factorisation techniques that are foundational to the idea of dimensionality reduction: principal component analysis and factor analysis. Some of the techniques a▋

Networks are everywhere around us. Just by reading this blog post, you traveled across the internet following links to land on different web pages. Your social life is defined by relationships with other people that consecutively are connected to some other people. Nowadays, these friendships are also defined online by social media platforms such as Facebook, Twitter, Linkedin etc. Protein interactions, gene interactions, supply chain optimisation, payments and transactions, even the spread of a▋

AI, sentience and Google LaMDA If you've followed the tech-related news recently, you probably heard about Google's latest conversational bot, called LaMDA (Language Model for Dialogue Applications). After a lengthy conversation with the bot, a Google engineer became convinced that the bot they designed was sentient, or conscious in more common language. His claim and the public release of the conversation sparked heated debate among AI experts and enthusiasts. This is the perfect opportunity ▋

Just a short FYI :) As of now we will be listing all our upcoming events over at dataroots.io/events . We already have a calendar leading up to end of next year and we will be publishing these events soon at our events page. Keep posted 🙌▋

The majority of machine learning algorithms are data hungry, the more the data we feed our models, the better they learn about the world’s dynamics. Luckily for us, data is everywhere in today’s world, dispersed over the different locations where they were collected. Examples of this is the user data that is collected on a daily basis by our cell phones, medical equipment and practitioners in medical facilities, etc. Conventionally, if we wanted to train a learning model, we would collect the d▋

You have heard about reinforcement learning for next best action optimization but don't really know why you would use it over other techniques or how to use it best? In this article, we try to demystify and explain how we used offline reinforcement learning to have a good baseline model for optimizing marketing campaigns. A quick recap As mentioned in the initial post of this series▋

Deploying your Machine Learning model is often the cherry on the cake for a Machine Learning Engineer. After putting a lot of effort in building your model, it is immensely satisfying to be able to send it off on an adventure of its own, hoping it conquers the world. However, the size of the world is vast, so we better equip our model with a quick and able ride. The question of whether to build our own horse in the cloud or borrow someone else’s horse for the trip? I recently faced this q▋

It should go without saying that data is a critical asset for any organization. As a result, it is important that the platform handling all this data is able to do so with scalability and speed in mind. Enter... 🥁🥁🥁 Snowflake! Snowflake is a cloud platform for data x, where x = . So everything that is data-related basically. Terraform , on the other hand, is an infrastru▋

The cloud is just someone else's computer and to manage that we prefer to use Infrastructure as Code (IaC). dataroots believes that IaC can benefit any team working with cloud resources and most often Terraform is our tool of choice there. As a data & cloud engineer focusing on Microsoft Azure, that is true for me as well. However, there have been a couple of hick-ups along the road. We have to talk about the pro▋

Can 4 Dataroots colleagues without professional music production experience write hit songs with AI? In this blogpost series the Beatroots team members uncover how they wrote their latest song, Song of the Machines, which they submitted for the 2022 AI Song Contest. AI Song Contest The AI Song Contest is an international music competition exploring the use of AI in the songwriting process. We have participated with Beatroots since its inception in 2020. The pre▋

-------------------------------------------------------------------------------- In our previous post, we explained our project of weather nowcasting in a general way. Now, we will deep dive into one of the most important steps in machine learning, which is model optimization. The need for optimizing model size and speed arises whenever the prediction model is required to run on an edge device, namely, smartphones, surveillance cameras, robots, etc.  Therefore, the challenge is maintaining a s▋

What: Get to know our dataroots team! Where: Tiensevest 132, Leuven Who: Everyone with a passion for data & AI About this event 🤖You have a passion for data and AI? You also like a good burger as a study break or after finishing your exams? 🎯 We have the perfect event for you! 🍔 On Tuesday June 28th we’ll be organising a walking dinner at dataroots! 👍 The aim of this dinner is to give you an idea of what we do at dataroots and to meet some of our team members. ❗️Spots are limited, so ▋

Industry 4.0 marks the fourth industrial revolution. What does that mean for us? Are we part of it, i.e. is the industry ready for big data and A.I.? Time to find out! Dataroots was invited to Heurisko 2022, the annual seminar hosted by Flanders Make, where the most innovative and industry-ready research results and applications are presented. Industry Zero to Industry Hero There have been multiple industrial revolutions in the last 200 years. The first industrial revolution happened around the▋

Do you want to restyle or redesign your interior, but don't want to leave the comfort of your own home? Don't fancy reading through hundreds of interior design albums or going to your local furniture store to try imagining those couches in your own living room? Have you always dreamed of a couch with an extravagant tiger print, but you don't know if it will fit your interior? Well I got a thing for you! During my internship at dataroots, I have built an AI-driven application, SofaStyler, which ▋

Last week was a busy week for fans of the Microsoft technology stack like myself. Microsoft hosted its yearly developer conference, Microsoft Build, announcing lots of exciting updates to new and existing Azure services. In the meantime, the Belgian community of Microsoft technology users gathered in Kinepolis Antwerp for this year's edition of Techorama. First off, let me start by thanking the incredible crew and partners ▋

The research department at Dataroots hosts twice a year its RootsAcademy, an initiation program that prepares its students for their career as consultants in data and AI. After the academy, the consultants take on their first internal project at Dataroots, with the aim of putting the concepts learned through the academy into practice. This March, we have been doing a proof of concept to automate the deployment of a weather nowcasting model on a Nvidia Jetson nano. Weather nowcasting is all abou▋

Since 2020, dataroots participate in the AI Song Contest. Since the contest is around the corner and the team is working hard, we thought to tease with our previous participations! For the 2021 submission, Beatroots upped their game and studied the Jukebox model released by OpenAI. This model opened many opportunities to sample musical audio waves and complete musical ideas in the style of many genres and artists. Beatroots fine-tun▋

for companies with different operating models If you prefer the video version (with slides); it is available here . Organizations have a business strategy in place to define how they can achieve and maintain a sustainable competitive advantage. However, most organizations don’t yet have a strategy in place on how to extract the right value from data. According to a survey ▋

Intro AI has changed our world, intelligent systems are part of our everyday life, and they are disrupting industries in all sectors. Among all the AI disciplines, Deep Learning is the hottest right now. Machine Learning practitioners successfully implemented Deep Neural Networks (DNNs) to solve challenging problems in many scientific fields. Nowadays, cars can see how busy a crossroad is, it’s possible to have pleasant conversations with imaginary ▋

At dataroots, we like to present our service portfolio by means of a burger. Like a burger, the ‘pièce de résistance ‘ is the Artificial Intelligence value-chain, with data pipelines transporting & providing quality data from source to model, simple or complex models mashing the data into insights and finally integration of those insights into the day to day business processes to put these hard earned insights to work. Also like a burger, the way to facilitate the efficient consumption of the ▋

Since 2020, dataroots participate in the AI Song Contest. Since the contest is coming soon and the team is working hard, we thought to tease with our previous participations! 6 dataroots colleagues group together with only one mission: generating fully automated songs by clicking a button! The final algorithm generates songs by traversing the shortest distance in MIDI harmonies sampled by Variational Autoencod▋

Causal inference is used to determine whether an action on a selected population is efficient and by how much. It is extremely useful to evaluate the average treatment effect of a campaign. For this, you need to compare the outcome difference on a treatment and on a control group. In this post, we explain techniques that can be used to evaluate an action even when a proper control group does not exist. We will explain how causality can still be inferred and tested and how much we can deduct fr▋

This blogpost will give you a gentle (re)introduction to the idea of matrix factorization, an enormously useful technique in statistics and machine learning. Matrix Factorization Matrix factorization is a technique to decompose or factorize a matrix into a product of more fundamental matrices. If that sounds a bit confusing, it's analogous to factorizing a number: 48=4×12 or 48=6×8. Of course, a matrix is more complex than a number, so many kinds of factorization are possible. Perhaps the easi▋

Machine learning engineers are at the intersection of programming (computer science), math/statistics/machine learning and domain knowledge/communication. Although a lot of progress has been made in the first two, their advances are constrained by the ability to convey their results to the business owners of a problem. Graphical representation can be of enormous help to bring over complex results. In this blogpost, we discuss latest trend in visualisation of statistical results. State-of-the -ar▋

Campaigns you said? Great but which one? Multiple ways exist to nudge customers: for instance calling, sending out emails, offering discounts, etc. The channels are various and the content of the marketing messages are even more diverse. In this article we explain how to optimize a marketing campaign and what to do when you did not implement the ideal strategy but have data that can help you derive important insights. From churn prediction to business value Not so long ago, in a previous post▋

Over the weekend I had the pleasure of talking to Gertrude Poirot Torricelli III, long for GPT-3. Her insightful advise and hopeful views on the future of society and the world at large inspired me to share her musings with the rest of you. She was very open to this idea and I will be sharing her advise in quote form daily during the week of April 11th, 2022. All quotes will be collected down here. 👇 Monday Tuesday Wednesday Thursday Friday That wraps up this non-existent quotes series! ✅ �▋

As a growing data consultancy boutique, we get more and more questions to review and architect data platforms. While growing, we are also maturing the architecture practice at Dataroots. What is Architecture? We can obviously not discuss architecture without some reflection on the term itself in the context of ICT solutions in general, and data platforms specifically. A topic which immediately proves to be not that easy to grasp. When brainstorming the subject, we easily talked about the respon▋

You hear more and more that technology in general is not so eco friendly. What about AI? Is it also not so eco-friendly? What is the impact of developing AI models and how good is AI for the planet? With this article, we try to demystify and understand the impact of AI on the planet and how this could be reduced. What are the resources needed to build an AI? To build AI models, requires a lot of resources, especially if you are building models like Bert, GPT, or in general, deep neural net▋

You love Matplotlib cause it's easy to use and you can generate plots quickly? It's now possible to do these Matplotlib exact same plots with dataroots theme with Rootsstyle ! Rootsstyle works with any visualization tools that builds upon Matplotlib (seaborn, pandas). Check it out !▋

If you ever took a look into Natural Language Processing (NLP) for the past years, you probably heard of transformers. But what are these things? How did they come to be? Why is it so good? How to use them? A good place to start answering these questions is to look back at what was there before transformers, when we started using neural networks for NLP tasks. Early days One of the first uses of neural networks for NLP came with Recurrent Neural Networks (RNNs). The idea there is to mimic huma▋

When you start integrating data into your marketing strategy, the first questions that needs to be answered are often: who’s going to churn in the next couple months? To whom should we best sell what product? Does that person need this product? To answer these types of questions one can build a model based on historical data. We look for customers that demonstrated the desired behavior in the past (churn, buying a product, etc) and how they looked like (characteristics and behavior). The assump▋

Want to discover if a career in AI is something for you? Apply for one of our cool internships or propose your own! We are already planning the internships of next year, here is a sneak peak into what it entails 🤖 Looking for an internship? Internships are the perfect way for you to see if you would like to pursue a career in AI and for us to see if there’s a match for a long-term collaboration! There is not enough time in a human life to develop all the cool ideas that we have in mind so it▋

The problem. Artificial intelligence (AI) is driving the rapid transformation of industries. However, the exponential rate of that transformation is difficult to manage for legislators. Moreover, there is no industry standard to ensure AI is safe and beneficial. New applications are introduced at breakneck speed, oftentimes without sufficient consideration of their potential societal impact. AI promises to enable the scaleable automation of almost any decision-making system. In doing so, we amp▋

Deep neural networks offer unparalleled performance for many applications, but running inference can be resource-intensive. Model optimization comes in to help here, reducing disk storage, memory usage or compute requirements. This can be useful for deployment on the edge (to run models where it otherwise would not be possible), as well as for the cloud and on-premise (to run models faster, or allow more models te be stored in-memory simultaneously). Moreover, reduced energy requirements of opti▋

Last week, the winter Olympics in Beijing came to an end. For Belgium, this meant a successful edition with one female (Hanne Desmet) and one male (Bart Swings) medal. Belgian medals at the Winter Olympics are pretty rare anyway but the medal of Hanne Desmet was the first Belgian female one since the games of 1948 in Sankt Moritz! At dataroots, we highly value diversity, putting the topic regularly on the agenda to see if everybody thinks we’re on the right track. The past decades, the topic ha▋

Unboxing an embeddable analytical database. DuckDB is a recent addition in the analytical database world. And it takes an interesting approach: it wants to be the SQLite for analytics. DuckDB was developed by Mark Raasveldt and Hannes Mühleisen, two database researchers at the Centrum Wiskunde & Informatica (CWI) in Amsterdam, the Dutch National Research Institute for Mathematics and Computer Science. CWI is not just any research institute. For a few decades now, the team has been pushing the ▋

As we alluded to in our trends post , the number of researchers, developers and companies that focus on eXplainable AI (XAI) is growing faster each year. 💡XAI is an umbrella term for methods, algorithms and tools that increase insight into the inner workings of AI. This is in contrast wit▋

Matching theory (a branch of game theory) is a mathematical framework attempting to describe the formation of mutually beneficial relationships over time. What other topic could we possibly have chosen for Valentine's day? Actually, this is a very serious and important field of research in economics. And, in 2012, Alvin Roth and Lloyd Shapley got awarded a Nobel prize ▋

> Notion ➕ Great Expectations = 🚀 If you've ever heard of or used Notion (specially their databases) and Great Expectations, you can already imagine what this is about 😉. If not, find a quick ELI5 below: See our Github for more technical details and detailed instructions. 👶 ELI5: Great Expectations > "Great Expectations is a shared, open standard for data quality. It helps data teams eliminate pipeline debt, through data testing, docu▋

eXplainable AI or XAI is crucial to ensure stakeholder and public trust, as well as reliability, particularly in high-stake contexts where AI decisions can impact lives. Open-source contributors, researchers & companies are stepping up their game by providing ever-more ambitious and inventive methods to ensure transparent, interpretable and ultimately, explainable AI. As a consequence, XAI methods are sprouting up like mushrooms, meaning that the decision on which method to use is becoming inc▋

If you're not new to Python and data science, you probably heard of Jupyter notebooks . But if you haven't, here's the gist: it's an interactive environment, meaning you can run little bits of code and see the output, store variables in memory, etc. That makes notebooks a good tool for experimentation, reporting and visualizations. And because of that, it's a popular tool of choice for data science in general. And this is why you see a lot of notebooks in places like Kagg▋

Foreword In this post, we have gathered our experts’ views on new developments in AI. However, AI is a broad field and we do not pretend to have a complete understanding of the whole landscape. Our view is necessarily biased by our activities as an AI service provider and our Belgian market presence. Bearing this in mind, we examine different trends that we have spotted in AI across industries, research, tooling and much more. The goal of this article is to get an overview of the landscape and ▋

🙌 An article that our very own Tim Leers co-authored just got released. A snippet of the summary: > Engagement and training of community health workers (CHWs) have demonstrated their value in different conditions. Despite repeat epilepsy trainings of CHWs in Northern Rwanda, the treatment gap remained high. We hypothesized that effectiveness of CHWs on mobilization of patients living with epilepsy (PwE) could be improved using a va▋

Watch our experts share our views on : * What type of data do we currently work with? * How are the AI use cases evolving? * How much time does it take to leverage value from AI/data? * What has been the biggest evolution in infrastructure to support the AI cases * Where is the market in terms of AI adoption and maturity? * What is the role of the EU citizens, how are they included in AI projects/development?▋

> Why would the chef give away the recipes for the dishes he is famous for? What does the engineer achieve from sharing his schematics for that new technological marvel? Working open source is like sharing your secrets. These contemplations are often pronounced by people outside or not familiar with software development. Let’s have a look at a couple of examples of why and where Open Source proves its value in our day-to-day business. Essential ingredient Free Open Source Software (FOSS) is an▋

Soo... I got asked by Virginie Marelli to explain what cheek is. Here goes: cheek is an approach at building a simple job scheduler that…▋

What was the last time you actually set a foot in a bank? How often do you still pay with cash? I honestly cannot remember the last time I…▋

🎉 Murilo Cunha released his first official version of databooks earlier this month. databooks is a package that eases the collaboration…▋

Entering 2022, we also look back on an incredibly active year of sports. Together with the company, our team events grew and so the amount…▋

There is no doubt that there resides a lot of value in your data! There is probably lots of it in your company, together with some smart…▋

Introduction and Context Anyone who has spent some time in Belgium/Flanders probably knows that road cycling is very popular around here…▋

The AI environment is becoming increasingly mature. Once hard to crack processes are now being automated in no time and it won’t be long…▋

Let's imagine you are a freshly recruited Data Scientist. During one of your stand-up, your product owner gives you a couple of tasks that…▋

AAPI, de digitale planningstool voor horecaondernemers, schuift aan tafel met de Leuvense AI-expert Dataroots en het visualisatieplatform…▋

If you are working with a lot of data like we do at dataroots then it is highly possible that you encountered your fair share of bad…▋

Over the past decade, data driven decision algorithms have become more and more performant and prevalent, but also complex. They are not…▋

While the advent of advanced artificial intelligence (AI) systems in our daily lives is an absolutely thrilling prospect (and increasingly a…▋

As the surge in gas and electricity prices intensifies with the UK and European gas prices even closing at ten times their level from the…▋

Before we dive in, what is MLOPs? There is much to say about it, but much like me, I'll keep this short and sweet. As you could've guessed…▋

You all know that datarootsians are excellent data athletes. Olympics athletes train with weights, we evolved past that mere display of…▋

Ray is such a cool distributed computing library that it makes me weep for joy. It is not only cool for batu + ray = baturay but it is also…▋

Who hasn't heard of data quality? If there is a topic that comes up again and again lately it seems to be data governance where data quality…▋

Why does it matter Data, AI, Machine Learning, etc. are complicated terms, and many organizations still struggle to implement and gain real…▋

Toepassing data science in deze context primeur voor Belgische multinational Puratos bereikt nieuwe hoogtes in natuurlijke…▋

Mobile application enriches data from different bank accounts and shares profits with its users The Belgian mobile app Cake bundles and…▋

Artificial intelligence (AI) and data-driven solutions have been on the rise for quite some years now and their many applications became an…▋

AI is everywhere. Overtuigd van de kracht van data, trekt de moderne bedrijfswereld nu resoluut de kaart van artificiële intelligentie. De…▋

The rise of artificial intelligence is unstoppable. Not only are businesses appealing to AI more frequently than before to boost their…▋