Power Query

Accumulating lists in Power Query using… List.Acculumate()

By Michał 13 Jul, 2018 Leave a comment

List.Accumulate is a very powerful function that is often overlooked, when doing Power Query transformations. Its basic behaviour is explained in the reference. How this function works is accumulates a result from a specified operation (accumulator function) starting from the initial value – seed – and going row by row till the end of a specified list. Radacad greatly explained the possibilities of the function. I treat List.Accumulate as a function that lets me access a previous row. Something that is very often expected by customers using Excel sheets as data sources. This enables me to e.g. detect a change in ID or date – from my experience 90% of the cases.

Azure

Processing Analysis Services Table in PowerApps

By Michał 29 Jun, 2018 Leave a comment

This tutorial was requested by one of our clients. His app was connected to DWH, which was the source for the Analysis Services. After the data was input into the edit form, the task was to start processing the table to see it through Power BI.

PowerBI

A real loop function in Power BI

By Michał 13 Jun, 2018 1 Comment

Today, I will go through how to create a loop function using List.Generate() and a Custom Function. I will show how to loop through pages in an API call. This would normally be solved using a for loop in e.g. Python.

PowerBI

SQL Injection in Power BI Service

By Michał 6 Jun, 2018 Leave a comment

I know that this case might be obvious for the most of the experienced data engineers and other specialists, but it really surprised me. Our Principal Architect in Clouds on Mars – Paweł Potasiński pointed me this possibility.

PowerBI

Authenticating to a datasource with multiple credentials

By Michał 30 May, 2018 Leave a comment

The case from one of my previous comments had another catch! As I mentioned the client was downloading data from an API. The client was interested in data for multiple entities i.e. had to use different credentials for the same URL to retrieve different datasets. Because the client wanted to see everything in one Power BI I had to find a suitable solution. Same as before, I turned my attention towards M language!

PowerBI

Looping through a table to get data from Web in Power BI

By Michał 23 May, 2018 1 Comment

Today’s post shows how to call a custom function for each row in a table. This can be done both using standard Power BI interface and M language scripts. I have decided to try the latter.

Bez kategorii

Connecting to Numbeo.com table

By Michał 24 Jan, 2018 Leave a comment

The data module in Excel is sued to connect to the table on the websites. In this way, when refreshing, the data will be automatically downloaded and always up-to-date.

Python

Learning how to play Flappy Bird using ANN and genetic algorithm

By Michał 14 Nov, 2017 Leave a comment

I decided to try creating a self-learning algorithm on a simple problem. I know that the solution is an overkill, but nonetheless I wanted to explore the possibilities connected to using GA with ANN.

Python

Flights during a storm

By Michał 9 Sep, 2017 Leave a comment

This vizualization took way more time than I expected. The idea came up on 29th June, when I was sitting in Microsoft’s office right next to the airport in Warsaw. The storm during that afternoon was huge. I immediately checked flightradar24 to see, what the airtraffic looks like. I wondered what it would look like if plotted with the clouds and maps.

Azure

Delete from FTP using Azure Data Factory

By Michał 30 Jul, 2017 Leave a comment

During development of an ETL process in Azure Data Factory, you may come across a need to delete the data from FTP. It may be neccessary e.g. when you want to make place for new incoming data or you don’t want your pipeline to pull the old data twice. The solution of the problem lays in a custom activity.

Michał Ćwiok

Analytics, clouds, AIs and stuff.