Research on global warming and its causes — The heat wave makes me think of heat and radiation. How does radiation work? How does carbon dioxide causes the temperature to increase, or is carbon dioxide the single cause of the current global temperature increase? This article is a research to find the answers to the above questions. How do we know the earth is getting warmer? It…

How to export a large volume of data from Kusto — One of the complaints from Kusto users is its limited size of data exporting. The Kusto’s Query Limit document says this: Kusto can return either 500,000 rows or 64 MB of data to you. Is this a flaw in design? I don’t think so. Kusto is designed to be a…

What I learned from the experience of Frank Abagnale — The real character of the movie “Catch Me If You Can” — I am shocked by the talks from Frank Abagnale. You can stop here and ignore my article, but you won’t regret spending an hour watching his speech if you haven’t watched it before. In the beginning, I thought he was just reciting the prepared speech text. He delivered the…

Use Python to understand economic data and the cause of the current high inflation rate — The stock price is pluming; the crypto market is melting down; inflation is rocketing to its 40-years high; the whole economy is precarious. Everyone is talking about recession like every expert swore the inflation rate is under control just half a year ago. Now the FED decided to control inflation…

Simulate a tiny solar system with Sun, Earth, Mars, and an unknown comet using real mass, distance, and velocity data in Matplotlib — I was amazed by the PCA (Principal Components Analysis) and thinking of using animation to show the machine learning processes. When I managed to animate a graph, I was tempted to animate something cool. The first cool stuff that comes to me is the solar system. …

Understand the K-Means model by creating one from scratch — K-Means model is one of the unsupervised machine learning models. This model is usually used to partition observed data into k clusters. You give the model a bunch of data with defined features and tell it how many clusters you want it to output. The model will classify the dataset…

Walk around amazon.com's anti-bot mechanism and use Python to crawl Amazon.com price data automatically — It is not that easy to crawl Amazon.com data nowadays. Amazon will block your HTTP requests here and there, and make your automation a vain trial. For example, run the following code: import requests page = requests.get('https://www.amazon.com/') print(page.text) Your request will get a warm welcome from Amazon.com like this instead…

Build a neural network model to simulate any functions using PyTorch — We know that the Linear Regression model can help generate a line to simulate “Linear Data”. A function in the form of f(x) = ax + b. So, what about other functions, like non-linear ones? Even an irregular shape that we know nothing about. Can we still simulate a model…

Leverage the idea from Neural Network to estimate weights for a system with multiple factors — Imagine you have a customer dataset with dozens of features, and you are trying to build a weighted system to predict certain customer behaviors (like buy or not buy). How to determine those individual weights value?