A step-by-step guide to setup a runnable GPT-2 model on your PC or laptop, leverage GPU CUDA, and output the probability of words generated by GPT-2, all in Python — The best way to understand ChatGPT and GPT-3 is to install one on a personal computer, read the code, tune it, change parameters, and see what happened after every change. Considering the size of the GPT3 model, not only that you can’t download the pre-trained model data, you can’t even…

Ideas I learned in 2022 — 1. Reduce social media usage, reduce unnecessary preoccupations Almost all productive creators saying that Twitter, daily news, and all sorts of social media are poisonous to their minds. They only become more productive and happier after quitting social media and news. My personal experience is, the mind needs to be protected to be happy and productive. If I…

Data pivoting in Kusto — The problem description Before feeding the data to a machine learning model, I need to tidy the data as needed. For example, I have a table with user id and using services.

Write in Markdown, publish to Medium along with embedded images using Python — Writing and editing on the Medium website is not only painful and also wasting of time on style wrangling. I am wondering if there is a way to write in a Markdown file and then publish to Medium directly using Python. After some searches, no open source and free solution…

Cover three end-year holidays with three stories — Data Scientists and Engineers are those who not only indulged in data, machine learning, and business logic but Just like you, they celebrate holidays too. The end of the year is knocking on the door, holidays are waiting. In this article, I am going to cover three holidays from different…

Here is the problem I faced today. When I use the following Python code to upload a CSV file to Azure Blob container. blob_client = self.container_client.get_blob_client(blob_file_path) with open(local_file_path,'rb') as f: blob_client.upload_blob(f,blob_type="BlockBlob") See the complete sample code here. A small file of size less than 9MB works well. However, when the…

A comparison of matrix arithmetic calculation in CPU and GPU with Python and PyTorch — How fast do GPU computation gains compare with CPU? In this article, I am going to test it out using Python and PyTorch Linear Transform functions. Here are some of my test machine specs: CPU: Intel i7 6700k (4c/8t) GPU: RTX 3070 TI (6,144 CUDA cores and 192 Tensor cores) …

Research on global warming and its causes — The heat wave makes me think of heat and radiation. How does radiation work? How does carbon dioxide causes the temperature to increase, or is carbon dioxide the single cause of the current global temperature increase? This article is a research to find the answers to the above questions. How do we know the earth is getting warmer? It…

How to export a large volume of data from Kusto — One of the complaints from Kusto users is its limited size of data exporting. The Kusto’s Query Limit document says this: Kusto can return either 500,000 rows or 64 MB of data to you. Is this a flaw in design? I don’t think so. Kusto is designed to be a…