One tweet from https://twitter.com/finbarrtimbers says: I enjoyed the CUDA driver installation for 2 days plus another day to reinstall the whole system around 2 years ago. Now in 2023, with the correct steps, you can only enjoy CUDA drivers installation for just 5 mins in Ubuntu, here are the steps: …

Build A Dual GPUs PC for Machine Learning and AI with Minimum cost — Background and Building Target Both Stable Diffusion and offline LLM models require a huge amount of RAM and VRAM. To run and learn those models, I bought an RTX 3090 for its 24G VRAM. Actually, my aging Intel i7–6700k can still work well with a single RTX 3090, but when I throw another GPU…

Test various methods to boost Stable Diffusion package Diffusers' performance and lower VRAM usage — This is a testing note of running Diffusers with the latest PyTorch 2.0⁴. The purpose is to test out if all those optimization methods work or not if they work, how much performance improved. This article is going to cover the following performance & optimization methods: What is the baseline…

Overcoming token size limitations, custom model loading, LoRa support, textual inversion support, and more — Stable Diffusion WebUI from AUTOMATIC1111 has proven to be a powerful tool for generating high-quality images using the Diffusion model. However, while the WebUI is easy to use, data scientists, machine learning engineers, and researchers often require more control over the image generation process. …

A step-by-step guide to setup a runnable GPT-2 model on your PC or laptop, leverage GPU CUDA, and output the probability of words generated by GPT-2, all in Python — The best way to understand ChatGPT and GPT-3 is to install one on a personal computer, read the code, tune it, change parameters, and see what happened after every change. Considering the size of the GPT3 model, not only that you can’t download the pre-trained model data, you can’t even…

Ideas I learned in 2022 — 1. Reduce social media usage, reduce unnecessary preoccupations Almost all productive creators saying that Twitter, daily news, and all sorts of social media are poisonous to their minds. They only become more productive and happier after quitting social media and news. My personal experience is, the mind needs to be protected to be happy and productive. If I…

Data pivoting in Kusto — The problem description Before feeding the data to a machine learning model, I need to tidy the data as needed. For example, I have a table with user id and using services.

Write in Markdown, publish to Medium along with embedded images using Python — Writing and editing on the Medium website is not only painful and also wasting of time on style wrangling. I am wondering if there is a way to write in a Markdown file and then publish to Medium directly using Python. After some searches, no open source and free solution…

Cover three end-year holidays with three stories — Data Scientists and Engineers are those who not only indulged in data, machine learning, and business logic but Just like you, they celebrate holidays too. The end of the year is knocking on the door, holidays are waiting. In this article, I am going to cover three holidays from different…