Adding a new HDD to a Linux system

As deep learning {datasets, models, scale of experiments} grow, so do the storage requirements, and we increasingly find ourselves running out of space on our SSDs. I recently added a new 8TB HDD to my workstation to act as a new scratch volume. While adding a disk would be a standard “sysadmin” work, I found the process of handling permissions for a shared research group on a domain-connected Linux machine to be a bit more involved than I expected. So, for the sake of my own documentation and on the off chance that someone else might find it useful, I’ll document the process here. Since I am using Ubuntu 22.04 on this workstation, I used the Ubuntu instrcutions as a starting point and modified them as needed. ...

May 27, 2022 · 6 min · Kumar Abhishek

Deep Learning for Unsupervised Image Segmentation

This term, I really wanted to present this one ICASSP paper I found very interesting, but then I realized that the authors followed up their work with another journal paper (IEEE TIP), so I decided to discuss both. Both of these papers deal with the topic of unsupervised image segmentation: Kanezaki, “Unsupervised Image Segmentation by Backpropagation”, ICASSP 2018 [URL]. Kim et al. “Unsupervised Learning of Image Segmentation Based on Differentiable Feature Clustering”, IEEE Transactions on Image Processing, 2020 [URL]. Here are the slides I made to present this topic in our reading group: ...

March 31, 2022 · 1 min · Kumar Abhishek

Using HuggingFace Accelerate for mixed-precision training

Note: This post was originally written in 2021, but I have since updated it to reflect the latest changes in HuggingFace Accelerate (last update November 2025 using accelerate==1.11.0). For a grad course that recently concluded, the course project required me to train and evaluate a large number of models. Our school’s local SLURM cluster has new GPUs that support fp16, which meant I could take advantage of PyTorch’s Automatic Mixed Precision (AMP) training. And honestly, there is no reason not to use it: we get reduced memory usage, faster training, and all of this without virtually any loss in performance. ...

December 20, 2021 · 4 min · Kumar Abhishek

The "No-Space" Backup Solution (Streaming tar over SSH)

We recently got an email from our IT department that our workstation OSes will be getting upgraded from Ubuntu 18.04 MATE to Ubuntu 20.04 GNOME. As much as I love MATE and how lightweight it is (LinuxScoop makes wonderful OS overview videos), I also like the “visuals” of GNOME. My personal laptop already runs Ubuntu 20.04 GNOME, so I am excited to have it on my lab workstation as well. However, this OS upgrade also means that we have to backup our workstations since the drives will be wiped. Our research group has a generous storage space allocation on Compute Canada’s Cedar, so storage is not a big issue. The problem is: Cedar’s long-term storage space is a “tape-based backup system”, so there is a strict limit on the number of files we can store there. Therefore, the best strategy is to create tar archives of our data and store those on Cedar. ...

July 10, 2021 · 4 min · Kumar Abhishek

CMPT 757 Paper Summaries

Single-page paper summaries written for CMPT 757 (Frontiers of Visual Computing, Fall 2020), collected in one place.

November 30, 2020 · 2 min · Kumar Abhishek