Nishant's Tech Blog

Writings on Engineering, AI, and more.

The Annotated LLaMA

Complete code breakdown of the LLama Architecture

January 27, 2025
The Annotated LLaMA

Compressing LLM’s with Low Rank Decomposition

Tricks for Compressing Large Language Models

January 26, 2025
Compressing LLM’s with Low Rank Decomposition

All about PyTorch Tensors

All about pytorch tensors

January 26, 2025
All about PyTorch Tensors

Diving into Jetson Nano

setting up a jetson nano

November 23, 2024
Diving into Jetson Nano

AWS Lambda X API Gateway

Host any piece of code in minutes for cheap with AWS Lambda

October 5, 2024
AWS Lambda X API Gateway

Deploying Models at Scale using TorchServe

Guide to scaling ML model deployment with Torchserve

Deploying Models at Scale using TorchServe

Quantisation Notes

Comprehensive notes on quantisation

March 26, 2024
Quantisation Notes

Work at Sharechat

My Journey and projects as an ML Engineer at Sharechat

February 2, 2024
Work at Sharechat

Dev Containers

Open VS code inside any docker container

January 27, 2023
Dev Containers

Mobile-VIT

A review of the Mobile-VIT architecture for lightweight vision transformers

Mobile-VIT

Docker Cheatsheet

A comprehensive guide to Docker basics and commands

September 11, 2022
Docker Cheatsheet

A Self-Supervised Descriptor for Image Copy Detection

Detect image duplicates using SSL

A Self-Supervised Descriptor for Image Copy Detection

Channels and Kernels

Building blocks of CNN’s

February 6, 2021
Channels and Kernels