Kunjal Panchal
Code for "Thinking Forward: Memory-Efficient Federated Finetuning of Language Models" (NeurIPS 2024). Spry is a federated learning algorithm that enables finetuning LLMs using Forward-mode Auto Differentiation; to achieve low memory footprint, high accuracy, and fast convergence.
Code for "Flow: Per-Instance Personalized Federated Learning" (NeurIPS 2023). Flow addresses the challenge of statistical heterogeneity in federated learning through creating a dynamic personalized model for each input instance through a routing mechanism.
A novel multimodal fusion model to classify 6 classes of emotions from visual, verbal, and vocal features of a person’s speech in CMU-MOSEI dataset.
Final Year Project (BEngg at MSU, Vadodara) on Skin Cancer Detection using Matlab Image Processing Toolbox
I have used the ExtraSensory data set. This is a human activity recognition data set containing data from 60 individuals. The task that I will focus on, is probabilistic activity forecasting. Given a sub-dataframe consisting of between one and 30 consecutive observations for a single individual and a timestamp value t, the objective is to predict the (log) probability that each of the five labels (label:LYING_DOWN, label:SITTING, label:FIX_walking, label:TALKING, label:OR_standing) is active (e.g., takes the value 1) at the future specified time, t.
In digital cameras the red, blue, and green sensors are interlaced in the Bayer pattern. The missing values are interpolated to obtain a full color image. In this project, I implemented several interpolation algorithms.
My reviews of the research published for computer architecture which includes: Methodology, Experience, Wearout, Memory, Cache, Multithreading, Prediction, Pipelining, Instruction-level Parallelism, Branch Prediction, Virtualization, Secondary Storage, Security, Parallelism, Data Parallelism, Data Centers
Template for my portfolio website, built using GatsbyJS. - https://astuary.github.io/Kunjal/