Project List

My Project List

This website is not finished :)

Transformer Gallery

A gallery of many transformer variants, specifically long sequence transformers to try to benchmark and open source research. (Longformer, Recurrent Memory Transformer etc...)

Agent 57

A DQN based AI agent that was able to play all 57 atari games at a superhuman level. It was a big milestone in reinforcement learning.

Stock AI

A deep learning stock trading bot. It uses many transformer variants integrated with distributed reinforcement learning algorithms to try to make sense of the news feed from google news.

Intrinsic Curiosity Module

A reimplementation of the ICM paper that endows DQN agents with curiosity, incentivizing them to explore unfamiliar things in their environment.

Diffusion Models

A generative AI that synthesizes images from noise. Reimplemented from the landmark paper that became the predecessor to current image AI generators.

Deep-Q-Network

An algorithm that learned to play atari games entirely from self play using Q learning