I train language models from scratch on consumer hardware and build the tooling that keeps AI agents honest.
$ whoami
B.Tech CSE (AI & ML) @ AKGEC, Ghaziabad · class of 2027
ex-Software Engineer Intern @ AMRR Techsols · real-time CV + backend
| 24 | GPT-style 60M models trained from scratch (250+ GPU hrs) |
| 1 Mbp | DNA context inference in 5.6 GB VRAM |
| 1,940 tok/s | training a 1.5B MoE model on an 8 GB RTX 5060 |
| <100 ms | inference across 3 synced camera streams in production |
Architectural Inductive Biases Under Extreme Capacity Constraints · codemind
Single-axis ablations of MHA / MQA / GQA / MLA, RoPE, MoE, and Muon vs. AdamW at 60M parameters on 1B tokens. Showed MLA's deficit is rank saturation (r=256 + decoupled RoPE → 31.22 PPL at 2.7× smaller KV cache), and that Muon on GQA needs shape-aware scaling and a retuned LR (−1.01 PPL).
Mnemos-DNA: long-context DNA language model · paper
A k-mer fast-weight memory on linear-attention (KDA) models restores exact recall out to 64 kbp for ~3% extra parameters. Weights on Hugging Face and the companion benchmark
recall-benchon PyPI.
| Project | What it does | Stack |
|---|---|---|
| Riftguard · live | Safety layer for parallel Claude Code / Codex agents: shared decisions over MCP, an LLM judge for conflicts, auto-checkpoints before irreversible actions. On PyPI. | Python · MCP · SQLite |
| Aura · live | Agentic SRE co-pilot: links incidents to deploys, recalls similar past incidents, proposes rollbacks behind human approval. | LangGraph · FastAPI · React · K8s |
| CodeMind | Memory-efficient PyTorch pipeline with MLA + MoE + Muon, trained on a $10 compute budget. | PyTorch · CUDA |
| HackRx 6.0 RAG | RAG over legal-scale PDFs with no pre-computed embeddings. Top 35 of 10,000+ teams. | AWS · Gemini · Docker |
| WhatsApp Agent | Autonomous WhatsApp agent: Go bridge + Python MCP server on Google ADK. | Go · Python · MCP |
LangGraph MCP Google ADK Hugging Face RAG MoE Qdrant Neo4j Pinecone ChromaDB YOLOv8 PyArrow
- Top 35 Finalist, Bajaj Finserv HackRx 6.0 (10,000+ teams)
- 3★ on CodeChef
- NVIDIA DLI: Fundamentals of Deep Learning

