WeeLLM — Running 20B Diffusion Models on a 4GB GPU

Posted on Sat 22 August 2026 in Inference • Tagged with diffusion, low-vram, layer-streaming, flux, local-inference

WeeLLM is a layer-streaming inference engine for large diffusion models. Its one claim is unusual: run a ~12B FLUX model, or even a ~20B Qwen-Image model, in under 4GB of VRAM — with no quantization. Full bfloat16 weights, degraded only in speed, never in precision.

The Core Idea

Layer Streaming The …


Continue reading

Why Lean Inference Matters

Posted on Fri 21 August 2026 in AI Engineering • Tagged with inference, LLM, efficiency, cost-optimization, local-first

The frontier of AI is no longer just about who has the biggest model. It's about who can run intelligence cheaply, quickly, and everywhere. That shift is what Lean Inference is about: treating inference cost, latency, and accessibility as first-class engineering problems rather than afterthoughts.

For years the industry chased …


Continue reading

How 19 Year Old Dropped Out Changed the World - The Mark Zuckerberg Story

Posted on Tue 28 July 2026 in Founder Stories • Tagged with Zuckerberg, Facebook, Startups, Tech History

Mark Zuckerberg went from building a home messaging app at age 12 to running the world's largest social network. This is the story of how a self-taught programming prodigy turned a dorm-room project into a platform used by billions — and the controversies he weathered along the way.

Young Mark Zuckerberg

The Kid From …


Continue reading

My Darkest & Challenging Days in India

Posted on Mon 29 June 2026 in Personal • Tagged with resilience, career, learning, life-lessons

Everyone has their dark days. Here are the toughest situations I went through — the ones that shaped my life and taught me to face any challenge that comes my way.

The Fall

Second Class Graduate — I graduated second class in Engineering, and no employer would even consider me for an …


Continue reading

How Canada Outlasted South Africa to Reach the Round of 16

Posted on Sun 28 June 2026 in Sports • Tagged with world-cup, canada, south-africa, knockout-stage, jesse-marsch

Canada beat South Africa 1-0 at SoFi Stadium in Inglewood on June 28, 2026, with a Stephen Eustáquio goal in the 92nd minute, advancing to the World Cup Round of 16 for the first time in the nation's history. The match stayed scoreless deep into stoppage time, a tight and …


Continue reading

FACommerce: How Agentic Fashion-Commerce Will Change the Way We Buy

Posted on Sun 28 June 2026 in Commerce • Tagged with agentic-commerce, fashion, retail, AI-agents, FACommerce

For two decades, online shopping has asked us to do the work. We type queries, scroll grids, open ten tabs, compare sizing charts, abandon carts, and come back three days later when the algorithm finally serves the right ad. The store is a catalog and we are the search engine …


Continue reading

From Static Graphs to Thinking Systems: Agentic GraphRAG for COBOL Codebases

Posted on Mon 22 June 2026 in Knowledge Graphs • Tagged with GraphRAG, COBOL, LangGraph, Neo4j, Agentic AI, Legacy Modernization

Disclaimer: This is a shadow article of https://medium.com/@vineetchachondia/from-static-graphs-to-thinking-systems-agentic-graphrag-for-cobol-codebases-fcea6d1b62a6 as Medium is paywalled

Part-3 of the Knowledge Graph Series

What if your legacy COBOL codebase could explain itself — collaboratively, intelligently, and on demand?

For decades, COBOL systems have quietly powered banks, insurance firms, and governments. And for …


Continue reading

Graph Databases and Libraries: A Practical Comparison

Posted on Sat 13 June 2026 in Knowledge Graphs • Tagged with graph-databases, neo4j, kuzu, networkx, rdflib, cypher, sparql

Choosing a graph backend is less about finding the "best" tool and more about matching the tool to your scale, query style, and deployment constraints. This is a survey of the main options across three tiers: in-process libraries, embedded file-based engines, and full graph database servers. Each entry below gives …


Continue reading

GraphRAG for Mainframe Abend Troubleshooting with AgentScope

Posted on Fri 12 June 2026 in GenAI • Tagged with GenAI, RAG, KnowledgeGraph, AgentScope, Mainframe, GraphRAG, Python, COBOL

Most mainframe troubleshooting RAGs fail at the same place: retrieval. An abend code like S0C7 is a near-exact lookup, not a fuzzy semantic match — but vector search happily returns the S0C4 chunk because the embeddings sit close together. And job dependencies are graph-shaped: an abend in step 3 cascades to …


Continue reading

Understanding Startup Equity Cliffs and Vesting

Posted on Thu 11 June 2026 in Startup • Tagged with equity, vesting, stock-options, startups, founders

A startup employee equity cliff period is the minimum amount of time an employee must stay with the company before earning any ownership rights to their stock options or equity grants.

Typical Structure

4-Year Vesting with 1-Year Cliff The most common arrangement: equity vests over four years, with nothing earned …


Continue reading