PinnedBuilding BlocksA Homage to Jürgen KloppTurning Doubters to Believers4 min read·Jan 26, 2024----
PinnedBuilding BlocksinTowards AIComparing Dense Attention vs Sparse Sliding Window AttentionPart 2: LLMs May Not Need Dense Self Attention8 min read·Dec 24, 2023----
PinnedBuilding BlocksLLMs May Not Need Dense Self AttentionSink Tokens and the Sparsity of Attention Scores in Transformer Models13 min read·Nov 11, 2023----
PinnedBuilding BlocksinTowards AIPaper Review: Multimodal Chain of Thought ReasoningLanguage Models improve with Visual Features7 min read·Feb 7, 2023--1--1
PinnedBuilding BlocksVisualizing Attacking Build-Up Play Using Dynamic Passing NetworksLeveraging Probabilistic Sampling, K-Nearest Neighbors and Longest Common Subsequence9 min read·Oct 20, 2022--1--1
Building BlocksPaper Review: What is UL2 in Flan-UL2?A Mixture of Denoisers and Mode Switching·6 min read·Mar 13, 2023----
Building BlocksVisual ChatGPT: Paper and Code ReviewPowering ChatGPT with Visual Foundation Models9 min read·Mar 12, 2023--2--2
Building BlocksinTowards AIIs AI Becoming the Gatekeeper and Mouthpiece of Knowledge?AI vs Human Expertise: The Growing Dependence on Machine-Learned Knowledge8 min read·Mar 8, 2023--1--1
Building BlocksPart 2: Enjoying the Subtler Aspects of FootballPressing, Baiting, Ambipedal6 min read·Jan 30, 2023----
Building BlocksPaper Review: Constituional AI, Training LLM’s using PrinciplesGoverning the behavior of Generative AI through Principles8 min read·Jan 26, 2023----