We'd go through normal distribution, Bernouli distribution, binomial distribution, Poisson distribution, chi-square distribution, etc. ANOVA (Analysis of Variance) is primarily associated with the F-test, but its scope extends beyond just the F-test. ANOVA tests whether the means of three or more groups are equal by comparing: Between-group variability (differences across group means). Within-group variability (differences … Continue reading Statistic Distribution and Methods to Perform Statistical Analysis

Revisiting the concept of tensor in April 2025 per inspiration from "abide by reason". The key is to grasp concept of dual space, (where df in differential geometry live too). It's essentially a "linear functional" that takes in element in vector space and spit out real number in R. Tensor's concept is the expansion on … Continue reading Tensor – Invariant Geometric Object

Besides the widely used object-oriented programming (OOP), functional programming is another powerful paradigm, especially in applications like Apache Kafka, where handling high-volume streaming data is crucial. To understand functional programming, it's helpful to first examine non-functional programming paradigms. OOP is one example, but there are several others, including imperative programming, procedural programming, event-driven programming, logic … Continue reading OOP and Functional Programming

While Lagrange multipliers are a powerful technique for constrained optimization, there are several other methods used to solve optimization problems: Gradient Descent: An iterative first-order optimization algorithm for finding a local minimum of a differentiable function24. It's commonly used in machine learning for training models by minimizing error functions. Newton's Method: A second-order optimization technique that … Continue reading Optimization Problem and Methods

Diana Hu did a great job summarizing the key innovations or ingenuities of Deepseek. First, float 8 format to save memory without sacrificing performance. But FP8 will have accumulation precision issue, the strategy to improve accumulation precision in FP8 GEMM operations on NVIDIA H800 GPUs. Due to limited 14-bit precision in Tensor Cores, large matrix … Continue reading Deepseek Innovations per Their Papers Summarized by YC

There are people who research and develop new algorithms and architectures, advancing the field of artificial intelligence. There are people who train the neural network models such as OpenAI's ChatGPT, Qwen, and DeepSeek models, pushing the boundaries of what AI can achieve. There are people who use these AI models to transform and disrupt existing … Continue reading Three Types of AI Talent Needed

in the github page, the three repos are pinnned: DeepSeek-VL2, an advanced series of large Mixture-of-Experts (MoE) Vision-Language Models that significantly improves upon its predecessor, DeepSeek-VL. DeepSeek-VL2 demonstrates superior capabilities across various tasks, including but not limited to visual question answering, optical character recognition, document/table/chart understanding, and visual grounding. Our model series is composed of … Continue reading Deepseek Codes and Paper

DeepSeek originated as a research initiative within High-Flyer, a Chinese quantitative hedge fund known for its AI-driven trading strategies. In April 2023, High-Flyer established DeepSeek as an independent entity dedicated to advancing artificial general intelligence (AGI), explicitly separating its research from the firm's financial operations. Wikipedia Since its inception, DeepSeek has developed several notable AI … Continue reading Who is the Inventor of Deepseek and What are the Key Innovation of Deepseek v3 R1 Model

The ability to grasp the essence—the INSIGHT—is everything. You can outsource or delegate many tasks, but the insight must remain your own. Insight drives conviction, and conviction fuels perseverance. So, how do you develop INSIGHT? From my experience, it starts with mastering the highest forms of human knowledge: math, physics, and engineering. These disciplines capture … Continue reading Ability to Understand Essence of Things

The deeper I dive into this topic, the more fascinating and fundamental knowledge I uncover. Using the swap function outlined in the previous blog, we understand the core concepts of pointers and addresses. In C, however, you can’t pass constants directly to a function like swap(3, 4). Instead, you must assign the values to variables, … Continue reading Practicing C C++: Continue