Master tensor calculus using Einstein index notation by Sho Takatori

I don't know why the definition of tensor is so mysterious: tensor is something transform like a tensor. Sho Takatori also pointed out the absurdity and illuminate it with Einstein index notation in real calculus computation. Nevertheless, it's still quite complicated, that's why genius Einstein had to come in and provide a notation for generations … Continue reading Master tensor calculus using Einstein index notation by Sho Takatori

Marketing is Key

The key to success is marketing and promotion rather than just having the best product. Here’s why: 1. The Best Product Doesn’t Always Win Many great products or services fail simply because nobody knows about them. Meanwhile, inferior products can dominate the market due to superior marketing (think of brands like Coca-Cola vs. generic sodas). … Continue reading Marketing is Key

Understanding Square Root of Geometry: Lie Algebra to Spinor

The key traits that an exceptional mathematician or physicist possesses include the ability to identify abstract similarities and commonalities between seemingly disparate objects. The concept of the "square root of geometry" in the context of describing spinors and supersymmetry serves as an exemplary illustration of this skill. However these explanation from chatGPT is not intuitive. … Continue reading Understanding Square Root of Geometry: Lie Algebra to Spinor

Understanding Electromagnetism via Field Tensor and Exterior Derivative

Math is a language and language can be simple and more sophisticated. Based on Faraday's discovery of electromagnetism, Maxwell came up with Maxwell equations, the vector calculus language to describe it, but when we elevate to 4D and leverage tensor and differential geometry to describe the same, we got more beautiful statement. From Reumi's world, … Continue reading Understanding Electromagnetism via Field Tensor and Exterior Derivative

True Understanding of Query, Key and Value in Transformer’s Attention Mechanism

If you truly understand a theory, you can code it up and run it. So is my approach to truly understanding q, k and v in transformer's attention mechanism. in Previous blog, using "the cat chased the mouse" as an example the math is illustrated in details. Now apply it in codes (from Andrej Kaparthy): … Continue reading True Understanding of Query, Key and Value in Transformer’s Attention Mechanism

Web Search, File Search and Computer Use Released by OpenAI

OpenAI just released in face of fierce competition in the market. When generating model responses, you can extend model capabilities using built-in tools. These tools help models access additional context and information from the web or your files. The example below uses the web search tool to use the latest information from the web to generate a model … Continue reading Web Search, File Search and Computer Use Released by OpenAI