Throughout my time doing research in multimodal machine learning, I happened accross many times where I had to find the higher order derivative of a matrix function. The straightforward way to find these is to use the kronecker delta. But unfortunately this results in some high order tensors as the...
[Read More]
GenNet, 1/23/2020 Update
Benefits of Multimodal Training Over winter break I learned that for linear regression there was a benefit to training with multiple modalities even when your test task is unimodal. In the time since then, I learned that this situation is better termed cross modal learning. Unfortunately, all the theoretical papers...
[Read More]
GenNet, Winter Break Update
Benefits of Multimodal Training
It makes sense that for a multimodal task, a multimodal model is better than a unimodal one. However, would a multimodal model be better for a unimodal task than a unimodal one?
[Read More]
GenNet, Theoretical Explanations for Certain Phenomenons in Multimodal Deep Learning
Introduction
[Read More]
Snowflake, the Fridge Management System
Have you ever gone home from work, only to realize you should have made a pit stop at your local store to pick up some groceries? Or how about that feeling you get when you buy too much food when you’re at the store because you don’t know what you...
[Read More]