We review papers, explore ideas and write pedagogical articles & deep dives on areas that excite us!
Let us know if you would like to see specific papers featured here!
-

A recent paper Tensor Product Attention Is All You Need grabbed my attention. Over the last year, I have been exploring and investigating ways to reinterpret attention mechanism, mainly for my own edification. What correlations do a transformer really capture? And unsurprisingly, I have been looking at using intuition from the physics of correlated systems.…
-

Folks who have been dreaming happily like I have over the past decade that nucleic acids are the right substrate for engineering medicines, well, here is one more evidence that we might just be right with our obsession with this marvelous polymer of life! Here is how I evangelized my obsession amongst colleagues. Silicon Valley…
