Hi everyone, before I go ahead and share my progress, I wanted to quickly talk about what this blog is about.

I am highly passionate with the idea of high performance computing, optimizing deep learning applications, and solving real world problems using deep learning, computer vision, and speech processing. While I’m on this path - I would like to document this somewhere. And while I’m doing that, why not share it publicly?

So here it is, the first weekly update blog on what I’ve been upto:

PyTorch: (ft. Quansight and Facebook)

  • Followed up on batch_norm PR. Merged 🎉
  • Structured Kernel porting for baddbmm, bmm PR. Lots of interesting discussions, and should be approved after final round of review. Will have to follow up on this coming week.
  • Structured Kernel porting (WIP) for nonzero PR. Putting this on hold, as there is a related PR on this - and it makes more sense to let that one go first, and then start working on this.
  • Finished the max_poolNd PR, the PR is approved and will be merged after some time.
  • While working on structured kernel for baddbmm, bmm PR, we needed to differentiate between in-place and out calls, interestingly - the autogenerated set_output function was the answer. A good discussion on this is here.
  • Took a look at implementation of ArrayRef class, find the source code here.

Extras:

  • The concept behind JIT is very interesting, and I wanted to read more about it. Started with this article on “A Brief History of Just-In-Time”. I plan to write a blog on this once I’m done reading.
  • Effective Modern C++: I continued reading through Item 12 and Item 13 of Chapter 3:
  • A very interesting blog on vmap and pmap in Jax is here. Read half of it, will continue reading in the next week.
  • An interesting watch on When do I use a union in C or C++, instead of a struct?. I like watching such videos when I’m a little tired from work.
  • Blog theme:
    • Worked on a new theme inspired by this theme.
    • Re-organized the blog, fixed all the links (wherever it’s shared on the internet), in-blog images and cover images as well. Check the milestone here.
    • With this blog, the milestone for the blog will be closed. 🎉
  • Started reading tutorial on PyTorch’s official docs about Returning a Dispatched Operator in C++. Half way through, will continue reading in the next week.
  • Contribution to pystiche, attempting to suppress deprecation warnings produced by pystiche module. PR, a few review comments to address otherwise should look good.

Yes, and apart from all of this, I did won a few games of CSGO with my friends, had a few health issues to catch up with (😢), updated my discord channel with blog announcements, helped a few friends with their doubts, and well, yeah that’s it.

I hope to perform better once I feel good (w.r.t health). Thank you for reading.