Deep Learning SeriesJonathan Hui·Follow3 min read·Sep 10, 2018--ListenSharePhoto by Adam AzimOverviewHow to start a Deep Learning project?In a 6-part series, I will explain the whole journey from starting to finishing a deep learning (DL) project. We will…medium.comBuild a Deep Learning dataset (Part 2)The success of a Deep Learning project depends on the quality of your dataset. In the 2nd part of this series, we…medium.comDeep Learning designs (Part 3)In part 3, we cover some high level deep learning strategy. Then we go into the details of the most common design…medium.comVisualize Deep Network models and metrics (Part 4)In troubleshooting a deep network, people jump to conclusions too early too fast. Before learning how to troubleshoot…medium.comDebug a Deep Learning Network (Part 5)You have build a deep network (DN) but the predictions are garbage. How are you going to troubleshoot the problem? In…medium.comImprove Deep Learning Models performance & deep network tuning (Part 6)Once we have our models debugged, we can focus on the model capacity and the tuning. In this section, we will discuss…medium.comCNN"Convolutional neural networks (CNN) tutorial"Deep learningjhui.github.ioRNN"RNN, LSTM and GRU tutorial"Deep learningjhui.github.ioGNNGraph Convolutional Networks (GCN) & PoolingYou know, who you choose to be around you, let’s you know who you are. — The Fast and the Furious: Tokyo Drift.jonathan-hui.medium.comGraph Neural Networks (GNN, GAE, STGNN)In general, Graph Neural Networks (GNN) refer to the general concept of applying neural networks (NNs) on graphs. In a…jonathan-hui.medium.comApplications of Graph Neural Networks (GNN)In two previous articles, we present an overview of the GCN and GNN networks. In our final article, we will cover their…jonathan-hui.medium.comOptimizationOptimization: Calculus of VariationsTo find the optimal values of a function f, we solve for the points where its derivative f’ equals zero.jonathan-hui.medium.comCapsule networks"Understanding Dynamic Routing between Capsules (Capsule Networks)"Deep learningjhui.github.io"Understanding Matrix capsules with EM Routing (Based on Hinton's Capsule Networks)"Deep learningjhui.github.ioMemory NetworkNeural Turing Machines: a fundamental approach to access memory in deep learningMemory is a crucial part of the brain and the computer. In some areas of deep learning, we extend the capabilities of…medium.comApplicationsHow deep learning fakes videos (Deepfake) and how to detect it?Fabrication of celebrity porn pics is nothing new. However, in late 2017, a user on Reddit named Deepfakes started…medium.com“Class visualization, style transfer and DeepDream”Deep learningjhui.github.io“DRAW — Deep recurrent attentive writer”Deep learningjhui.github.ioAI: Snap a UI mockup & finish the prototype in seconds.Brainstorming, mockups and prototyping take up a large portion of time in product designs. It will be ideal if we can…medium.comTechnologies"Soft & hard attention"Deep learningjhui.github.io"Variational Autoencoders"Deep learningjhui.github.ioMiscellaneousRegNetNAS-like methods explore a search space to find optimal models for specific tasks. In contrast, RegNets take a…jonathan-hui.medium.comTutorial"Deep learning without going down the rabbit holes."Deep learningwithout going down the rabbit holes." Deep learningjhui.github.io"Deep learning without going down the rabbit holes. (Part 2)"Deep learningwithout going down the rabbit holes. (Part 2)" Deep learningjhui.github.ioSoftware"CUDA Tutorial"Deep learningjhui.github.io"TensorBoard - Visualize your learning."Deep learningjhui.github.io"TensorFlow with multiple GPUs"Deep learningjhui.github.io"Keras tutorial."Deep learningjhui.github.io"PyTorch - Basic operations"Deep learningjhui.github.io"PyTorch - Variables, functionals and Autograd."Deep learningjhui.github.io"PyTorch - Neural networks with nn modules"Deep learningjhui.github.io"PyTorch - Data loading, preprocess, display and torchvision."Deep learningjhui.github.io
