I started deep learning coding in Numpy for those backpropagation codes because many other platforms are not available. But that was many years ago and you need special libraries with CUDA to make it fast enough for practical purposes. There are no compelling reasons now that you should not do it on a platform like TensorFlow or PyTorch.