MNIST is often considered the “hello world” of today’s deep learning, and deep learning networks are pretty much the standard now.
While there’s not much literature on Julia and deep learning yet, you might want to look at grokking deep learning by Andrew Trask. He only uses numpy, and those numpy examples will translate very directly to Julia