Deep Learning Poems:

Like a rotten log
half resulting in NaNs -
my training, which
has not finished, comes
to this sad end.


When gradients flow
Not one hidden unit will remain
The way that it was


Deep Learning Papers
Are they but mere delusions?
SOTA is SOTA


Had I not known
That I was already scooped
I would have mourned
The Loss of my GPU


We have brought the students to a windowless lab
Away from the world, and yet the world torments them.


Inside a terminal, a student’s empty shell.
Sadly I muse upon the shell of a graduate student


Seeing NaNs
Clears up reality
And dream alike


I cannot change the algorithm so close to the deadline
I know that others have, but I cannot.




Holding back my graduation
With its increasing frequency
The summer internship




Notice how, not even for a single update
Does the gradient stay the same.
Witness the sign of the hessian.




If I were the gradient
The forget gate would not be able to
Keep me away from you


Students outside the professor's door
Gradients in a batch




There is no output
There is no input
Indeed, every layer
is dream after dream