Gradient is All You Need?