Turns out that IP forwarding is needed if you want IP packets to be, you know, forwarded.