It was pretty much plug-and-play.

I downloaded the OpenWrt image (about 6 MB in size) and navigated to the firmware update page on my router's web interface. Selected the image and it took roughly 5-10 minutes to install. All I had to do was update the default SSIDs and its passwords to match what I had before.