Can you rebuild in an offline installation?

I’m trying to build an offline setup using an SBC, so I’m using sdImage. But after booting, I’d like to change the configuration, such as configuring wifi, by changing the configuration.nix, and rebuilding. Is that possible? Is there anything I have to do configuration-wise for that to work?