OP - whose FD are you using? Campy? Shimano? SRAM? Band adapter for a braze-on?
You do have a little bit more leeway in your clamping torque since the bike has an aluminum seat tube, but you're right to still exercise caution. Like FBinNY said, the minimum amount of torque that holds the FD in place is the correct amount. Still, here are the "brand manual" recommended values:
- Campagnolo: 7 N.m
- Shimano: 5-7 N.m
- SRAM: 5-7 N.m
Again, those are from tech docs available on their respective websites and that would come in boxes with parts. If 4 N.m were enough to hold a derailleur in place, why go to 5? It is easier on the bolt, the derailleur clamp, and the seat tube...