That can be done just like in the signle palyer version. Using 'foreground <#RRGGBB>' replacing RRGGBB with the hexy code for the colour you want, or typing the name of the colour. You can use '|xn' to keep the line going. Example:
foreground <#AA550F>
msg <You see a |xn>
foreground <blue>
msg <Banana!!!>
Need anything else just ask me.