Not on your iPhone or iPad.
This version doesn’t include all of the formatting features available in other version of OneNote.
You can change page color, but to change other colors, do the following:
To change notebook and section color, use OneNote for Windows.
To change only section color, sign in to OneDrive and use the OneNote Online.