Unfortunately, no. You can print a document already formatted as labels but you can’t create a new one using Word templates.
If you have the Word desktop application, use the Open in Word command to create and print labels using a Word label template.
Tip: The Office Web Apps are updated all the time with new features. Subscribe to the Office Web Apps blog for the latest news and announcements.