Yes, you can.
On the top right of the customer list page, click [Actions > Send SMS]. You can select a template or directly edit the content of the newsletter and send it to the filtered customers.

Note: Make sure that your customer list has mobile phone numbers, otherwise the SMS will not be sent (Status: Send Failed).