Would this be considered less than casual attire?

Your using the term wrong, do you mean business casual? Just "casual" means anything you want to wear. Business casual would be like kakhi's and a polo for a guy. What you have picked out fits business Casual perfectly. You have a cute body by the way.