Hello!
In order for an animal to be a vertebrate, it must have a backbone. As can clearly be seen in any image of a sponge, it is a highly asymmetrical simple animal and does not have a backbone. Therefore, a breadcrumb sponge is not a vertebrate, or is an invertebrate.
I hope this helped!
