Flute Sleeve Dress with Embroidered Collar - Why Clothing Size Doesn't Matter

Dress: here. (Alternative here) | Earrings: Dior (alternative here) Lip Colour: here.
- - -  I'm fairly certain I owned an almost identical dress aged 4. In fact, I regularly see little people clothes and wish they came in my size (or seriously wondered if I could squeeze myself into 'age 11-12' - answer: lol no.) So when I saw this insanely adorable little piece I ordered it in a frantic, mad excitement. It makes me feel like a 4 year old milkmaid and that is absolutely fine with me. Every detail is exquisite; from the intricately embroidered cut-out collar and bib to the flute sleeves, complete with little bows. 
A little heads up; this comes up rather small. I find that the fit of Dahlia's clothes to lean more towards teeny-tiny bird-like creatures, which I am not. (I once ordered a pinafore dress from them which literally did not even cover my entire bum..) Their clothes come in sizes Small, Medium and Large -  I'm 5'9 and generally a size 10 in dresses, and I'm wearing a Large. I hate to admit that initially, a small part of me didn't like the fact that I was wearing a size Large, but then the more prominent, more reasonable side of my brain took over and I reiterated to myself what I've often told other people; the label in an item of clothing literally does not matter. I cannot stress it enough. I know people use the word literally so often these days that it's almost lost all meaning, but it literally doesn't matter. The cut/measurements of clothing varies hugely from store to store. As long as it fits and it looks good, no one knows what size you're wearing and more importantly, no one actually cares. (And of course, it goes without saying but I'll say it anyway - a larger size does not necessarily equate to 'less attractive'.)
What do you think? Do you care what the labels in your clothes say?