Weeds are not a real classification. Its just a plant that is growing where a human does not want it.
Since this is biased, a slow growing, picky plant likely won’t pose much of a problem and thus won’t be on average considered a “weed” to most.
Its the ones that make you go out into your garden to fight it, that you interact with the most and thus are more likely to refer to as a weed.
But I promise that if a lily started growing in the middle of your vegetable garden, it would be a “weed” just the same.
Latest Answers