problematic weed or shrub? please help

In a section of my lawn I have an issue with the below pictured plant. It has some characteristics of a shrub but not sure what this is or how to eleminate it. The stalk is shrub like in nature. Small flowers and flower pods at the top of the taller plant. Have pulled them out by the roots but they seem to have come back with a vengance. If anyone could assist me in identifying this plant and how to remove it from my yard for good.