Caterpillar and plant IDs

Hello everyone – while wandering around my yard yesterday thinking about everything I want to get done before it freezes, I noticed that one of my plants had several caterpillars on it. I took some photos this morning in an attempt to ID them, but my google-fu fails today. Any idea what species these are? For reference, I’m in Michigan (zone 5).

On one of my bulbs (all the rest were on a plant growing over the bulb):

On the underside of a leaf (this was smaller than the others, I think it’s the same species but I’m not 100% sure):

Three on the underside of a leaf:

Also, I’m really not sure what plant they’re growing on. Any ideas?
This photo is from earlier in the summer, showing the berries:

Photo of the whole plant, taken today (please ignore the mess around it):

Close-up of the leaves, taken today:

Thanks very much! I’m very excited about having plants that attract caterpillars. I’ve only found one so far this summer until yesterday, and that was a black swallowtail caterpillar that came on a dill plant I bought :) I’d been planning to rip this plant out to make room for a privacy hedge along the road, but I think it’s bought itself an extension (though I may still need to move it).