Are you using separate objects for each bristle - or are you using a heightfield?

Here is an test I did some time ago using HFs - one for all of the white bristles & one for all of the blue bristles.