Do weeds grow in these patches? Are they constantly wet? Is the soil compacted like concrete there?
There is something wrong with the patches of soil where nothing grows. Possibly some spilt chemical/fuel. A bit of heavily packed earth or similar. Maybe remove a square section of the soil and try placing a patch of turf in the hole and see if it grows OK, then do this to the rest of the areas as you get the urge. There must be something wrong with the soil in those spots, removal, aeration, limimg etc may all be enough to fix the problem. Can you take a foto of the areas?

* * * *

The secret is the soil.