How can I specify entries for array elements individually

Perhaps something like this: https://www.mockaroo.com/schemas/50857

It always generates both a simple value and an object, then randomly switches between them for the actual value. Naming a field starting with "__" hides it from the output.