Efficiently Read JSON and Create DataFrame

I had a similar challenge. Perhaps you can use a sink function and maybe this thread may provide some help: