Awesome content!! One question though :)
I have built a streaming pipeline.
Now let's assume, events/files are getting generated every 3 hrs in my source.
How will the data bricks cluster & notebook be invoked every 3 hrs to process the new events? does the cluster should be up and running all the time?