Previous: Step 7 - Dive deeper with BDDF

Next: Step 9 - Deliver historical data

It’s been a long journey but we are almost done - you are now ready to start uploading real-time BDDF documents to the SFTP!

We are working on the ability to process bundled BDDFs - one big json file with multiple documents following BDDF schema. Until it’s ready, please send the documents individually - as you create them one by one, upload them to the SFTP one by one, and our processing pipeline will pick them up.

Please remember that we have provided you with two separate usernames for the SFTP connection - please use the one for real-time to deliver real-time documents. The difference is subtle but affects the way how we process the documents - they will be picked up and processed as soon as they appear on the FTP but, at the same time, they won’t overload our system.

And that’s it - your documents will start appearing on Bigdata.com and you will be able to start interacting with them. However, to make the most of it, you’ll need to deliver the historical archive to us as well, so we perform the backfill and improve your results even more. To see how to do that, please go to the next step.

Next: Step 9 - Deliver historical data