The most straightforward delivery mechanism, hence we’ve picked it to be the first one we support: we’ll create a root folder for you on our secure FTP server, arrange credentials and it’s done - you can start pushing the documents whenever you are ready. Please read the section about best practices, it might give you ideas on how to best organize your content.

To securely exchange data with our system via FTP, follow the steps below:

  1. Send API Key:
    • Provide your API key securely to us (via encrypted email or other secure channels). This will be used for authentication purposes.
  2. SFTP Setup:
    • Once we receive your API key, we will set up the necessary SFTP account and configuration for you.
    • This includes creating an SFTP server and generating your unique FTP credentials (host, username, password, and port).
  3. Receive FTP Credentials:
    • We will securely send you the generated SFTP credentials via email or another secure method.
    • These credentials will allow you to upload and transfer data to our system.
  4. File Upload:
    • Once you receive your FTP credentials, you can begin uploading your files to the designated SFTP folder where they will be automatically processed by Bigdata.

​
Best practises for maximising your FTP use

  1. File management: Implement a good file management system. For each source create a dedicated subfolder inside the SFTP. This allows easy identification and access to files from different sources.

    For example, if you aggregate content from multiple websites, a separate folder for each of them would be cool.

    You, most likely, have some internal IDs to distinguish sources at your end - feel free to use that to organize the folders (on top of providing those values in the respective field in Bigdata Document Format)

  2. Consistent naming conventions: Use descriptive and clear file names that
    describe the content to help with file organization and reduce the risk
    of errors when managing files.

    We process data programmatically but, in case of any issues and needs to debug, humanly readable filenames help a lot - we are sure you know what we talk about ;)