Platform documentationDatasetsAPIs
Platform documentation
Log in to Seven Bridges Platform

Import from an FTP/HTTP(S) server

Suggest Edits

šŸ“˜

Note

This upload method can also be used with (pre)signed URLs from cloud storage services such as AWS S3 and Google Cloud Storage.

In addition, it is not possible to import files from an FTP/HTTP link which has a redirection.

Overview

The FTP/HTTP(S) import method copies files to the Platform from the following sources:

  • Public or private FTP server.
  • Public or private HTTP(S) server.
  • Cloud storage such as AWS S3 or Google Cloud Storage, using presigned URLs. Unlike Connect Cloud Storage that attaches your cloud storage as a volume to the Platform, this will copy the files to the Platform's storage right away, and may cause file transfer costs if the files that are being transferred and the Platform project they are transferred to are in different locations.

This method allows you to add a single file, a directory (FTP), or a list of URLs (HTTP(S) or pre-signed URLs). They are uploaded in the same job. Additionally, active uploadsĀ run in the background on the Seven Bridges Platform and do not depend on your local network speed. This allows you to multitask as your files are added to your project.

Use the import feature

  1. Navigate to the project to which you're importing files.
  2. Select the Files tab.
  3. Click Add Files > FTP/HTTP, as shown below.
512
  1. Type in or paste the URL of the file(s) you want to add. Or, click Browse to navigate to a text file on your computer containing the URLs.
  2. (Optional) Enter tags in the Add tags box. This makes it easier to visually identify and organize files. Separate tags with commas or by hitting the return key. All tags which are already in the selected project are autosuggested in the drop-down menu. Learn more about tagging your files.

  1. Resolve naming conflicts - Select the action to be taken if a naming conflict occurs. Available actions are Skip (default option), Auto-rename and Overwrite. Read more about naming conflicts resolution below.

šŸ“˜

  • Allowed characters in file names are all alphanumerics and special characters except slash (/). File names canā€™t be longer than 255 characters.
  • Allowed characters in folder names are a-z, A-Z, 0-9, and special characters (_), (-), and (.). Folder names canā€™t be longer than 255 characters.
  1. Preserve folder structure - If enabled, the imported items will be an exact mirror of the file/folder structure on the server. Otherwise, the items will be "flattened" when imported from the server, i.e. only files will be imported, with no folder structure.
  2. Click Import to start the upload.
  3. Click Import more files if you have more URLs to import. If you're finished uploading, click Done to close the dialog.

During upload

Track the import progress under the import status icon on the right-hand side of the main menu.

519

When the upload completes, review your files in the Files tab of your project.

Accessing password-protected FTP and HTTP(S) servers

The FTP/HTTP(S) tool can submit usernames and passwords to the server. To do this, you should include the username and password in the links that you pass to the tool, using the standard HTTP syntax: http://username:[email protected]/sample/.

Pasting in a link formatted in this way will attempt to authenticate with the server example.org using the credentials username and password and then try to fetch everything that is hosted under the directory/sample/.

Resolving naming conflicts

Naming conflicts happen when you try to import an item (file or folder) from an FTP/HTTP server to a project's root folder or subfolder, where an item with the same name already exists. The list below illustrates the possible cases of naming conflicts and the way they are resolved depending on which option is selected in the Resolve naming conflicts dropdown:

  1. Importing a file that has the same name as an existing file at the destination path:
    • Skip (default): The file won't be imported. This is the default behavior.
    • Auto-rename: The imported file will be automatically renamed by adding a prefix (underscore and serial number).
    • Overwrite: The existing file will be overwritten by the file imported from the server.
  2. Importing a file that has the same name as an existing folder at the destination path:
    • Skip (default): The file won't be imported.
    • Auto-rename: The imported file will be automatically renamed by adding a prefix (underscore and serial number).
    • Overwrite: The file won't be imported.
  3. Importing a folder that has the same name as an existing folder at the destination path:
    • The content of the folder that is being imported will be merged with the content of the existing folder, regardless of the option selected in the Resolve naming conflicts dropdown. Any conflicts related to files within the folders will be handled according to file naming conflict resolution rules described above.
  4. Importing a folder that has the same name as an existing file at the destination path:
    • The folder and the files it contains won't be imported. This is the default, non-configurable behavior, regardless of the option selected in the Resolve naming conflicts dropdown.

The following table illustrates the entire naming conflict resolution mechanism:

Check import status

To check the progress of your import, click the notification bell in the upper right corner.

Click Open activity center to see more detailed information about each of the imports.

Click on an import in the left pane, and the right pane will show detailed information about that import including:

  • FTP/HTTP link - the link the file was imported from

  • Status - the status of the import for each of the files; in case of a failed import, the following information will also be available:

    • Error Code - click to see detailed information about the error code
    • Error Message - the description of the error

Troubleshooting

If the Seven Bridges FTP/HTTP(S) import feature fails to upload all the files whose links you provided, please retry by providing shorter lists of links.

Resources

Updated 11 months ago