How to Automate CSV uploads from FTP and Auto Map the data

18.11.2016 - 6 minutes read

DSYNC is a bidirectional integration platform and can be used to pull data from an FTP or push data to the FTP in a variety of formats. If you are a developer sign up for our FREE developer account to test our capabilities.

New features of our platform include

TWO way connectivity with FTP

Set up automatic email notification for your data SYNC jobs

Set up an RSS feed that contains prices, inventory, stock data

Uploading a CSV from an FTP is nothing new, however when you can automatically map data to multiple applications with multiple endpoints that is when it gets exciting!  The team at DSYNC have prepared the below tutorial and data mapping guide to help customers with the setup and the process. Data synchronization is what DSYNC is best at.  The below steps show how jobs can be scheduled to run at the chosen time intervals. Listed below please find the step by step documentation.

In this tutorial we will be accessing a CSV from an FTP location and uploading it to the DSYNC system. This process is designed for users who would like to fetch a CSV from an FTP location, automatically map the data and then push to a desired location. In this tutorial we will be setting up the DSYNC dashboard for the job to run, creating a map for the upload automation and setting the schedule for the automation process. Please let the DSYNC team know if you have challenges we would be happy to assist.

Step 1. Add a new job to run

To begin we will need to add a new system to the DSYNC dashboard. The first step is to select “System” then select “add new blank”

Add new system

Step 2. A pop up box will appear asking to add a new system, proceed to name the system.

This will add a new system onto the DSYNC dashboard

Step 3. Now that you have created a new system we will need to add an “Endpoint” to the system. On the right hand side select “add an endpoint”

Adding an endpoint DSYNC

Step 4. An endpoint pop up box will appear

Create a name for your endpoint

A description is optional

Within the “Type” section select “SOURCE”

In the connector field select “FTP” then select “OKEndpoint section

Step 5. When the FTP job is selected on the right hand side details will appear of where to access the CSV file. In this location we will need to apply the settings for the FTP.

Step 6. Enter in the FTP details

The details required will be “Host”, “Username”, “Password”, “Port” and “Path”. Proceed to enter the FTP details then select “Save the details”.  Within the “path” section you can specify a file or grab all of the files in the directory.

FTP details DSYNC

Step 7. Create a data layout

Click on the FTP job and then select “New” under create a data layout.

The data layout pop up section will appear. The reason why we create a data layout is to format the columns and rows for the upload.

As we are uploading a CSV select “CSV”

We are going to upload a file by selecting the “File” icon

Drag and drop the CSV into the blue section then select “OK” confirm all of the data is there then select “Save”

CSV data layout

Step 8. Create a relation

A relation helps you to connect one point to another. Select and highlight the FTP job and then on the right hand side select “Create Relation”

Click on an “Endpoint” the end point is where you would like the FTP or CSV job to be sent.

Create a relation and link DSYNC

Step 9. Name your job

Step 10. Create the map

A map will help you to drag and drop fields you would like to correspond. In this case we will be creating our own map. To create our own map simply click on the line between the FTP job and the endpoint. Create a name and a description for the map.

Create a map DSYNC

Step 11. Edit the map

Once you have named your map you can edit the fields by selecting “Edit” on the right hand column. Edit the map by dragging and dropping the field names you would like mapped. Proceed to save the map.

Mapping engine DSYNC

Step 12.  Set the time the job should run

Select the line in between the FTP job and the endpoint. On the right hand side there is a Schedule. Within the schedule you can select “Recurring”. Jobs can be run at selected times minute, hour, day, month and year.  After selecting the times the job should run, save the schedule.

Schedule the jobs to run DSYNC

This completes the CSV upload / automated FTP process, the process is now complete and is ready for testing.

Would you like to learn more about DSYNC’s cloud integration services? Or is there a specific connector you would like our team to add to our growing list of ready built applications? Our team is standing by to help out.




Tags: , , , , , , , , , , , , , , , ,