Chapter 3: Data Import

This chapter provides a comprehensive guide on the various methods available for importing data into the portal, including sales data, staff data, and bulk site creation. It covers the configuration steps required to set up and automate import jobs, ensuring efficient data integration and management. By following the instructions in this chapter, users will be able to streamline their data import processes, maintain data accuracy, and enhance overall operational efficiency.

3.1 Sales Data

3.1.1 One-off Sales Data Import

Click the "Create a Job" button and choose JobType of "1089 - Data Import".

Step 1 - To import Sales Data, select 'Sales Data' for the Data and select 'Microsoft Excel' for the Data Source.

Step 2 -Select Parser Type, the default parser type will be for Site.

Step 3 - Upload the file by clicking the Browse button.

Step 4 - The sample Excel file for the Sales Data can be downloaded from the hyperlink. After downloading the file, edit the data in the Excel file based on the provided format.

Step 5 - An error message will pop out if there are errors in the Excel file, read the error message and make changes to the uploaded file to resolve the problem.

Step 6 - A 'Job Created' message box will pop out once the job has been created successfully.

The data from the Excel file will be updated and the created import job details will be shown on the Import and Export page.

3.1.2 Automate Sales Data Import

Click the "Create a Job" button and choose JobType of "1089 - Data Import". Then, we will be navigated to the page below. 

Step 1 - Select the data (Sales Data).

Step 2 - Select either SFTP or FTP for the data source.

Step 3 - Set up the host for the SFTP/FTP server.

Step 4 - Enter the port number.

Step 5 - The path is where the sales data in the CSV format is stored.

Step 6 - The username required to access the SFTP/FTP server.

Step 7 - The password required to access the SFTP/FTP server.

Step 8 - Select the parser type to import sales data: Area Sales Data, Site Sales Data, or V8 Sales Data. (refer 3.1.2.13.1.2.2 and 3.1.2.3)

Step 9 - This is to get the file pattern (filename) for the output file.

Step 10 - Select the type of transformation for the sales data and click 'Next'.

Step 11 - Now, we can set up the frequency for the job to run. Select Recurring, Frequency, and Next Running Date. After that, click 'Create Job' and the job will be created successfully and import the sales data automatically based on the frequency and interval selected.

3.1.2.1 Parser Type: Default (Site Sales Data) - Automate the import of site sales data

Step 1 - To import Site Sales Data, select 'Default (Site Sales Data)' for the parser type.

Below is the sample file template for Site Sales Data. Ensure the imported file matches the provided Site Sales Data template format exactly.

3.1.2.2 Parser Type: Area Sales Data - Automate the import of area sales data

Step 1 - To import Area Sales Data, select 'Area Sales Data' for the parser type.

Below is the sample file template for Area Sales Data. Ensure the imported file matches the provided Area Sales Data template format exactly.

3.1.2.3 Parser Type: V8 Sales Data - Automate the import of V8 Site sales data
 Step 1: To import V8 Site Sales Data, select 'V8 Sales Data' for the parser type.

Below is the sample file template for V8 Site Sales Data. Ensure the imported file matches the provided V8 Site Sales Data template format exactly.

 

3.2 Third-Party Device Historical Data

3.2.1 One-off Counting Data Import

All steps remain consistent with those outlined in section 3.2.2, 'Automate the Import of Counting Data,' with the exception of the final step, Step 12, which differs.

Step 1 - Select One-off

Step 2 - Select the date range

3.2.2 Automate Counting Data Import

Click the "Create a Job" button and choose JobType of "1089 - Data Import". Then, we will be navigated to the page below. 

Step 1 - Select the data (Counting Data).

Step 2 - Select either SFTP or FTP for the data source.

Step 3 - Select the target device

Step 4 - Set up the host for the SFTP/FTP server.

Step 5 -  Enter the port number.

Step 6 - The path is where the sales data in the CSV format is stored.

Step 7 - The username required to access the SFTP/FTP server.

Step 8 - The password required to access the SFTP/FTP server.

Step 9 - Select the parser type to import counting data: Vivotek, Xovis, or VCount.

Step 10 - This is to get the file pattern (filename) for the output file.

Step 11 - Select the type of transformation for the counting data and click 'Next'.

Step 12 - Now, we can set up the frequency for the job to run. Select Recurring, Frequency, and Next Running Date. After that, click 'Create Job' and the job will be created successfully and import the counting data automatically based on the frequency and interval selected.

3.3 Marketing Data

Stay tuned! The new feature will be ready soon.

3.4 Site Settings Data

3.4.1 New Sites Creation

Step 1 - From the Dashboard, go to 'System' > 'Data' > 'Import & Export'. Then click on 'Create a Job' at the upper right corner of the page.

Step 2 - Create a name for the Job and choose JobType of "1089 - Data Import".

Step 3 - To import New Site Creation Data, select 'New Site Creation' for Data. Then, select 'Microsoft Excel' for Data Source and 'Site' for Parser Type.

Below are the fields found in the page:

Field Description
Data The category of data to be imported to the database.
Parser Type Choose the Parser Type for data import.
Upload File To browse the file to upload for data import. Note that only one file can be uploaded at a time.

Step 4 - A sample template for New Site Creation data can be downloaded via the hyperlink. After downloading the template, edit the data in the Excel file based on the provided format.

Below shows the available columns found in the template:

Category Column Description
Site Info Site Code The Site Code of the new Site.
Site Name Name of the new Site.
Country The country in which the Site is located. Select the country from the drop down list.
Time Zone The time zone in which the Site will be using. Select the time zone from the drop down list.
Advanced Settings Download Bandwidth Limit Sets the download speed limit (kB/s). Set "0" to use default value.
Upload Bandwidth Limit Sets the upload speed limit (kB/s). Set "0" to use default value.
Video Upload Start Time

Sets the hour of the day in which the device will attempt to upload recording(s) (for accuracy tuning purposes) to the server. The device will perform the upload at the 2nd minute of the hour.

For instance, if value is set to "9", then device will start uploading recording(s) at 9.02AM.

This column must have a value, otherwise the entire row is considered invalid.

Video Upload End Time

Sets the hour of the day in which the device will stop upload recording(s) (for accuracy tuning purposes) to the server. The device will stop the upload at the 2nd minute of the hour.

For instance, if value is set to "18", then device will stop uploading recording(s) at 6.02PM.

This column must have a value, otherwise the entire row is considered invalid.

Minimum Visit Duration

Sets the minimum visit duration (in minutes). Set value to "0" to set no limit for this property.

This column must have a value, otherwise the entire row is considered invalid.

Maximum Visit Duration

Sets the maximum visit duration (in minutes). Set value to "0" to set no limit for this property.

This column must have a value, otherwise the entire row is considered invalid.

Latitude

Specifies the latitude of the site. For default value, set it to "0".

This column must have a value, otherwise the entire row is considered invalid.

Longitude

Specifies the longitude of the site. For default value, set it to "0".

This column must have a value, otherwise the entire row is considered invalid.

 

Step 5 - Upload the New Site Creation Excel file by clicking on 'Browse', and selecting your Excel file. If file upload is successful, there will be an indicator stating that the file is uploaded.

Step 6 - Click on 'Next', set up the data transformation as default and data load to One-off, and Click on 'Create Job' to begin the import process.

Step 7 - A popup message would appear indicating that the job has been successfully created.

If there are issues in the import process, a popup will appear with the error message. Read the error message and rectify the errors if needed. Below is an example of an error message.

 

3.4.2 Standard Operating Hours Update

Step 1 - From the Dashboard, go to 'System' > 'Data' > 'Import & Export'. Then click on 'Create a Job' at the upper right corner of the page.

Step 2 - Create a name for the Job and choose JobType of "1089 - Data Import".

Step 3 - To upload Standard Operating Hours, select 'Standard Operating Hours' for Data. For Data Source, select Microsoft Excel. And for Parser Type, you can select either Site Operating Hour or Area Operating Hour.

Below are the fields found in the page:

Field Description
Data The category of data to be imported to the database.
Parser Type Choose the Parser Type for data import. Options available are Site Operating Hour and Area Operating Hour.
Upload File To browse the file to upload for data import. Note that only one file can be uploaded at a time.

Below are the available options for Entity Level:

Entity Level Description
Site To import Standard Operating Hours for Sites.
Area To import Standard Operating Hours for Areas.

 

Step 4 - Both Entity Levels have their own sample Excel template that can be downloaded via their hyperlinks. Edit the data in the Excel file based on the provided format.

Below shows the available columns found in the template:

Column Description
Site Code (For Site Standard Operating Hours Template) Site Code of an existing Site.
Area Code (For Area Standard Operating Hours Template) Area Code of an existing Area found within an existing Site.
Monday (Open/Closed) Indicates if the Site is open or closed at that particular day of the week.
Monday (Start) Specifies the starting hour at that particular day.
Monday (End) Specifies the closing hour at that particular day.

 

Step 5 - Once ready for upload, click on 'Browse' and select the Excel file to upload. If file upload is successful, there will be an indicator stating that the file is uploaded.

Step 6 - Click on 'Next', set up the data transformation as default and data load to One-off, and Click on 'Create Job' to begin the import process.

Step 7 - A popup message would appear indicating that the job has been successfully created.

If there are issues in the import process, a popup will appear with the error message. Read the error message and rectify the errors if needed. Below is an example of an error message.

 

3.4.3 Custom Operating Hours Update

Step 1 - From the Dashboard, go to 'System' > 'Data' > 'Import & Export'. Then click on 'Create a Job' at the upper right corner of the page.

Step 2 - Create a name for the Job and choose JobType of "1089 - Data Import".

Step 3 - To import Custom Operating Hours Data, select 'Custom Operating Hours' for Data. Then, select 'Site' for Entity Level.

Below are the fields found in the page:

Field Description
Data The category of data to be imported to the database.
Parser Type Choose the Parser Type to be involved for data import.
Upload File To browse the file to upload for data import. Note that only one file can be uploaded at a time.

 

Step 4 - A sample template for Custom Operating Hours data can be downloaded via the hyperlink. After downloading the template, edit the data in the Excel file based on the provided format.

Below shows the available columns found in the template:

Column Description
Site Code Site Code of an existing Site.
Date Specifies the date. Format is "YYYY-MM-DD".
Open/Closed Specifies if the site is open or closed on that particular date.
Start Time Specifies the starting hour at that particular date.
End Time Specifies the closing hour at that particular date.
Reason Specifies the reason for the Site to be open or closed on that particular date.

 

Step 5 - Once ready for upload, click on 'Browse' and select the Excel file to upload. If file upload is successful, there will be an indicator stating that the file is uploaded.

Step 6 - Click on 'Next', set up the data transformation as default and data load to One-off, and Click on 'Create Job' to begin the import process.

Step 7 - A popup message would appear indicating that the job has been successfully created.

If there are issues in the import process, a popup will appear with the error message. Read the error message and rectify the errors if needed. Below is an example of an error message.

 

3.5 Area Settings Data

3.5.1 Bulk Area Creation


Step 1 - From the Dashboard, go to 'System' > 'Data' > 'Import & Export'. Then click on 'Create a Job' at the upper right corner of the page.

Step 2 - Create a name for the Job and select '1089 - Data Import' as the Job Type.

 

Step 3 - To import New Area Data, select 'Area Data' for Data. Then, select 'Microsoft Excel' for Data Source.

Below are the fields found in the page:

Field Description
Data The category of data to be imported to the database.
Data Source Source from which data is extracted for processing and analysis.
Upload File To browse the file to upload for data import. Note that only one file can be uploaded at a time.
File Template Download a sample template for Area Data.

 

Step 4 - A sample template for Area Data can be downloaded via the hyperlink. After downloading the template, edit the data in the Excel file based on the provided format.

Below shows the available columns found in the template:

Sheet Column Description
Area Data AreaName Name of the new Area.
AreaCode Code of the new Area.
Description Description of the new Area.
An empty description is acceptable.
AreaGroup Existing Area Group for the new Area.
An empty Area Group is acceptable.
SiteCode The Site Code of an existing Site.

 

Step 5 - Upload the Area Data Excel file by clicking on 'Browse', and selecting your Excel file. If file upload is successful, there will be an indicator stating that the file is uploaded and click 'Next' to continue.

 

Step 6 - Select 'Default Transformation' for Transformation and click 'Next' to continue.

Step 7 - Select 'One-off' for Fashion and click 'Create Job' to create the data import job.

Step 8 - A popup message will shown if the job is created successfully. Otherwise, an error message will be shown.

Additional Information - If there are issues in the import process, a popup will appear with the error message. Read the error message and rectify the errors if needed. Below is an example of an error message.

3.6 User Settings Data

Stay tuned! The new feature will be ready soon.

3.7 Time Table Import (Movie, Class, Church)

Step 1 - From the Dashboard, go to 'System' > 'Data' > 'Import & Export'. Then click on 'Create a Job' at the upper right corner of the page.

Step 2 - Create a name for the Job and choose JobType of "1089 - Data Import".

Step 3 - To import Timetable Data, select 'Session Data' for Data. Then, select 'Microsoft Excel' for Data Source.

Below are the fields found in the page:

Field Description
Data The category of data to be imported to the database.
Parser Type Choose the Parser Type to be involved for data import.
Upload File To browse the file to upload for data import. Note that only one file can be uploaded at a time.

 

Step 4 - A sample template for Session Data can be downloaded via the hyperlink. After downloading the template, edit the data in the Excel file based on the provided format.

Below shows the available columns found in the template:

Column Description
Area Code The area code of an existing Area.
Session Name The name of the session.
Start Date The starting date of the session.
Start Time The starting time of the session.
End Date The ending date of the session.
End Time The ending time of the session.

Step 5 - Once ready for upload, click on 'Browse' and select the Excel file to upload. If file upload is successful, there will be an indicator stating that the file is uploaded.

Step 6 - Click on 'Next', set up the data transformation as default and data load to One-off, and Click on 'Create Job' to begin the import process.

Step 7 - A popup message would appear indicating that the job has been successfully created.

If there are issues in the import process, a popup will appear with the error message. Read the error message and rectify the errors if needed. Below is an example of an error message.

3.8 Staff Data

Step 1 - From the Dashboard, go to 'System' > 'Data' > 'Import & Export'. Then click on 'Create a Job' at the upper right corner of the page.

Step 2 - Create a name for the Job and choose JobType of "1089 - Data Import".

Step 3 - To import Staff Data, select 'Staff Data' for Data. Then, select 'Site' for Entity Level.

Below are the fields found in the page:

Field Description
Data The category of data to be imported to the database.
Parser Type Choose the Parser Type to be involved in data import. 
Upload File To browse the file to upload for data import. Note that only one file can be uploaded at a time.

 

Step 4 - A sample template for Staff data can be downloaded via the hyperlink. After downloading the template, edit the data in the Excel file based on the provided format. Do note that there are 3 sheets within the template.

Below shows the available columns found in the template:

Sheet Column Description
Staff Data Staff ID ID of the staff member.
First Name First name of the staff member.
Last Name Last name of the staff member. This field is optional and can be left blank.
Designer The job position of the staff member.
Wage Hourly wage of the staff member.
Minimum Working Hours Minimum working hours of the staff member.
Maximum Working Hours Maximum working hours of the staff member.
Site Code The Site Code of the Site the staff member works in.
Staff Preference Staff ID ID of the staff member. Select the ID via the dropdown list.
Day Of Week Specifies the day of the week. Can be chosen via dropdown list.
Off Day Specifies if the staff member has an off day on that particular day or not.
Start Time Starting time for the staff member on that particular day.
End Time Ending time for the staff member on that particular day.
Schedule Staff ID ID of the staff member. Select the ID via the dropdown list.
Date Specifies the date. Format is "YYYY-MM-DD".
Start Time Starting time in that particular date.
End Time Ending time in that particular date.
Break Start Time Starting time of lunch break at that particular date.
Break End Time Ending time of lunch break at that particular date.

Step 5 - Once ready for upload, click on 'Browse' and select the Excel file to upload. If file upload is successful, there will be an indicator stating that the file is uploaded.

Step 6 - Click on 'Next', and set up the data transformation as default and data load to One-off, and Click on 'Create Job' to begin the import process.

 

Step 7 - A popup message would appear indicating that the job has been successfully created.

If there are issues in the import process, a popup will appear with the error message. Read the error message and rectify the errors if needed. Below is an example of an error message.

3.9 Bus Route

3.10 ESL Product

Step 1 - Go to 'System' > 'Import & Export' to access the existing import and export list.

Step 2 - To create a new import job for ESL Product, click on 'Create a Job' at the upper right corner of the page, fill in the Job Name and select '1089 - Data Import' as the Job Type, then click the 'Create' button.

Step 3 - On the import page, select 'ESL Product' as the Data and select 'Microsoft Excel' as the Data Source.

Step 4 - A sample template for the ESL data can be downloaded via the hyperlink. After downloading the template, edit the data in the Excel file based on the provided format. Do note that there are 2 sheets within the template.

Below are the available columns found in the template:

Sheet Column Description
Brand and Category Brand The brand of the product
Category The product category
Product ID The ID for the product
Product Name The name of the product
Product Description The product description
Barcode The product barcode, which only contains numbers
QR Link A valid QR link for the product
Unit The quantity of the product
Unit of Measurement The measurement used to describe the quantity of the product
Product Price Product ID The ID for the product 
Currency The type of currency used to calculate the price of the product
Normal Price The normal price of the product
Discounted Price The discounted price of the product, this field can be empty
Apply to Company Level? Should the product price applied to all sites of the company? Select "TRUE" or "FALSE"
Applicable Site(s) The applicable sites for the price, if the previous answer is "FALSE", then write down the site code for the applicable site(s)

Step 5 - Once the file is ready for upload, click on 'Browse' and select the Excel file to upload.

Step 6 - Once the file is uploaded successfully, click on 'Next' button and select 'Default Transformation'. The mode of Data will be on 'One-off' as default, click on 'Create Job' to begin the import process.

Step 8 - If there are issues in the import process, a popup will appear with the error message. Read the error message and rectify the errors if needed.

Step 9 - If no errors are found, a popup message will appear indicating that the job has been successfully created.

Updated on December 9, 2024