Importing products from Shopify
If you have an integration configured with Shopify, you can run a one time product import action. This will import all of your Shopify product data into Endless. To run this bulk import, navigate to Integrations and use the actions menu.
How the import tool works?
The Shopify product import tool processes each product variant as a separate product in Endless. For each variant, the following rules apply:
- Each variant becomes its own product in Endless
- The product name is constructed by combining the Shopify product title with the variant title
- Every variant must have a unique SKU assigned in Shopify to be imported
- If a variant is missing a SKU, it will be skipped during import
Shopify Product variants with the following attributes will also be skipped during import:
- Gift cards
- Shopify Product variants that do not require shipping
- Shopify Product variants with a Draft or Archive status.
- Shopify Product variants that meet the skip_by_tag or skip_by_type criteria as entered through the app.
Understanding which data fields are mapped
Which fields are populated
When products are imported from Shopify into Endless, the following fields are populated:
Field | Description | Source |
---|---|---|
product_id | Unique identifier for the product | Generated UUID |
name | Product title | Shopify product title |
brand_id | Brand identifier | From Shopify integration settings |
sku | Stock keeping unit | From Shopify variant |
upc | Universal product code | From Shopify barcode |
price | Product price | From Shopify variant price |
status | Product status | Set to 'active' |
weight | Product weight | Converted from Shopify's weight measurement |
product_type | Type of product | From Shopify product type |
description | Product description | From Shopify product's HTML description |
source | Source of the product | Set to 'SHOPIFY' |
source_id | Source system identifier | Shopify variant ID |
source_updated_at | Last update timestamp | Shopify variant's updated timestamp |
supplier | Product supplier | From Shopify product vendor |
Product images
Product images including featured image from Shopify
Additional Import Details
Products are imported in batches of 50 at a time. If a last import timestamp exists in the integration logs, only products created after that timestamp will be imported. The import process is idempotent - existing products with the same SKU will be skipped.
- Duplicate Prevention: The system checks for duplicate SKUs before importing
- Timestamp Tracking: Updates the last import and sync timestamps in the Shopify integration settings
- Warehouse Management: Creates warehouses if they don't exist for Shopify locations
- External Data: Sets up external product data to maintain the connection with Shopify
Importing a single product
You can also import a single product at a time. To import a single product, open the integration and use the Import Product action. You will be prompted to enter the product ID and should use the product ID that is found in the URL of your Shopify admin.
Processing Shopify Orders
Endless provides a robust system for processing orders from Shopify through a combination of real-time webhooks and scheduled reconciliation jobs. This dual approach ensures that no orders are missed while maintaining system reliability.
How Order Processing Works
Real-time Webhook Processing
When an order is created or updated in Shopify, our system receives webhooks for the following events:
- ORDERS_CREATE: When a new order is created
- ORDERS_PAID: When an order is paid
- ORDERS_FULFILLED: When an order is fulfilled
- ORDERS_UPDATED: When an order is updated
Each webhook is processed through the following steps:
- Webhook Verification: The system verifies the webhook's authenticity using Shopify's HMAC signature
- Order Processing: Based on the webhook type, the system:
- Creates new orders
- Updates order status
- Processes payments
- Handles fulfillment updates
Scheduled Reconciliation
To ensure no orders are missed, we run an hourly check to check for new orders. This job:
- Includes safeguards against duplicate processing
- Handles pagination for large order volumes