# catalog-service streaming update API ### Example payload (to catalog-service) ``` { "is_delta_rescrape" : true, "updated_at_min" : "Wed Apr 01 2020 00:00:17 GMT+0000 (Coordinated Universal Time)", "callback" : "http://platform-manager.internal.adeptmind.ai:80/shops/1135/statuses/finalizing/update", "notification" : "http://platform-manager.internal.adeptmind.ai:80/shops/eebd6c48-60a8-47ee-8c16-3f74e22b9e72/notifystatus/update", "shop_id" : "eebd6c48-60a8-47ee-8c16-3f74e22b9e72", "shop_name" : "toolusa", "shop_type" : "shopify", "shop_language" : "en", "catalog_endpoint" : "http://platform-manager.internal.adeptmind.ai:80", "priority" : 6, "do_not_archive" : true, "productsCount" : { "count" : "7370" }, "data_version" : "1.0.0", "callback_url" : "http://search-platform.search:4000/callback", "elastic_search_endpoint" : "http://elastic-search.internal.adeptmind.ai:9200", "data_source_shop_id" : "eebd6c48-60a8-47ee-8c16-3f74e22b9e72", "controller_context" : { "task_id" : "5639e4f7ffa74eb7bf81b51e18a44b4c", "from_action" : "71e7394901e347d58229a441b6d494cf", "complete_action" : "79894cc8b1a3498ba44b96a447d6058e" }, "index_alias" : "shopify-toolusa-d3a57aac8ce44b518ae4a2euwqrynpfacfaampma9otgkbg" } ``` ### Explanation: most fields are the same as normal update. Except for: - `"is_delta_rescrape" : true,`: indicates this is for streaming(incremental) update - `"updated_at_min" : "Wed Apr 01 2020 00:00:17 GMT+0000 (Coordinated Universal Time)",` which will be used to retrieve delta catalog from `catalog_endpoint` - `catalog_endpoint` is expected to take `updated_at_min`, and return only updated products ### Example request/response to catalog_endpoint: request back to `catalog endpoint`, url: http://platform-manager.internal.adeptmind.ai/shops/eebd6c48-60a8-47ee-8c16-3f74e22b9e72/catalog/products?normalized=true&updated_at_min=Wed%20Apr%2001%202020%2000:00:17%20GMT+0000%20(Coordinated%20Universal%20Time)&is_delta=true response: ```JSON { "success": true, "data": [ { "content": { "url": "https://toolusa.myshopify.com/products/ta25-10-yt", "tags": [], "brand": "ToolUSA", "image": "https://cdn.shopify.com/s/files/1/2709/6888/products/TA25-10-YT-FF_55487fdb-1cfa-40d5-8a28-212bedfff8dd.jpg?v=1525367559", "sizes": [], "store": "toolusa", "title": "Battery Terminal 10pc (Pack of: 1) - TA25-10-YT", "colors": [], "images": [ "https://cdn.shopify.com/s/files/1/2709/6888/products/TA25-10-YT-FF_55487fdb-1cfa-40d5-8a28-212bedfff8dd.jpg?v=1525367559", "https://cdn.shopify.com/s/files/1/2709/6888/products/TA25-10-YT-F7_f5c015ec-2de4-4622-bc0e-08619ae7e9f6.jpg?v=1525367559" ], "bullets": [ "100% Solid lead terminals-each is equipped with steel nuts and bolts", "dentical for either positive or negative side of battery-use on either side", "You will get an extra tight connection with these terminals to ensure no loss of battery power", "Great for the professional mechanic and the do-it-yourselfer as well" ], "variants": [ { "id": 9033614164011, "sku": "TA25-10-YT", "price": "9.60", "title": "Battery Terminal 10pc (Pack of: 1) - TA25-10-YT", "images": [ "https://cdn.shopify.com/s/files/1/2709/6888/products/TA25-10-YT-FF_55487fdb-1cfa-40d5-8a28-212bedfff8dd.jpg?v=1525367559" ], "barcode": "", "options": { "Battery Terminal 10pc (Pack of: 1) - TA25-10-YT": "Battery Terminal 10pc (Pack of: 1) - TA25-10-YT" }, "position": 1, "sale_price": "9.60", "track_inventory": true, "inventory_quantity": 68 } ], "body_html": "This is a display card of 10 battery terminals. They are made of 100% lead, and have solid steel bolts and nuts to ensure tight connection to the battery cable. They can be used on either positive (+) post or negative (-) post.<li><li>100% Solid lead terminals-each is equipped with steel nuts and bolts</li><li>dentical for either positive or negative side of battery-use on either side</li><li>You will get an extra tight connection with these terminals to ensure no loss of battery power</li><li>Great for the professional mechanic and the do-it-yourselfer as well</li><br><br><img src=\"//cdn.shopify.com/s/files/1/2709/6888/files/Prop65WarningYellowSign_820be785-ab25-4a07-a4f4-5c9d1feaffec_large.jpg?v=1536717491\" width=\"26\" height=\"26\"><a href=\"https://www.toolusa.com/blogs/news/proposition-65\">WARNING</a>Proposition 65 - California residents (please click on hyperlink to the left)", "created_at": "2018-01-19T00:44:27.000Z", "normalized": false, "product_id": "ta25-10-yt", "topologies": [ "Tools" ], "updated_at": "2020-01-30T18:14:43.000Z", "description": "This is a display card of 10 battery terminals. They are made of 100% lead, and have solid steel bolts and nuts to ensure tight connection to the battery cable. They can be used on either positive (+) post or negative (-) post.100% Solid lead terminals-each is equipped with steel nuts and boltsdentical for either positive or negative side of battery-use on either sideYou will get an extra tight connection with these terminals to ensure no loss of battery powerGreat for the professional mechanic and the do-it-yourselfer as wellWARNINGProposition 65 - California residents (please click on hyperlink to the left)This is a display card of 10 battery terminals. They are made of 100% lead, and have solid steel bolts and nuts to ensure tight connection to the battery cable. They can be used on either positive (+) post or negative (-) post.100% Solid lead terminals-each is equipped with steel nuts and boltsdentical for either positive or negative side of battery-use on either sideYou will get an extra tight connection with these terminals to ensure no loss of battery powerGreat for the professional mechanic and the do-it-yourselfer as wellWARNINGProposition 65 - California residents (please click on hyperlink to the left)WARNING", "product_type": "Tools", "published_at": "2018-01-19T00:44:25.000Z", "document_type": "product", "shopify_product_id": 820772831275 }, "status": "unchanged" }, ... ] } ```