Copy Data and Lookup Activities | Azure Data Factory for Business Central Part 3

Moving data once is easy. Moving only the new records, every time the pipeline runs, is the part that matters. Alex builds the copy data activity that carries records from an Oracle source into a SQL staging table, maps the fields, and swaps the single table for a query that pulls from several tables at once. Then he opens a working pipeline to show how a lookup activity picks out unprocessed records, posts them into Microsoft Dynamics 365 Business Central, and marks them processed so the next run never sends the same record twice. What is covered: 0:00 Creating the copy data activity 0:20 Source and sink datasets 1:30 Mapping fields with import schemas 3:42 Using a query instead of a single table 5:48 The lookup activity 6:22 Processed status and duplicate protection 7:04 Posting to Business Central 7:54 Coming up in Part 4 The copy data activity has two sides: the source, and the destination, which Data Factory calls the sink. Import schemas lines the fields up, matching by name where it can and leaving the rest for you to map by hand. A lookup activity reads rows from the staging database and applies conditions, so a pipeline that runs every hour only picks up what has not been processed yet. We keep a library of pre-built queries for Oracle E-Business Suite and other ERP and CRM systems, and we write new ones to fit the result you need. Talk to the team: https://www.navisiontech.com/contact-... Part 1 covers the solution and how pipelines are monitored. Part 2 covers datasets and connectors. Part 4 covers running the pipeline and reviewing the results. Watch the full series:    • Azure Data Factory for Business Central   Not sure whether your ERP is ready to move? Free ERP Readiness Scorecard: https://erp-readiness-scorecard.verce... Moving off Oracle E-Business Suite? Request your free migration assessment: https://www.navisiontech.com/migrate-... More: https://www.navisiontech.com Navisiontech is a Microsoft Solutions Partner. We implement, migrate and support Microsoft Dynamics 365 Business Central, LS Central and the Power Platform for wholesale distribution and retail. #BusinessCentral #Dynamics365 #AzureDataFactory #ERPMigration #DataMigration