{"id":71630,"date":"2016-07-19T16:44:41","date_gmt":"2016-07-19T16:44:41","guid":{"rendered":"http:\/\/beringer.net\/?p=71630"},"modified":"2023-12-18T10:20:44","modified_gmt":"2023-12-18T10:20:44","slug":"solving-data-migration-challenges-scribe-online","status":"publish","type":"post","link":"https:\/\/www.beringer.net\/beringerblog\/solving-data-migration-challenges-scribe-online\/","title":{"rendered":"Solving Data Migration Challenges With Scribe Online"},"content":{"rendered":"<p><img decoding=\"async\" class=\"wp-image-71636 alignleft\" src=\"\/wp-content\/uploads\/2016\/07\/binary-1414315_960_720-768x512.jpg\" \/>If you&#8217;ve ever been tasked with migrating data, then you know there are a wide variety of challenges that you must overcome. I&#8217;ve migrated data to <a href=\"https:\/\/www.microsoft.com\/en-us\/dynamics\/crm.aspx\">Microsoft Dynamics CRM<\/a> from many disparate systems in my career, which typically involves pulling data from a live system. The key word is &#8220;live&#8221;, so you need to tread lightly when querying millions of rows of data. It is very easy to negatively impact performance, which will instantly translate into end user complaints.<\/p>\n<p>My best practice is to simply run the data migration during off hours, when the end users are not in the system. I will typically schedule the data migration to launch on a Friday afternoon after everyone has left for the day. While most migration tools allow you to control when to start your migration, they do not account for a hard stop if all of your data is not migrated when the end users come back on Monday morning. Prepare for a whole new onslaught of performance complaints!<\/p>\n<p>I find <a href=\"http:\/\/www.scribesoft.com\/products\/scribe-online\/\">Scribe Online<\/a> is a great cloud based platform to migrate and transform data between systems, especially when working with Microsoft Dynamics CRM. This product has a very intuitive interface, and can be configured to handle this scenario. Are you ready to see how it&#8217;s done?<\/p>\n<p>First, let&#8217;s start with a simple map that queries SQL data. It will loop thru the data source and create or update an account in CRM. Take a closer look, and you will see that I have a conditional block that will check to see if it is 7am on a Monday morning. If so, it will execute a Map Exit block, which will stop the data migration.<\/p>\n<p><a href=\"\/wp-content\/uploads\/2016\/07\/2-262x300.png\"><img decoding=\"async\" class=\"alignnone wp-image-71632\" src=\"\/wp-content\/uploads\/2016\/07\/2-262x300.png\" \/><\/a><\/p>\n<p>Dive into the conditional block and you will see the logic used to determine if it is 7am on Monday. Since I don&#8217;t know the local time zone of the server, I&#8217;m going to focus on Coordinated Universal Time (UTC).<\/p>\n<p><img decoding=\"async\" class=\"alignnone wp-image-71631\" src=\"\/wp-content\/uploads\/2016\/07\/1-300x154.png\" \/><\/p>\n<p>You can even customize the error message in your Map Exit block, which is displayed in the execution history.<\/p>\n<p><img decoding=\"async\" class=\"alignnone wp-image-71633\" src=\"\/wp-content\/uploads\/2016\/07\/3-768x84.png\" \/><\/p>\n<p>A well designed query block should always focus on a date field. When you resume your data migration, you will see it pick up right where it left off.<\/p>\n<p><img decoding=\"async\" class=\"alignnone wp-image-71634\" src=\"\/wp-content\/uploads\/2016\/07\/4-768x96.png\" \/><\/p>\n<p>Beringer is always here to provide expert knowledge in topics like these and has deep experience integrating data. Can we help migrate you to Microsoft Dynamics CRM?<\/p>\n<p><a href=\"\/contact-us\/\">Please reach out to us today<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>If you&#8217;ve ever been tasked with migrating data, then you know there are a wide variety of challenges that you must overcome. I&#8217;ve migrated data to <a href=\"https:\/\/www.microsoft.com\/en-us\/dynamics\/crm.aspx\">Microsoft Dynamics CRM<\/a> from many disparate systems in my career, which typically involves pulling data from a live system. The key word is &#8220;live&#8221;, so you need to tread lightly when querying millions of rows of data. It is very easy to negatively impact performance, which will instantly translate into end user complaints.<\/p>\n","protected":false},"author":20,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"inline_featured_image":false,"footnotes":""},"categories":[135,136],"tags":[64,613,157,152],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v22.5 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Solving Data Migration Challenges With Scribe Online | - NJ, PA, DE, MD | Beringer Technology Group<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.beringer.net\/beringerblog\/solving-data-migration-challenges-scribe-online\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Solving Data Migration Challenges With Scribe Online | - NJ, PA, DE, MD | Beringer Technology Group\" \/>\n<meta property=\"og:description\" content=\"If you&#039;ve ever been tasked with migrating data, then you know there are a wide variety of challenges that you must overcome. I&#039;ve migrated data to Microsoft Dynamics CRM from many disparate systems in my career, which typically involves pulling data from a live system. The key word is &quot;live&quot;, so you need to tread lightly when querying millions of rows of data. It is very easy to negatively impact performance, which will instantly translate into end user complaints.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.beringer.net\/beringerblog\/solving-data-migration-challenges-scribe-online\/\" \/>\n<meta property=\"og:site_name\" content=\"Beringer Technology Group\" \/>\n<meta property=\"article:published_time\" content=\"2016-07-19T16:44:41+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-12-18T10:20:44+00:00\" \/>\n<meta name=\"author\" content=\"theProfessor\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"theProfessor\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.beringer.net\/beringerblog\/solving-data-migration-challenges-scribe-online\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.beringer.net\/beringerblog\/solving-data-migration-challenges-scribe-online\/\"},\"author\":{\"name\":\"theProfessor\",\"@id\":\"https:\/\/www.beringer.net\/#\/schema\/person\/29d47ebf924d67cef0c83ee7e73da1c5\"},\"headline\":\"Solving Data Migration Challenges With Scribe Online\",\"datePublished\":\"2016-07-19T16:44:41+00:00\",\"dateModified\":\"2023-12-18T10:20:44+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.beringer.net\/beringerblog\/solving-data-migration-challenges-scribe-online\/\"},\"wordCount\":411,\"publisher\":{\"@id\":\"https:\/\/www.beringer.net\/#organization\"},\"keywords\":[\"Cloud Computing\",\"Data Migration\",\"Data Sync Cloud\",\"Microsoft Dynamics CRM\"],\"articleSection\":[\"Cloud Computing\",\"Microsoft Dynamics CRM\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.beringer.net\/beringerblog\/solving-data-migration-challenges-scribe-online\/\",\"url\":\"https:\/\/www.beringer.net\/beringerblog\/solving-data-migration-challenges-scribe-online\/\",\"name\":\"Solving Data Migration Challenges With Scribe Online | - NJ, PA, DE, MD | Beringer Technology Group\",\"isPartOf\":{\"@id\":\"https:\/\/www.beringer.net\/#website\"},\"datePublished\":\"2016-07-19T16:44:41+00:00\",\"dateModified\":\"2023-12-18T10:20:44+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.beringer.net\/beringerblog\/solving-data-migration-challenges-scribe-online\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.beringer.net\/beringerblog\/solving-data-migration-challenges-scribe-online\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.beringer.net\/beringerblog\/solving-data-migration-challenges-scribe-online\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.beringer.net\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Solving Data Migration Challenges With Scribe Online\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.beringer.net\/#website\",\"url\":\"https:\/\/www.beringer.net\/\",\"name\":\"Beringer Technology Group\",\"description\":\"Performance. Integrity. Trust.\",\"publisher\":{\"@id\":\"https:\/\/www.beringer.net\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.beringer.net\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.beringer.net\/#organization\",\"name\":\"Beringer Technology Group\",\"url\":\"https:\/\/www.beringer.net\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.beringer.net\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.beringer.net\/wp-content\/uploads\/2023\/12\/beringer-technology-group.jpeg\",\"contentUrl\":\"https:\/\/www.beringer.net\/wp-content\/uploads\/2023\/12\/beringer-technology-group.jpeg\",\"width\":200,\"height\":200,\"caption\":\"Beringer Technology Group\"},\"image\":{\"@id\":\"https:\/\/www.beringer.net\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.beringer.net\/#\/schema\/person\/29d47ebf924d67cef0c83ee7e73da1c5\",\"name\":\"theProfessor\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.beringer.net\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/d7484aed60e44ac6010e4b4752e468fc?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/d7484aed60e44ac6010e4b4752e468fc?s=96&d=mm&r=g\",\"caption\":\"theProfessor\"},\"description\":\"Rob is the CTO of Beringer Technology Group, and focuses his efforts on software development, cloud engineering, team mentoring and strategic technical direction. Rob has worked with Beringer since 2005, and has influenced every department from Development, Security, Implementation, Support and Sales. Rob graduated with his MBA from Rowan University in 2012, earned his Bachelors of Computer Science in 1997, and is current with several Microsoft technical certifications. Rob is very active, and loves to mountain bike, weight train, cook and hike with his dog pack.\",\"url\":\"https:\/\/www.beringer.net\/beringerblog\/author\/theprofessor\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Solving Data Migration Challenges With Scribe Online | - NJ, PA, DE, MD | Beringer Technology Group","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.beringer.net\/beringerblog\/solving-data-migration-challenges-scribe-online\/","og_locale":"en_US","og_type":"article","og_title":"Solving Data Migration Challenges With Scribe Online | - NJ, PA, DE, MD | Beringer Technology Group","og_description":"If you've ever been tasked with migrating data, then you know there are a wide variety of challenges that you must overcome. I've migrated data to Microsoft Dynamics CRM from many disparate systems in my career, which typically involves pulling data from a live system. The key word is \"live\", so you need to tread lightly when querying millions of rows of data. It is very easy to negatively impact performance, which will instantly translate into end user complaints.","og_url":"https:\/\/www.beringer.net\/beringerblog\/solving-data-migration-challenges-scribe-online\/","og_site_name":"Beringer Technology Group","article_published_time":"2016-07-19T16:44:41+00:00","article_modified_time":"2023-12-18T10:20:44+00:00","author":"theProfessor","twitter_card":"summary_large_image","twitter_misc":{"Written by":"theProfessor","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.beringer.net\/beringerblog\/solving-data-migration-challenges-scribe-online\/#article","isPartOf":{"@id":"https:\/\/www.beringer.net\/beringerblog\/solving-data-migration-challenges-scribe-online\/"},"author":{"name":"theProfessor","@id":"https:\/\/www.beringer.net\/#\/schema\/person\/29d47ebf924d67cef0c83ee7e73da1c5"},"headline":"Solving Data Migration Challenges With Scribe Online","datePublished":"2016-07-19T16:44:41+00:00","dateModified":"2023-12-18T10:20:44+00:00","mainEntityOfPage":{"@id":"https:\/\/www.beringer.net\/beringerblog\/solving-data-migration-challenges-scribe-online\/"},"wordCount":411,"publisher":{"@id":"https:\/\/www.beringer.net\/#organization"},"keywords":["Cloud Computing","Data Migration","Data Sync Cloud","Microsoft Dynamics CRM"],"articleSection":["Cloud Computing","Microsoft Dynamics CRM"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.beringer.net\/beringerblog\/solving-data-migration-challenges-scribe-online\/","url":"https:\/\/www.beringer.net\/beringerblog\/solving-data-migration-challenges-scribe-online\/","name":"Solving Data Migration Challenges With Scribe Online | - NJ, PA, DE, MD | Beringer Technology Group","isPartOf":{"@id":"https:\/\/www.beringer.net\/#website"},"datePublished":"2016-07-19T16:44:41+00:00","dateModified":"2023-12-18T10:20:44+00:00","breadcrumb":{"@id":"https:\/\/www.beringer.net\/beringerblog\/solving-data-migration-challenges-scribe-online\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.beringer.net\/beringerblog\/solving-data-migration-challenges-scribe-online\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.beringer.net\/beringerblog\/solving-data-migration-challenges-scribe-online\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.beringer.net\/"},{"@type":"ListItem","position":2,"name":"Solving Data Migration Challenges With Scribe Online"}]},{"@type":"WebSite","@id":"https:\/\/www.beringer.net\/#website","url":"https:\/\/www.beringer.net\/","name":"Beringer Technology Group","description":"Performance. Integrity. Trust.","publisher":{"@id":"https:\/\/www.beringer.net\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.beringer.net\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.beringer.net\/#organization","name":"Beringer Technology Group","url":"https:\/\/www.beringer.net\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.beringer.net\/#\/schema\/logo\/image\/","url":"https:\/\/www.beringer.net\/wp-content\/uploads\/2023\/12\/beringer-technology-group.jpeg","contentUrl":"https:\/\/www.beringer.net\/wp-content\/uploads\/2023\/12\/beringer-technology-group.jpeg","width":200,"height":200,"caption":"Beringer Technology Group"},"image":{"@id":"https:\/\/www.beringer.net\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/www.beringer.net\/#\/schema\/person\/29d47ebf924d67cef0c83ee7e73da1c5","name":"theProfessor","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.beringer.net\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/d7484aed60e44ac6010e4b4752e468fc?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/d7484aed60e44ac6010e4b4752e468fc?s=96&d=mm&r=g","caption":"theProfessor"},"description":"Rob is the CTO of Beringer Technology Group, and focuses his efforts on software development, cloud engineering, team mentoring and strategic technical direction. Rob has worked with Beringer since 2005, and has influenced every department from Development, Security, Implementation, Support and Sales. Rob graduated with his MBA from Rowan University in 2012, earned his Bachelors of Computer Science in 1997, and is current with several Microsoft technical certifications. Rob is very active, and loves to mountain bike, weight train, cook and hike with his dog pack.","url":"https:\/\/www.beringer.net\/beringerblog\/author\/theprofessor\/"}]}},"_links":{"self":[{"href":"https:\/\/www.beringer.net\/wp-json\/wp\/v2\/posts\/71630"}],"collection":[{"href":"https:\/\/www.beringer.net\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.beringer.net\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.beringer.net\/wp-json\/wp\/v2\/users\/20"}],"replies":[{"embeddable":true,"href":"https:\/\/www.beringer.net\/wp-json\/wp\/v2\/comments?post=71630"}],"version-history":[{"count":1,"href":"https:\/\/www.beringer.net\/wp-json\/wp\/v2\/posts\/71630\/revisions"}],"predecessor-version":[{"id":97390,"href":"https:\/\/www.beringer.net\/wp-json\/wp\/v2\/posts\/71630\/revisions\/97390"}],"wp:attachment":[{"href":"https:\/\/www.beringer.net\/wp-json\/wp\/v2\/media?parent=71630"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.beringer.net\/wp-json\/wp\/v2\/categories?post=71630"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.beringer.net\/wp-json\/wp\/v2\/tags?post=71630"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}