David Evans replied to a different blog post of mine and pointed out that the product team has done a very large amount of work to make things work quicker through the CRM SDK and shared the video below. I have heard David Cai tout how he has seen well over 200 rows per second in SSIS though his product. I thought this was AMAZING considering I was used to Scribe and if I got 15 records per second I was pretty dang happy. I could run more than one thread at once though if I could chunk up the job properly.
In the video below I was blown away. Literally you will see using the maximum threads per second against CRM Online which hasn't always been known for being the most performant depending on where in the country you are accessing it from. You will see here shortly after 3:10 in the video where in a matter of seconds the process they run revs up to OVER 650 ROWS PER SECOND! They are running 16 threads, but now I have a new appreciation for just what the SDK is capable of handling if you hit it just the right way.
Check out the video here and just skip to 3:10-ish to see them start running first with one thread and then with 16. WOW!!! http://player.vimeo.com/video/74729381
- I hope you enjoy this video!