Define Sources

Let's take a look at what sources we may use and create the configuration, credentials, and refreshes we need to use.

• Do we want to put connection strings in the appsettings.json and read them?

  • Create the json sections and keys

  • Optionally, encrypt them

• Do we want to implement a property loader?

  • See Property Loaders

• Do we communicate with anything on the web?

  • See Restsharp Authenticators and Credential Management.

  • Read all about the HTTP(S) communication and extensions here.

• Do we need to define additional services to dependency inject?

  • See the Core Module: Application.

• Do we have any important information we need to keep in synchronized state like pull dates, offsets or delta keys?

  • Define a Watermark for all basic data types

  • Or define a custom FileSync to track a rich data object

  • Look at the Limiter for resource restricted calls.

• Do you need to have things run on a timer?

  • Check out the CRON thread.

  • Have a scheduler pick up items from a remote source, like a database.

  • Have a network of Sync Agent's communicating and performing refresh tasks.

• Do you need to coordinate a list of steps and NEVER have a failure cause the process to break?

  • Create a Transaction Coordinator.

• Talk with third parties:

  • Salesforce

  • Microsoft Graph

  • DataVerse

  • SmartSheets

  • Azure Service Bus

• Do you have any instances of:

  • Testing Network Connectivity?

  • Sorting dependencies?

  • Working in Parallel?

  • Sending notifications?

  • Run logic through a behavior tree?

  • Sort and query hierarchical data?