SSIS Dynamic Data Import Data Source

The goal of the Dynamic Data Import Data Source is to make it exceedingly simple to import diverse types of data. It uses the xSkrape data parsing engine to let you pull tabular data out of semi-structured sources such as HTML. You're able to set a data source reference (typically a URL) and data is made available as a data flow in your SSIS package. Hints related to data parsing can be provided, with the default behavior covering many scenarios with no additional effort.

Property Name Overview / Default

SQLHeroServerName

A URL reference to your SQL-Hero application server services. Typically this would be "http://servername:46837" where "servername" matches the server on which you installed the SQL-Hero services, with port 46837 being the default port number used by the SQL-Hero installer program.


Default: None (required)

SourceSpec

A reference to the source data to be queried. Can be a reference that is HTTP, HTTPS or FILE based. Can optionally be an expression that supports loading data across multiple requests, as described here.


Default: None (required)

UseLongStrings

When True, strings are treated as the "text" data type, as opposed to varchar(8000) / nvarchar(4000). (When False, strings longer than these limits can produce errors.)


Default: True

UseUnicode

When True, strings are treated as Unicode throughout.


Default: True

UseCache

When True, data can be returned from the in-memory cache (previously retrieved data).


Default: True

LoadHintsXml

Optional configuration data that helps define mapping, data detection hints, etc. This is expressed using XML. More documentation to follow.


Default: None (optional)