Class CssSelectorConnector

Namespace

Datafication.Connectors.WebConnector.Connectors

Assembly

Datafication.WebConnector.dll

A flexible connector for extracting data using CSS selectors.

public class CssSelectorConnector : WebConnectorBase<CssSelectorConnectorConfiguration>, IDataConnector

Inheritance

object

WebConnectorBase<CssSelectorConnectorConfiguration>

CssSelectorConnector

Implements

IDataConnector

Inherited Members

WebConnectorBase<CssSelectorConnectorConfiguration>.Configuration

WebConnectorBase<CssSelectorConnectorConfiguration>.GetConnectorId()

WebConnectorBase<CssSelectorConnectorConfiguration>.GetStorageDataAsync(IStorageDataBlock, int)

WebConnectorBase<CssSelectorConnectorConfiguration>.FetchDocumentAsync()

WebConnectorBase<CssSelectorConnectorConfiguration>.FetchHtmlAsync()

WebConnectorBase<CssSelectorConnectorConfiguration>.ResolveUrl(string)

WebConnectorBase<CssSelectorConnectorConfiguration>.IsExternalUrl(string)

Extension Methods

DataConnectorExtensions.AsStorageConnector(IDataConnector)

DataConnectorExtensions.GetDataBatchesAsync(IDataConnector, int)

DataConnectorExtensions.GetSourceInfoAsync(IDataConnector)

Remarks

This connector allows extracting any structured data from web pages by specifying CSS selectors for the main elements and sub-selectors for extracting specific values. It's ideal for scraping lists of items like products, articles, or search results.

Constructors

CssSelectorConnector(CssSelectorConnectorConfiguration)

Initializes a new instance of the CssSelectorConnector class.

public CssSelectorConnector(CssSelectorConnectorConfiguration configuration)

Parameters

configuration CssSelectorConnectorConfiguration

The configuration for this connector.

Exceptions

ArgumentNullException

Thrown when configuration is null.

ArgumentException

Thrown when configuration is invalid.

Methods

GetDataAsync()

Extracts data using CSS selectors and returns it as a DataBlock.

public override Task<DataBlock> GetDataAsync()

Returns

Task<DataBlock>

A DataBlock containing the extracted data.