Class PageMetadataConnector

Namespace

Datafication.Connectors.WebConnector.Connectors

Assembly

Datafication.WebConnector.dll

Connector for extracting page metadata from web pages.

public class PageMetadataConnector : WebConnectorBase<PageMetadataConnectorConfiguration>, IDataConnector

Inheritance

object

WebConnectorBase<PageMetadataConnectorConfiguration>

PageMetadataConnector

Implements

IDataConnector

Inherited Members

WebConnectorBase<PageMetadataConnectorConfiguration>.Configuration

WebConnectorBase<PageMetadataConnectorConfiguration>.GetConnectorId()

WebConnectorBase<PageMetadataConnectorConfiguration>.GetStorageDataAsync(IStorageDataBlock, int)

WebConnectorBase<PageMetadataConnectorConfiguration>.FetchDocumentAsync()

WebConnectorBase<PageMetadataConnectorConfiguration>.FetchHtmlAsync()

WebConnectorBase<PageMetadataConnectorConfiguration>.ResolveUrl(string)

WebConnectorBase<PageMetadataConnectorConfiguration>.IsExternalUrl(string)

Extension Methods

DataConnectorExtensions.AsStorageConnector(IDataConnector)

DataConnectorExtensions.GetDataBatchesAsync(IDataConnector, int)

DataConnectorExtensions.GetSourceInfoAsync(IDataConnector)

Remarks

This connector extracts various types of metadata including standard meta tags, Open Graph, Twitter Cards, and JSON-LD structured data. It's useful for SEO analysis, content indexing, and understanding page structure.

Constructors

PageMetadataConnector(PageMetadataConnectorConfiguration)

Initializes a new instance of the PageMetadataConnector class.

public PageMetadataConnector(PageMetadataConnectorConfiguration configuration)

Parameters

configuration PageMetadataConnectorConfiguration

The configuration for this connector.

Exceptions

ArgumentNullException

Thrown when configuration is null.

ArgumentException

Thrown when configuration is invalid.

Methods

GetDataAsync()

Extracts page metadata and returns it as a DataBlock.

public override Task<DataBlock> GetDataAsync()

Returns

Task<DataBlock>

A DataBlock containing the extracted metadata.