v4.4.6

Changelog

Bugs

• node.prop('innerHTML') causes Error: Cannot read property "children" from undefined (#932).

v4.4.5

Changelog

There have been no changes to the project after v4.4.3.

v4.4.3

Changelog

Bugs

• WebCrawler doesn't delete old documents matching exclude pattern(s) (#923).
• Webcrawler: HttpHeadersTimeoutException on entrypointUrl causes Webcrawler to delete all documents (#924).
• Webcrawler: normalizedUrls should not contain query and fragment (#926).

v4.4.2

Changelog

There have been no changes to the project after v4.4.1.

v4.4.1

Changelog

Bugs

• WebCrawler: Normalize urls without slash to avoid duplicates (#914).

v4.4.0

Changelog

Features

• WebCrawler: Support noindex data attribute (#911).

v4.3.0

Changelog

Features

• Add displayName string in DocumentType (prefer og:title else title) (#896).
• Filter the Collections list (#594).
• Make collections table sortable on some columns (#905).
• WebCrawler: Support configurable headless browser (url:port) (#899).
• WebCrawler: Use html[lang]/og:locale as document_metadata.language -> stemmingLanguage (#900).
• WebCrawler: Support custom http request headers (#898).
• WebCrawler: Support indexing of Open Graph fields (#895).
• WebCrawler: Add domain and path field from url (#897)

Improvements

• WebCrawler: Add placeholder with example of regexp into the exclude input (#901).

v4.2.0

Changelog

Features

• Toggle to delete repo when deleting collection (#891).

Bugs

• Deleted collections doesn't delete schedule? (#890).

v4.1.0

Changelog

There have been no changes to the project after v4.0.5.

v4.0.5

Changelog

Bugs

• Collections list is flickering while collectors are running (#883).
• Non collector task shows up on the status page (#884).