Install this version using NPM by running: npm install --global https://code.europa.eu/EDPS/website-evidence-collector/-/releases/v3.3.0/downloads/website-evidence-collector.tgz
Updates since last version published on interoperable europe (v2.2.0):
Breaking Changes
- The standalone reporter script has been removed and integrated as a subcommand:
website-evidence-collector reporter - Codebase has been migrated to TypeScript, requiring a build step
- Minimum Node.js version requirement increased to v20 (LTS)
New Features
- Added
--seedoption to make link selection deterministic when using --max • Ne serve command to run WEC through a web interface - Added support for collecting whitelisted hosts from Content-Security-Policy (CSP) headers
- Introduced
--skip-head-requestoption to bypass MIME type checking of links - Updated list of recognised social media sites
- Added a web based user interface through the subcommand:
website-evidence-collector serve
Bug Fixes
- Fixed link extraction failures on certain websites
- Corrected classification of session vs permanent cookies
- Fixed deduplication of links to only consider href attributes
- Prevented rescanning of start page when using --max option
- Browsing history now only shows actually visited sites
- Fixed smaller issues in the contained templates
Improvements
- Refactored cookie and localStorage handling
- Updated to Puppeteer with Chromium 126.0.6478.126
- Addressed npm audit warnings in puppeteer-har dependency
- Optimized network idle handling in tests
- Several chnages in anticipation of a future SaaS version