Preparation for data cleaning and reprocessing

Relative tickets:

FEATURE: MET-1948_no_zero_facet_codes_generated
FEATURE: MET-1894_allow_filtering_on_all_executions
FEATURE: MET-1625_Normalization_of_xml_lang_attributes
FEATURE: MET-1762_remove_mocked_periodic_loop_from_executor
FEATURE: MET-1811_dashboard_executions_improvements
FEATURE: MET-1600_cleanup_dependencies_for_logging
FEATURE: MET-1579_update_code_communication_with_zoho
FEATURE: MET-1826_Backend_support_for_new_executions_list
FEATURE: MET-1624_add_normalized_language_in_Europeana_proxy
FEATURE: MET-1826_Backend_support_for_new_executions_list
FEATURE: MET-1889_register_reindexed_and_invalidated_plugins

BUG: MET-1956_language_normalization_preserve_subtags
BUG: MET-1955_handle_absence_of_content_type
BUG: MET-1924_timeout_on_ImageMagick
BUG: MET-1860_Thumbnail_image_type_not_correct

Link Checking Refactoring

Relative tickets:

FEATURE : MET-1763_support_for_sending_previous_task_identifier
FEATURE : MET-1806_Add_call_for_additional_node_statistics
FEATURE : MET-1770_send_sampling_parameter_to_ecloud
FEATURE : MET-1799_bypass_workflows_for_dps_gap' into develop
FEATURE : MET-1781_limit_timespan_entities_up_to_century_urls
FEATURE : MET-1764_indefinite_consecutive_monitor_cancel_failures
FEATURE : MET-1786_Create_API_for_record_history_viewing
FEATURE : MET-1783_add_main_wikidata_resource_to_same_as
FEATURE : MET-1741_disable_preview_collections_buttons_at_cleaning
FEATURE : MET-1766_proxy_call_for_checking_if_report_exists
FEATURE : MET-1768_add_sampling_parameter_for_link_checking
FEATURE : MET-1751_link_checking_always_allowed
FEATURE : MET-1750_Link_checking_support_for_EDM_external
FEATURE : MET-1761_some_API_changes_link_checking
FEATURE : MET-1723_send_cancellation_reason_to_ecloud
FEATURE : EA-1468_EA-1471_organizations_foaf_depiction_and_address_has_geo
FEATURE : MET-1678_error_report_for_failed_task
FEATURE : MET-1712_support_more_information_when_a_cancellation_occurs
FEATURE : MET-1719_send_parameters_through_body_of_put_method
FEATURE : MET-1533_Improve_color_space_support

BUG : MET-1779_elements_that_have_entities_should_be_part_of_europeana_proxy_with_ref_to_the_entity
BUG : MET-1675_fix_media_servers_for_FLV_files
BUG : MET-1743_validation_file_system_collisions

DEBT : MET-1638_unit_tests_for_media_service
DEBT : MET-1211_indexing_library_technical_debt
DEBT : MET-1797_Unit_tests_for_record_history_code
DEBT : MET-1821_clearup_testobjectfactory

This release is focused on the re-implementation of the link checking library.

Media Service refactoring

Relative tickets:

• MET-1563 Create API for topology using old code
• MET-1578 magick invocation: wrong command arguments
• MET-1565 Refactor code behind API
• MET-1604 MMS: misidentification of WR content type
• MET-1637 Incorrect isPartOf value for Timespans in Mongo
• MET-1595 Newlines stripped from dc:description

This release is focused on the re-implementation of the media service library.
dc:description was changed to not strip newlines during normalization.
Wrong value on timespans in mongo was fixed/updated.

Dereference/Enrichment/Media process fixes

Relative tickets:

• MET-1576 Fix Enrichment/Dereference issues
• MET-1593 Fix recognition of "grayscale" images in media library

Detailed changes:

• Proxy entity fields hasPart and isPartOf are not dereferenced anymore
• WebResource entity the hasPartList is not dereferenced anymore
• Added retries for "HttpServerErrorException" type exceptions on dereference and enrichment external calls
• Fixed the check from "grayscale" to checking "Gray" value during the setColorspace in WebResource of the
  media library

First release of Metis

With this release we aim to have an improved working solution, over the previous system, of a full workflow cycle for our ingestion pipeline, including all the new features and fixes that Metis had in its design.