Data Architect

For a potentially renewable 6-month project, Asenium is looking for a Data Architect.

Support the compliance, implementation and dissemination of IT policies and procedures, as well as supporting the team in articulating and achieving results through the creation of value for stakeholders;
Define policies, procedures, models and technologies that can be used in collecting, organizing, storing and accessing group data.
Model business requirements – data aspect – in a normalized, denormalized, star or other standard data model according to the objectives;
Model business requirements in a data model beyond the tabular: columnar, graph, geographic, time series, document;
Apply reference data architectures in accordance with the requirements of the data management strategy;
Evaluate blueprint for organizational data framework defined how data is obtained, stored, consumed, integrated, and managed in order to enrich the company's DataLakes, MDU and Datamarts;
Define indicators inherent to DataOps observability organized into 1 (3) aspects:
Health at the data level (profiling within the “expectation envelope”,
Outlier and anomaly detection,
Data drift and business rule enforcement.

We expect to find someone that could be able to do the tasks above.

Solid knowledge of Azure Databricks, including configuring clusters, notebooks and jobs;
Familiarity with Spark-based data processing and ETL pipelines is essential;
Proficiency in data management using the Unity Catalog in Azure Databricks;
Understanding catalog objects, schemas and permissions is crucial;
Ability to apply data governance policies using Unity Catalog;
Management of access controls, permissions and data lineage;
Knowledge of best security practices, encryption and compliance standards;
Experience as an Azure Databricks metastore administrator or familiarity with metastore management;
Understanding how to create and manage catalogs in Unity Catalog linked to the workspace;
Proficiency in creating and managing catalogs in Unity Catalog;
Understand the CREATE CATALOG privilege and ensure that the cluster used for catalog creation complies with Unity1 Catalog access modes;
Familiarity with installing and configuring Unity Catalog for data management;
Ability to configure and enable Unity Catalog for Azure Databricks workspaces;
Assign roles and permissions to users in the workspace, including workspace administrators and metastore administrators;
Strong communication skills to collaborate with data engineers, data scientists and other stakeholders;
Ability to document processes, guidelines and best practices related to the use of Unity Catalog and Databricks.
English

Hybrid Position (50% in the office)

Start immediately

Location: Lisbon