Job Description
Description: At ADN – Human Resources we are looking for a Data Engineer / Architect / 100% Remote / payment in USD for an Important Company.
Requirements:
-More than seven years of experience in data platforms and productive ETL pipelines.
-Training in Engineering, Computing or Data Sciences.
-AWS domain (S3, Glue, EMR, DMS, Athena, Redshift, MWAA).
-Knowledge of Spark (PySpark or Scala) and advanced SQL.
-Experience with Apache Iceberg or Delta Lake, Airflow, dbt, and IaC (Terraform/CloudFormation).
-Good management of security and compliance practices.
-Excellent technical communication with stakeholders.
Tasks to develop:
-Design and implement a modern data architecture based on AWS.
-Develop data ingestion and transformation pipelines in cloud environments.
-Catalog data sources and design a medallion architecture (Bronze-Silver-Gold).
-Migrate workloads from Hive/HDFS to Spark.
-Develop and maintain DAGs in Airflow, with quality control and monitoring.
-Ensure data quality using frameworks such as Deequ or Great Expectations.
-Design consumption layers in Athena or Redshift Serverless.
-Guide and mentor other engineers and analysts.
Remote work.
Hours: Monday to Friday from 9 a.m. to 6 p.m. (US Eastern Time).
Positions to cover: 1.
The person who assumes this position will have the possibility of developing within a team of high-quality professionals, with an excellent work environment, remuneration commensurate with the challenge, plus other benefits.",