Job Description

At ADN – Human Resources we are looking for a Data Engineer / Architect / 100% Remote / paid in USD for an Important Company.



Requirements:

-More than seven years of experience in data platforms and productive ETL pipelines.

-Training in Engineering, Computing or Data Science.

-AWS domain (S3, Glue, EMR, DMS, Athena, Redshift, MWAA).

-Knowledge in Spark (PySpark or Scala) and advanced SQL.

-Experience with Apache Iceberg or Delta Lake, Airflow, dbt, and IaC (Terraform/CloudFormation).

-Good management of security and compliance practices.

-Excellent technical communication with stakeholders.

Tasks to be developed:

-Design and implement a modern data architecture based on AWS.

-Develop data ingestion and transformation pipelines in cloud environments.

-Catalog data sources and design a medallion architecture (Bronze-Silver-Gold).

-Migrate workloads from Hive/HDFS to Spark.

-Develop and maintain DAGs in Airflow, with quality control and monitoring.

-Ensure data quality using frameworks such as Deequ or Great Expectations.

-Design consumer covers in Athena or Redshift Serverless.

-Guide and mentor other engineers and analysts.

Remote work.

Hours: Monthly to Friday from 9 am to 6 pm (Eastern USA time).",