Job Description
Join our team!
We are looking for a Data Engineer with experience in Big Data technologies and AWS services, who will be responsible for evaluating, designing and implementing data solutions that contribute to the operational continuity of IT services, ensuring the quality, availability and integrity of the information.
We are looking for professionals with analytical orientation, the ability to work as a team and experience in developing data processing and integration solutions.
Main responsibilities
Design, develop and maintain data solutions on Big Data platforms.
Build data ingestion, transformation and control processes towards a Data Lake.
Develop and implement solutions using Python and AWS services.
Evaluate, analyze and propose continuous improvements in processes, systems and technologies.
Participate in the gathering and functional and technical analysis of requirements.
Perform functional and technical tests to ensure the quality of the implemented solutions.
Apply security standards, methodologies and controls that guarantee the integrity and availability of information.
Participate in coordination meetings with technical teams and user areas, carrying out monitoring and progress reports.
Document processes, developments and implemented solutions.
Requirements
Academic Training
Professional degree of at least 4 years duration in:
Civil Engineering (any specialty).
Execution Engineering (any specialty).
Or careers related to the technological area.
Experience
Minimum 4 years of experience in functions related to data engineering, Big Data or data processing platforms.
Technical knowledge
Experience in Python.
Management of relational and NoSQL databases.
Experience in Big Data architectures and data processing.
Development of data ingestion and transformation processes towards Data Lake.
Experience using AWS services, such as:
Amazon S3
AWS Lambda
AWS Glue
AWS Step Functions
Amazon DocumentDB
Other related services
Version control using Git, CodeCommit or GitLab.
Knowledge of cluster architectures and distributed data processing.",