Data Engineer

• Developed solutions using programming languages such as SQL, Python, and Scala;

• Performed Data Governance and Data Manipulation tasks related to ETLs and ELTs, CI/CD processes, and data curation;

• Utilized technologies including SQL, NoSQL, and cloud ecosystems such as GCP, AWS, and Azure to manage and optimize data workflows;

• Leveraged skills in Python, SQL, Azure Data Factory, ETL, and Azure Databricks to enhance data processes and system efficiency.

• Acted in Data Analytics projects, performing tasks related to data analysis and engineering using both cloud-based and on-premises technologies;

• Developed data pipelines and analysis scripts using Python (Pandas), PySpark, SQL, and SAS for data mapping, processing, and automating data analysis tasks;

• Utilized Power BI to build reports focusing on banking risk indicators, providing valuable insights for decision-making processes.

• Participates in Data Analytics projects, focusing on tasks related to data engineering across cloud-based and on-premises technologies;

• Develops data pipelines using PySpark and SQL for data mapping and processing;

• Utilizes AWS Glue and AWS Step Functions for orchestrating and controlling data flow;

• Works with the Snowflake cloud database to manage and optimize data storage and retrieval processes;

• Assists in defining and implementing data architecture strategies for various projects;

• Ensures seamless integration and processing of data within complex systems, utilizing ETL best practices and cloud technologies.

• Defined procedures and best practices for developing ETL interfaces using the Oracle Data Integrator (ODI) tool and Oracle database system;

• Managed data environment migrations, implemented data lakes, and developed new functionalities for existing systems;

• Contributed to Business Intelligence projects following agile methodologies, particularly using the Scrum framework;

• Supported the design add data modeling phases of data warehouse projects, developing ETL mappings using SQL and Oracle Data Integrator for data definition and flow processes;

• Analyzed and performed tuning of SQL queries to optimize project efficiency.

• Defined procedures and best practices for developing ETL interfaces using data integration tools like Oracle Data Integrator (ODI) and Informatica PowerCenter (PWC), combined with database systems such as Oracle, Teradata, and SQL Server;

• Analyzed and tuned SQL queries and PL-SQL/T-SQL stored procedures to optimize performance within projects;

• Developed new features and functionalities for existing systems;

• Contributed to Business Intelligence projects using agile methodologies, specifically Scrum, including migrating data environments and implementing data warehouses.

• Worked on data migration and integration (ETL) projects using IBM Infosphere tools, such as Datastage and Information Analyzer;

• Defined and developed data migration solutions to support the company's business fronts;

• Provided support to business teams by ensuring efficient data integration processes;

• Applied best practices in ETL development to ensure data accuracy and consistency during migrations.

Analysis, technical design, development, corrections (bug fixes), and unit/integrated testing of ETL interfaces using IBM Infosphere DataStage, Informatica PowerCenter, Microsoft SSIS (Data flows and Control flows) or Oracle Data Integrator - ODI tools associated with an Oracle, Sybase, SQL Server, or Teradata database in Datamarts/Datawarehouse implementation projects or data extraction/loading in Datamarts/Datawarehouse, including KPI calculations, to be used as input for management.
Business reports in data visualization tools to assist in the client’s decision-making process.