Marcos W.

Data Engineer

Marcos is an experienced Data Engineer with eight years of commercial expertise, specializing in developing and optimizing data pipelines. With a strong foundation in information technology and a passion for data engineering, he brings extensive proficiency in Python, Airflow, DBT, and SQL.

He has valuable leadership experience, having successfully managed and mentored a small team to achieve project goals efficiently. One of his key accomplishments includes leading an initiative to optimize ETL processes, achieving a 50% reduction in processing time, significantly improving system performance and efficiency.

Marcos is eager to apply his skills to new and challenging data-centric projects, leveraging his technical expertise and problem-solving abilities to drive impactful results.

Huvudsaklig expertis

Git 6 år
JavaScript 4 år
PHP 4 år

Andra kompetenser

Vue.js 2 år
Apache Airflow 2 år
Azure Data Factory 2 år

Marcos W.

Brazil

Hitta en utvecklare

Utvald erfarenhet

Anställningar

Data Engineer

Pantheon Inc. - 2 år 7 månader
Working as Contractor for ExxonMobil as a Data Engineer:
- Data Pipeline Development & Optimization: Developed robust ELT pipelines to support data integration and transformation processes, leveraging technologies such as Snowflake, SQL and DBT to ensure seamless and efficient data workflows.
- Mentorship & Knowledge Sharing: Acted as a technical resource for team members, providing guidance and sharing best practices to elevate the overall quality and efficiency of project deliverables.
- Legacy System Maintenance: Managed and optimized legacy systems and processes, ensuring their continued functionality while implementing improvements to align with modern best practices and business needs. Utilized tools and platforms such as SSIS, Python and SQL to support critical business operations.
Teknologier:
- Teknologier:
- Git
- Fact Data Modeling
- Dimensional modeling
- REST API
- Database testing
- Data Modeling
- ETL
- dbt
- SQL
- Azure Data Factory
- Snowflake
- Python
- Data Engineering
- MSSQL
- Azure Cloud
- SSIS
- PL/SQL
Data Engineer

Henry Schein - 1 år 11 månader
- ELT Project Leadership: Led and served as the main developer for a comprehensive ELT project, leveraging a modern tech stack that included Airflow, DBT, Azure Data Lake Storage Gen2, Synapse SQL Pool, Python, and Azure Cloud Services. Successfully designed and implemented scalable data pipelines to streamline data integration and transformation processes.
- Cloud & Big Data Experimentation: Worked on small-scale projects experimenting with emerging technologies such as Azure Data Factory/Data Flow and Databricks with Spark, gaining hands-on experience in scalable cloud-based data processing and advanced analytics.
- Legacy System Maintenance: Maintained and enhanced legacy systems and processes using SQL Server Integration Services (SSIS) and Python, ensuring their continued reliability while identifying opportunities for incremental improvements.
Teknologier:
- Teknologier:
- Git
- MySQL
- REST API
- ETL
- Azure Synapse
- dbt
- Apache Airflow
- SQL
- Azure Data Factory
- Python
- Data Engineering
- MSSQL
- Azure Blob storage
- Azure Cloud
- SSIS
- PL/SQL
Full Stack Developer

Unimestre Sistemas Acadêmicos - 3 år 7 månader
- Maintained an ERP written in PHP and Javascript/Jquery with MySQL Database;
- Developed two new ERP's modules with PHP backend and VueJs frontend;
- Developed system integrations using RESTful APIs. Some examples are Certisign's Eletronic Signature API, and Boleto (Brazilian payment method) integrations with three of the main Brazilian Banks: Caixa Econômica Federal, Banco do Brasil and Itau;
- Head of a project which goal was to migrate the entire ERP frontend using Material Design Patterns.
Teknologier:
- Teknologier:
- Git
- Vue.js
- JavaScript
- PHP
- MySQL
- REST API
- SQL
- PL/SQL