Marcos W.

Data Engineer

Marcos is an experienced Data Engineer with eight years of commercial expertise, specializing in developing and optimizing data pipelines. With a strong foundation in information technology and a passion for data engineering, he brings extensive proficiency in Python, Airflow, DBT, and SQL.

He has valuable leadership experience, having successfully managed and mentored a small team to achieve project goals efficiently. One of his key accomplishments includes leading an initiative to optimize ETL processes, achieving a 50% reduction in processing time, significantly improving system performance and efficiency.

Marcos is eager to apply his skills to new and challenging data-centric projects, leveraging his technical expertise and problem-solving abilities to drive impactful results.

Hovedekspertise
  • Git
    Git 6 år
  • JavaScript
    JavaScript 4 år
  • PHP
    PHP 4 år
Andre færdigheder
  • Vue.js
    Vue.js 2 år
  • Apache Airflow
    Apache Airflow 2 år
  • Azure Data Factory
    Azure Data Factory 2 år
Marcos
Marcos W.

Brazil

Match med udvikler her

Udvalgt oplevelse

Beskæftigelse

  • Data Engineer

    Pantheon Inc. - 2 flere år 7 måneder

    Working as Contractor for ExxonMobil as a Data Engineer:

    • Data Pipeline Development & Optimization: Developed robust ELT pipelines to support data integration and transformation processes, leveraging technologies such as Snowflake, SQL and DBT to ensure seamless and efficient data workflows.

    • Mentorship & Knowledge Sharing: Acted as a technical resource for team members, providing guidance and sharing best practices to elevate the overall quality and efficiency of project deliverables.

    • Legacy System Maintenance: Managed and optimized legacy systems and processes, ensuring their continued functionality while implementing improvements to align with modern best practices and business needs. Utilized tools and platforms such as SSIS, Python and SQL to support critical business operations.

    Teknologier:

    • Teknologier:
    • Git Git
    • Fact Data Modeling
    • Dimensional modeling
    • REST API REST API
    • Database testing
    • Data Modeling
    • ETL ETL
    • dbt dbt
    • SQL SQL
    • Azure Data Factory Azure Data Factory
    • Snowflake Snowflake
    • Python Python
    • Data Engineering
    • MSSQL MSSQL
    • Azure Cloud Azure Cloud
    • SSIS SSIS
    • PL/SQL PL/SQL
  • Data Engineer

    Henry Schein - 1 år 11 måneder

    • ELT Project Leadership: Led and served as the main developer for a comprehensive ELT project, leveraging a modern tech stack that included Airflow, DBT, Azure Data Lake Storage Gen2, Synapse SQL Pool, Python, and Azure Cloud Services. Successfully designed and implemented scalable data pipelines to streamline data integration and transformation processes.

    • Cloud & Big Data Experimentation: Worked on small-scale projects experimenting with emerging technologies such as Azure Data Factory/Data Flow and Databricks with Spark, gaining hands-on experience in scalable cloud-based data processing and advanced analytics.

    • Legacy System Maintenance: Maintained and enhanced legacy systems and processes using SQL Server Integration Services (SSIS) and Python, ensuring their continued reliability while identifying opportunities for incremental improvements.

    Teknologier:

    • Teknologier:
    • Git Git
    • MySQL MySQL
    • REST API REST API
    • ETL ETL
    • Azure Synapse Azure Synapse
    • dbt dbt
    • Apache Airflow Apache Airflow
    • SQL SQL
    • Azure Data Factory Azure Data Factory
    • Python Python
    • Data Engineering
    • MSSQL MSSQL
    • Azure Blob storage Azure Blob storage
    • Azure Cloud Azure Cloud
    • SSIS SSIS
    • PL/SQL PL/SQL
  • Full Stack Developer

    Unimestre Sistemas Acadêmicos - 3 flere år 7 måneder

    • Maintained an ERP written in PHP and Javascript/Jquery with MySQL Database;

    • Developed two new ERP's modules with PHP backend and VueJs frontend;

    • Developed system integrations using RESTful APIs. Some examples are Certisign's Eletronic Signature API, and Boleto (Brazilian payment method) integrations with three of the main Brazilian Banks: Caixa Econômica Federal, Banco do Brasil and Itau;

    • Head of a project which goal was to migrate the entire ERP frontend using Material Design Patterns.

    Teknologier:

    • Teknologier:
    • Git Git
    • Vue.js Vue.js
    • JavaScript JavaScript
    • PHP PHP
    • MySQL MySQL
    • REST API REST API
    • SQL SQL
    • PL/SQL PL/SQL

Uddannelse

  • BSc.Information Systems

    Fundação Universidade Regional de Blumenau · 2011 - 2016

Find din næste udvikler inden for få dage, ikke måneder

Book en 25-minutters samtale, hvor vi:

  • udfører behovsafdækning med fokus på udviklingsopgaver
  • Forklar vores proces, hvor vi matcher dig med kvalificerede, godkendte udviklere fra vores netværk
  • beskriver de næste trin for at finde det perfekte match på få dage

Lad os snakke om det

I kan starte samarbejdet inden for få dage.