Marcos W.

Data Engineer

Marcos is an experienced Data Engineer with eight years of commercial expertise, specializing in developing and optimizing data pipelines. With a strong foundation in information technology and a passion for data engineering, he brings extensive proficiency in Python, Airflow, DBT, and SQL.

He has valuable leadership experience, having successfully managed and mentored a small team to achieve project goals efficiently. One of his key accomplishments includes leading an initiative to optimize ETL processes, achieving a 50% reduction in processing time, significantly improving system performance and efficiency.

Marcos is eager to apply his skills to new and challenging data-centric projects, leveraging his technical expertise and problem-solving abilities to drive impactful results.

Hovedekspertise

  • Git
    Git 6 år
  • JavaScript
    JavaScript 4 år
  • PHP
    PHP 4 år

Andre færdigheder

  • Vue.js
    Vue.js 2 år
  • Azure Data Factory
    Azure Data Factory 2 år
  • Apache Airflow
    Apache Airflow 2 år
Marcos

Marcos W.

Brazil

Match med udvikler her

Udvalgt oplevelse

Beskæftigelse

  • Data Engineer

    Pantheon Inc. - 2 flere år 7 måneder

    Working as Contractor for ExxonMobil as a Data Engineer:

    • Data Pipeline Development & Optimization: Developed robust ELT pipelines to support data integration and transformation processes, leveraging technologies such as Snowflake, SQL and DBT to ensure seamless and efficient data workflows.

    • Mentorship & Knowledge Sharing: Acted as a technical resource for team members, providing guidance and sharing best practices to elevate the overall quality and efficiency of project deliverables.

    • Legacy System Maintenance: Managed and optimized legacy systems and processes, ensuring their continued functionality while implementing improvements to align with modern best practices and business needs. Utilized tools and platforms such as SSIS, Python and SQL to support critical business operations.

    Teknologier:

    • Teknologier:
    • MSSQL MSSQL
    • Python Python
    • SQL SQL
    • Azure Azure
    • Azure Data Factory Azure Data Factory
    • Data Engineering
    • Git Git
    • SSIS SSIS
    • Azure Cloud Azure Cloud
    • PL/SQL PL/SQL
    • Snowflake Snowflake
    • Data Modeling
    • ETL ETL
    • Database Testing
    • REST API REST API
    • Dimensional modeling
    • Fact Data Modeling
    • dbt dbt
  • Web Multimedia Developer

    Google (remotely as a subcontractor) - 1 år 5 måneder

    • Mobile Development: Android and iOS;
    • Deep experience in AWS Services;
    • Database architecture.

    Teknologier:

    • Teknologier:
    • React Native React Native
  • Data Engineer

    Henry Schein - 1 år 11 måneder

    • ELT Project Leadership: Led and served as the main developer for a comprehensive ELT project, leveraging a modern tech stack that included Airflow, DBT, Azure Data Lake Storage Gen2, Synapse SQL Pool, Python, and Azure Cloud Services. Successfully designed and implemented scalable data pipelines to streamline data integration and transformation processes.

    • Cloud & Big Data Experimentation: Worked on small-scale projects experimenting with emerging technologies such as Azure Data Factory/Data Flow and Databricks with Spark, gaining hands-on experience in scalable cloud-based data processing and advanced analytics.

    • Legacy System Maintenance: Maintained and enhanced legacy systems and processes using SQL Server Integration Services (SSIS) and Python, ensuring their continued reliability while identifying opportunities for incremental improvements.

    Teknologier:

    • Teknologier:
    • MySQL MySQL
    • MSSQL MSSQL
    • Python Python
    • SQL SQL
    • Azure Azure
    • Azure Blob storage Azure Blob storage
    • Azure Data Factory Azure Data Factory
    • Data Engineering
    • Git Git
    • SSIS SSIS
    • Apache Airflow Apache Airflow
    • Azure Synapse Azure Synapse
    • Azure Cloud Azure Cloud
    • PL/SQL PL/SQL
    • ETL ETL
    • REST API REST API
    • dbt dbt
  • WordPress Developer

    Freelance - 3 flere år 10 måneder

    Serviced a wide range of clients from personal bloggers to professional athletes, universities, restaurants and more.

    Teknologier:

    • Teknologier:
    • WordPress WordPress
    • WooCommerce WooCommerce
  • Software Developer

    Freelance - 4 flere år 3 måneder

    • Contracted with several companies;
    • Worked as a full-stack developer;
    • Developed algorithm and data structures;
    • Built software architecture;
    • Optimized database design without duplication and complexity;
    • Auto-deployment to production and staging server.

    Teknologier:

    • Teknologier:
    • PHP PHP
    • Laravel Laravel
    • CakePHP CakePHP
    • CodeIgniter CodeIgniter
  • Full Stack Developer

    Unimestre Sistemas Acadêmicos - 3 flere år 7 måneder

    • Maintained an ERP written in PHP and Javascript/Jquery with MySQL Database;

    • Developed two new ERP's modules with PHP backend and VueJs frontend;

    • Developed system integrations using RESTful APIs. Some examples are Certisign's Eletronic Signature API, and Boleto (Brazilian payment method) integrations with three of the main Brazilian Banks: Caixa Econômica Federal, Banco do Brasil and Itau;

    • Head of a project which goal was to migrate the entire ERP frontend using Material Design Patterns.

    Teknologier:

    • Teknologier:
    • PHP PHP
    • MySQL MySQL
    • JavaScript JavaScript
    • Vue.js Vue.js
    • SQL SQL
    • Git Git
    • PL/SQL PL/SQL
    • REST API REST API

Uddannelse

  • BSc.Information Systems

    Fundação Universidade Regional de Blumenau · 2011 - 2016

  • BSc.Computer Science

    Bachelor Degree · 2011 - 2014

  • Standalone courseMaster of Computer Applications - MCA

    College of Evariste Galois · 2007 - 2011

Find din næste udvikler inden for få dage, ikke måneder

Book en 25-minutters samtale, hvor vi:

  • udfører behovsafdækning med fokus på udviklingsopgaver
  • Forklar vores proces, hvor vi matcher dig med kvalificerede, godkendte udviklere fra vores netværk
  • beskriver de næste trin for at finde det perfekte match på få dage

Lad os snakke om det