Marcos W.

Data Engineer

Marcos is an experienced Data Engineer with eight years of commercial expertise, specializing in developing and optimizing data pipelines. With a strong foundation in information technology and a passion for data engineering, he brings extensive proficiency in Python, Airflow, DBT, and SQL.

He has valuable leadership experience, having successfully managed and mentored a small team to achieve project goals efficiently. One of his key accomplishments includes leading an initiative to optimize ETL processes, achieving a 50% reduction in processing time, significantly improving system performance and efficiency.

Marcos is eager to apply his skills to new and challenging data-centric projects, leveraging his technical expertise and problem-solving abilities to drive impactful results.

Tärkein asiantuntemus

  • Git
    Git 6 vuotta
  • JavaScript
    JavaScript 4 vuotta
  • PHP
    PHP 4 vuotta

Muut taidot

  • Vue.js
    Vue.js 2 vuotta
  • Azure Data Factory
    Azure Data Factory 2 vuotta
  • Apache Airflow
    Apache Airflow 2 vuotta
Marcos

Marcos W.

Brazil

Aloita tästä

Valittu kokemus

Työllisyys

  • Data Engineer

    Pantheon Inc. - 2 years 7 months

    Working as Contractor for ExxonMobil as a Data Engineer:

    • Data Pipeline Development & Optimization: Developed robust ELT pipelines to support data integration and transformation processes, leveraging technologies such as Snowflake, SQL and DBT to ensure seamless and efficient data workflows.

    • Mentorship & Knowledge Sharing: Acted as a technical resource for team members, providing guidance and sharing best practices to elevate the overall quality and efficiency of project deliverables.

    • Legacy System Maintenance: Managed and optimized legacy systems and processes, ensuring their continued functionality while implementing improvements to align with modern best practices and business needs. Utilized tools and platforms such as SSIS, Python and SQL to support critical business operations.

    Tekniikat:

    • Tekniikat:
    • MSSQL MSSQL
    • Python Python
    • SQL SQL
    • Azure Azure
    • Azure Data Factory Azure Data Factory
    • Data Engineering
    • Git Git
    • SSIS SSIS
    • Azure Cloud Azure Cloud
    • PL/SQL PL/SQL
    • Snowflake Snowflake
    • Data Modeling
    • ETL ETL
    • Database Testing
    • REST API REST API
    • Dimensional modeling
    • Fact Data Modeling
    • dbt dbt
  • Web Multimedia Developer

    Google (remotely as a subcontractor) - 1 year 5 months

    • Mobile Development: Android and iOS;
    • Deep experience in AWS Services;
    • Database architecture.

    Tekniikat:

    • Tekniikat:
    • React Native React Native
  • Data Engineer

    Henry Schein - 1 year 11 months

    • ELT Project Leadership: Led and served as the main developer for a comprehensive ELT project, leveraging a modern tech stack that included Airflow, DBT, Azure Data Lake Storage Gen2, Synapse SQL Pool, Python, and Azure Cloud Services. Successfully designed and implemented scalable data pipelines to streamline data integration and transformation processes.

    • Cloud & Big Data Experimentation: Worked on small-scale projects experimenting with emerging technologies such as Azure Data Factory/Data Flow and Databricks with Spark, gaining hands-on experience in scalable cloud-based data processing and advanced analytics.

    • Legacy System Maintenance: Maintained and enhanced legacy systems and processes using SQL Server Integration Services (SSIS) and Python, ensuring their continued reliability while identifying opportunities for incremental improvements.

    Tekniikat:

    • Tekniikat:
    • MySQL MySQL
    • MSSQL MSSQL
    • Python Python
    • SQL SQL
    • Azure Azure
    • Azure Blob storage Azure Blob storage
    • Azure Data Factory Azure Data Factory
    • Data Engineering
    • Git Git
    • SSIS SSIS
    • Apache Airflow Apache Airflow
    • Azure Synapse Azure Synapse
    • Azure Cloud Azure Cloud
    • PL/SQL PL/SQL
    • ETL ETL
    • REST API REST API
    • dbt dbt
  • WordPress Developer

    Freelance - 3 years 10 months

    Serviced a wide range of clients from personal bloggers to professional athletes, universities, restaurants and more.

    Tekniikat:

    • Tekniikat:
    • WordPress WordPress
    • WooCommerce WooCommerce
  • Software Developer

    Freelance - 4 years 3 months

    • Contracted with several companies;
    • Worked as a full-stack developer;
    • Developed algorithm and data structures;
    • Built software architecture;
    • Optimized database design without duplication and complexity;
    • Auto-deployment to production and staging server.

    Tekniikat:

    • Tekniikat:
    • PHP PHP
    • Laravel Laravel
    • CakePHP CakePHP
    • CodeIgniter CodeIgniter
  • Full Stack Developer

    Unimestre Sistemas Acadêmicos - 3 years 7 months

    • Maintained an ERP written in PHP and Javascript/Jquery with MySQL Database;

    • Developed two new ERP's modules with PHP backend and VueJs frontend;

    • Developed system integrations using RESTful APIs. Some examples are Certisign's Eletronic Signature API, and Boleto (Brazilian payment method) integrations with three of the main Brazilian Banks: Caixa Econômica Federal, Banco do Brasil and Itau;

    • Head of a project which goal was to migrate the entire ERP frontend using Material Design Patterns.

    Tekniikat:

    • Tekniikat:
    • PHP PHP
    • MySQL MySQL
    • JavaScript JavaScript
    • Vue.js Vue.js
    • SQL SQL
    • Git Git
    • PL/SQL PL/SQL
    • REST API REST API

Koulutus

  • BSc.Information Systems

    Fundação Universidade Regional de Blumenau · 2011 - 2016

  • BSc.Computer Science

    Bachelor Degree · 2011 - 2014

  • Standalone courseMaster of Computer Applications - MCA

    College of Evariste Galois · 2007 - 2011

Löydä seuraava kehittäjäsi päivien, ei kuukausien sisällä

Kun otat yhteyttä, järjestämme lyhyen 25 minuuttia kestävän tapaamisen, jonka aikana:

  • Kartoitamme yrityksenne kehitystarvetta
  • Kertoa prosessimme, jolla löydämme teille pätevän, ennakkotarkastetun kehittäjän verkostostamme
  • Käymme läpi askeleet, joilla oikea ehdokas pääsee aloittamaan – useimmiten viikon sisällä

Keskustele kanssamme