Gonzalo L.

Data Engineer

Gonzalo is a Data Engineer with six years of commercial experience, specializing in Python, Spark, Scala, AWS, Kubernetes, and SQL. He has a strong track record of designing and implementing scalable, high-performance data solutions that drive business efficiency.

Among his key achievements, Gonzalo has developed a real-time data scraping application using Scala, deployed streaming pipelines on AWS, and built end-to-end data architectures. He also successfully integrated proxy solutions from data sources to production, ensuring seamless and efficient data delivery.

Recognized for his precision and adaptability, Gonzalo consistently delivers tailored, high-quality solutions that align with client needs, demonstrating his expertise in data engineering and infrastructure optimization.

Hauptkompetenz
  • AWS Glue
    AWS Glue 3 Jahre
  • ETL
    ETL 5 Jahre
  • Terraform
    Terraform 3 Jahre
Andere Fähigkeiten
  • Jenkins
    Jenkins 3 Jahre
  • AWS EC2
    AWS EC2 3 Jahre
  • Apache Airflow
    Apache Airflow 2 Jahre
Gonzalo
Gonzalo L.

Spain

Erste Schritte

Ausgewählte Erfahrung

Beschäftigung

  • Senior Data Engineer

    Data Plebbes - 1 jahr 2 monate

    • Leads data engineering projects utilizing PySpark and Python within a Kubernetes environment, ensuring scalable and efficient workflows;

    • Optimizes data visualization and monitoring using Elasticsearch, Kibana, and Grafana, enhancing real-time data insights and performance tracking;

    • Implements and manages CI/CD workflows with ArgoCD, streamlining deployment processes and improving development efficiency;

    • Contributes to system migration from Kubernetes (k8s) to k3s, achieving a 40% reduction in runtime and costs by improving system efficiency.

    Technologien:

    • Technologien:
    • Grafana Grafana
    • Kibana Kibana
    • Kubernetes Kubernetes
    • ElasticSearch ElasticSearch
    • Python Python
    • Data Engineering
  • Data Engineer

    Roamler - 6 monate

    • Builds scalable data pipelines using Spark and Scala, and engineers a scraping engine on AWS, resulting in a 30% improvement in data quality and volume;

    • Manages key AWS services such as EMR, Lambda, ECS, Glue, and ECK for efficient data processing and storage;

    • Streamlines infrastructure provisioning using Terraform and enhances workflow automation with Airflow for optimal system performance.

    Technologien:

    • Technologien:
    • AWS ECS AWS ECS
    • AWS ECR
    • AWS Kinesis AWS Kinesis
    • AWS Lambda AWS Lambda
    • Scala Scala
    • AWS AWS
    • Data Engineering
  • Data Engineer

    Azerion - 1 jahr 4 monate

    • Develops and manages AWS cloud infrastructures utilizing Spark and Scala for efficient data processing, integrating NoSQL databases to enhance flexibility;

    • Oversees key AWS services, including EC2, EMR, Glue, and Lambda, for seamless data streaming, while leveraging Athena for optimized querying, resulting in improved data architecture and storage solutions.

    Technologien:

    • Technologien:
    • AWS EC2 AWS EC2
    • AWS ECR
    • AWS Kinesis AWS Kinesis
    • AWS Lambda AWS Lambda
    • dbt dbt
    • Scala Scala
    • AWS AWS
    • Data Engineering
  • Big Data Developer

    Carrefour - 2 monate

    • Implements CI/CD processes using Jenkins, ensuring streamlined deployment and integration across projects;

    • Conducts data analysis using Cloudera tools, improving data insights and system performance;

    • Utilizes Spark-Scala and Control-M for efficient data processing and workflow management, enhancing overall performance and data integration.

    Technologien:

    • Technologien:
    • Jenkins Jenkins
    • Scala Scala
    • Cloudera Cloudera
  • Big Data Developer

    PUE - 10 monate

    • Utilizes Spark-Scala and MapReduce for efficient data processing, ensuring optimal performance and scalability;

    • Analyzes data with Cloudera, generating actionable insights to drive decision-making;

    • Improves data integration by leveraging Apache Kafka, NiFi, and Oozie, ensuring seamless data flow and enhanced system connectivity.

    Technologien:

    • Technologien:
    • Apache NiFi Apache NiFi
    • Scala Scala
    • Cloudera Cloudera
  • Software Developer

    SENER - 2 jahre 8 monate

    • Develops Fullstack projects using Scala, Python, Java, JavaScript, CSS, Node, and Django, delivering robust and scalable applications;

    • Utilizes SQL databases for managing transactional data, ensuring data integrity and reliability;

    • Implements NoSQL databases to handle unstructured customer interactions, optimizing data storage and retrieval for enhanced user experiences.

    Technologien:

    • Technologien:
    • Node.js Node.js
    • Python Python
    • SQL SQL
    • Scala Scala
    • JavaScript JavaScript
    • Java Java
    • NoSQL

Ausbildung

  • MSc.Analytical Methods for Big Data

    University Carlos III · 2019 - 2020

  • BSc.Dual Bachelor in Computer Science and Engineering and Business Administration

    University Carlos III · 2013 - 2019

Finden Sie Ihren nächsten Entwickler innerhalb von Tagen, nicht Monaten

In einem kurzen 25-minütigen Gespräch würden wir gerne:

  • Auf Ihren Bedarf bezüglich des Recruitments von Software-Entwicklern eingehen
  • Unseren Prozess vorstellen und somit wie wir Sie mit talentierten und geprüften Kandidaten aus unserem Netzwerk zusammenbringen können
  • Die nächsten Schritte besprechen, um den richtigen Kandidaten zu finden - oft in weniger als einer Woche

Unterhalten wir uns

Jetzt Entwickler:innen finden, die innerhalb von wenigen Tagen starten können. Ohne Risiko.