Omar C.

Data Engineer

Omar is a driven and accomplished Data Engineer with a strong passion for AI, Machine Learning, and NLP, currently residing in Cambridge, UK. With five years of commercial experience, he has demonstrated significant expertise and innovation in his field.

Omar has created scalable and reliable data pipelines that support crucial research and development activities. He also designed a Real-Time Vehicle Counting system using the YOLOv3 framework, showcasing his technical prowess and innovative thinking.

In 2019, he published a paper titled "A Comparative Analysis on the Use of Autoencoders for Robot Security Anomaly Detection," highlighting his contributions to academic research. Omar is proficient in data and big data analysis, data pipeline design and development, and agile software development.

Tärkein asiantuntemus
  • Data Engineering 5 vuotta
  • Python
    Python 4 vuotta
  • SQL
    SQL 4 vuotta
Muut taidot
  • Kubernetes
    Kubernetes 3 vuotta
  • Jenkins
    Jenkins 3 vuotta
  • Apache Hive
    Apache Hive 3 vuotta
Omar
Omar C.

United Kingdom

Aloita tästä

Valittu kokemus

Työllisyys

  • Lead Data Engineer

    Descartes & Mauss - 1 year 4 months

    • Conduct daily data cleaning, ingestion, and processing;
    • Design, develop, and perform quality control testing of data pipelines;
    • Manage a small team of one data engineer and one data scientist;
    • Coordinate with the CS team to provide compliant results for our client.

    Tekniikat:

    • Tekniikat:
    • Python Python
    • Apache Spark Apache Spark
    • Docker Docker
  • Senior Data Engineer London

    Quantexa - 1 year 8 months

    • Conduct daily data cleaning, ingestion, and processing;
    • Perform quality checks on Q products to enhance overall performance;
    • Design, develop, and perform quality control testing of data pipelines.

    Tekniikat:

    • Tekniikat:
    • Apache Spark Apache Spark
    • Scala Scala
    • ElasticSearch ElasticSearch
    • Jenkins Jenkins
    • Hadoop Hadoop
  • Data Engineer

    Recordsure - 2 years 1 month

    • Conducted integrity checks on the data pipeline across various environments using Grafana and Kibana;
    • Designed and implemented new features and resolved pipeline bugs;
    • Designed, developed, and maintained the data pipeline, enabling researchers to retrieve and create datasets for model training and analyze model performance;
    • Developed monitoring tools used by researchers to track pipeline jobs;
    • Conducted weekly code reviews with researchers to ensure a consistent coding style;
    • Delivered monthly demos during business reviews to present ongoing work to a wider audience.

    Tekniikat:

    • Tekniikat:
    • Python Python
    • Apache Airflow Apache Airflow
    • MongoDB MongoDB
    • Docker Docker
    • Kubernetes Kubernetes
  • Big Data Analyst Rome

    Minsait - 1 year 5 months

    • Designed and developed a user-friendly Kafka Console with a web interface, providing an efficient monitoring system for Kafka topics. Calculated essential KPIs to indicate system status and estimated time for processing messages in the queues.es;
    • Led the backend design of a Cloudera Web Application, designing data structures using HBase and developing methods to store aggregated performance indicators with Spark;
    • Designed and developed a Real-Time Vehicles Counting system using the YOLOv3 framework. Trained an object detection model specializing in recognizing vehicles on highways and created a real-time counting system to estimate traffic on specific streets.

    Tekniikat:

    • Tekniikat:
    • Python Python
    • Apache Spark Apache Spark
    • Scala Scala
    • Hadoop Hadoop

Koulutus

  • MSc.Computer Science Engineering

    Università degli studi di Roma Sapienza · 2017 - 2019

  • BSc.Computer Science Engineering

    Università degli studi della Campania Luigi Vanvitelli · 2014 - 2017

Löydä seuraava kehittäjäsi päivien, ei kuukausien sisällä

Kun otat yhteyttä, järjestämme lyhyen 25 minuuttia kestävän tapaamisen, jonka aikana:

  • Kartoitamme yrityksenne kehitystarvetta
  • Kertoa prosessimme, jolla löydämme teille pätevän, ennakkotarkastetun kehittäjän verkostostamme
  • Käymme läpi askeleet, joilla oikea ehdokas pääsee aloittamaan – useimmiten viikon sisällä

Keskustele kanssamme