Ali E.

• Used Airflow, SQL, Python, Bigquery, Cloud Storage, CloudRun
• Working on third-party dataset using GCP
• Create and Maintain DAGs in Airflow 2.3.0 and Create Custom Operators
• Collect Data from third-party APIs like Weather, Covid-19, OECD, etc.
• Create Dashboards Using Streamlit
• Create a self-service pipeline using Gitlab CI/CD to Schedule Jupyter NOTEBOOKS on GCP

• Support Supply Chain Projects
• Import Raw Data from old systems and files to BigQuery
• Create Data Pipelines with Composer(Airflow)
• Write APIs to serve data with flask and deploy to GCP
• Export or Dump data to Bucket or Cloud SQL
• Train AI models using Vertex AI (custom training)

● Hepsiburada is one of the biggest e-commerce companies in Turkey

● Create Reports to Hepsiburada’s CFO and Finance Team

● Import Raw Data from RDBMS to Hadoop with Sqoop Scripts

● Create ETL scripts with Hive Query Language

● Read Raw Data from External API(OMS) and Write to Hive Table with Python3

● Export Final Tables to MySql with Sqoop

● Schedule all jobs with Oozie, Hue

● Borusan Predictive Maintenance Project

● Restore Sensor Data from .bak files to Azure SQL Server

● Clean, Transform, and Combine data for Data Scientists with T-SQL

● Store Final Data in Blob Storage(Gen2)

● Mount Gen2 to Databricks File System

● Get quick insights Using Pyspark (Databricks Notebooks)

• Setup Hadoop Ecosystems HDP 3.1.0
• Install HDF(3.3) cluster on existing HDP
• Cluster Management (Enable HA, Kerberos)
• Data transfer to Hadoop
• Developing and Tuning Hive Tables
• Data Encryption and Masking (Ranger Policies)
• Check database scripts of over 40 agile development teams
• Define and maintain Naming Standards of Database objects

• Data transfer RDBMS to HDFS
• Develop new ETL jobs
• Developing and Tuning Hive Tables
• Data and Cluster Security with Ranger

● Setup Hadoop Ecosystems HDP 2.6.3 ● Maintain additional Services like Solr, Banana ● Cluster Management

● Design, Develop, and Maintenance DWH Architecture

● Create and improve ETL Processes with ODI 11g, ODI 12c

● Develop Business Intelligence Reports with Cognos, Qlikview

● Ad-hoc Reports