Apply now »

Junior Data Engineer

Location-El Giza ,  ,Egypt (EG) 

Job ID -5769

We are looking for a junior data engineer to join our team. Candidates for this vacancy, must be able to load and transform data from various data sources into a data lake using AWS tools. Help the data science team to develop and deploy various use cases that will help in solving business problems.

 

In this position, your role will be to model complex problems, discover insights and automate workflows through statistical analysis, machine learning, generative AI and data visualization techniques using state of the art big data & AI technologies. 

 

In this role, you shall work on deploying a wide variety of problems such as:

  • Maintaining and creating incremental and one-time ETL jobs for data transfer from on-premises servers to the cloud.
  • Using Generative AI for WhatsApp customer chatbot
  • Building a chatbot app for internal corporate stakeholders using Large Language Models such as OpenAI GPT-4, Google Palm, Claude etc.
  • Delivery sequencing and route optimization
  • Profiling and predictive analytics for customers, consignees, and shippers.


The role will cover the following areas of responsibility:
 

  • Collaborate and work with data management stakeholders such as data engineers, data scientists and product managers to identify functional and non-functional requirements for complex business problems that may be defined loosely.
  • Participate in creating a cloud-based solution architecture which fulfils the requirements taking into account reliability and scalability.
  • Sizing and building production databases (SQL and NoSQL).
  • Create, modify and maintain ETL/ELTs to transform input datasets to data warehouse and production databases.
  • Packaging and deploying production API endpoints.
  • Setup recurring jobs using EventBridge, ECS, and serverless functions.
  • Setting up CloudWatch alarms for continuous monitoring.
  • Using Continuous Integration / Continuous Deployment paradigm for code maintenance and DevOps.
  • Gain a thorough understanding and know-how of the on premise and cloud-based data warehouse and data lake.
  • Extraction of relevant data from data warehouses such as AWS Redshift to be used for Data Science projects.
  • Monitor, maintain and troubleshoot data integrity issues that may occur on our data warehouse.
  • Lead or participate in development, testing, documentation, and deployment of production-ready code.


To be successful in this role, you will need to be at least:
 

  • Pursuing Bachelor’s in computer science, Operational Research, Statistics, Applied Mathematics, Engineering or Natural Sciences or 1+ year of experience in a software related field.
  • Knowledge of functional or object-oriented programming.
  • Proficiency in Python, R, Java, Scala, JavaScript or other programming language.
  • Understanding of algorithms and data structures.
  • Experience with SQL to conduct database queries.
  • Understanding of basic database concepts, SQL and NoSQL databases.
  • Most importantly an Inquisitive mind and the ability to independently ask questions, find answers, learn and can-do attitude to move things forward.

 

A few skills which would be good to have are:

 

  • Understanding of unit testing, test-driven development (TDD), integration testing and user acceptance testing (UAT).
  • Experience with version control (GIT).
  • Understanding of the concepts of Continuous Integration/ Continuous deployment.
  • Understanding of REST and HTTP APIs.
  • Understanding of Agile framework.
  • Understanding of caching (Elastic cache and Redis)
  • Ability to deploy REST and HTTP APIs on API gateway.
  • Understanding of data engineering tools. (Glue, RedShift, S3, Matillion).
  • Understanding basic concepts of Machine learning and Data Science.
  • Understanding of Kubernetes containers, AWS Elastic Container Services.

 

Work Location: Maadi

 

 

Company Overview:

Since our founding in 1982 we have grown to become a world leader in comprehensive transport and delivery solutions for business and consumers. Headquartered in Dubai, at the heart of the world’s most dynamic commercial hub and on the site of historic trade routes linking east and west, commerce and transport are deeply embedded in Aramex’s DNA. We are dedicated to transforming the face of trade, expanding our operations rapidly to better connect businesses and consumers worldwide.

Apply now »