Software Engineer, Data Engineering - Work from Home

Job Description

Responsibilities
 

• Quickly learn latest technologies, conduct proof-of-concepts and experiments under guidance.
• Collaborate with a team of Big Data Engineers, Microservices and Cloud Architects and Domain SMEs to drive the product ahead.
• Stay up to date with the progress of technologies since we work on cutting-edge technologies and are constantly trying new things out.
• Build solutions for massive scale, that can handle high volumes of data and traffic efficiently.
• Understand the data in and out, and make sense of it. You will at times need to draw conclusions and present it to the business users.
• Be independent, self-driven and highly motivated. While you will have the best people to learn from and access to various courses or training materials, we expect you to take charge of your growth and learning.
• Follow best practices and coding standards and ensure efficient system performance.
   

Qualifications And Prerequisites
 

• 0-2 Year of relevant experience in Python, Big Data with pySpark.
• Prefer good knowledge and experience of distributed computing and Big Data Ecosystem - Hadoop, HDFS, Apache Spark, Apache Airflow.
• Good understanding of ETL, data lake and their importance.
• Good knowledge and exposure to one of the Cloud Environments (AWS, Azure or GCP).
• You like to work without a lot of supervision or micromanagement.
• Above all, you get excited by data. You like to dive deep, mine patterns and draw conclusions. You believe in making data driven decisions and helping the team look for the pattern as well.
• Familiarity with search engines like Elasticsearch and Bigdata warehouses systems like AWS Athena, Google Big Query etc
• Knowledge of NLP, AI/ML and Generative AI would be preferred.