About Our Company:
Reyan Technologies is a technology-driven company dedicated to delivering innovative digital solutions and research that help businesses grow and adapt to an evolving digital world. With a team of skilled professionals from diverse backgrounds, we provide high-quality technology solutions to clients across various industries. We believe in continuous innovation, collaboration, and excellence, while also fostering a positive workplace culture through initiatives like Spreading Happiness, which celebrates and appreciates the contributions of our employees and their families.
Job Description:
Reyan Technologies Ltd is looking for a skilled Data Engineer to join our team and support the design, development, and maintenance of data solutions that enable business insights. As a Data Engineer, you will be responsible for developing and maintaining ETL/ELT processes, cleansing and validating data, optimizing SQL queries, and building reliable data pipelines. You will work closely with developers, analysts, and business stakeholders to deliver scalable and high-quality data solutions while contributing new ideas to improve existing processes.
Job Role and Responsibilities:
• Build, maintain, and support data pipelines using Azure Data Factory and Snowflake.
• Develop and maintain ETL/ELT processes for integrating data from multiple source systems.
• Design and maintain data warehouse structures using star and snowflake schemas.
• Write, review, and optimise SQL queries, stored procedures, views, and functions.
• Perform data cleansing, validation, reconciliation, and quality checks to ensure accurate reporting.
• Support data migration, transformation, and integration activities across cloud and on-premises environments.
• Develop and maintain Azure Data Factory pipelines for data ingestion and transformation.
• Work with Azure Data Lake Storage, Azure SQL Database, and Azure Databricks to support data processing requirements.
• Assist in developing Spark-based data processing solutions where required.
• Collaborate with Business Analysts, Developers, and QA teams to understand business requirements and deliver data solutions.
• Support reporting and analytics teams by preparing reliable datasets for Power BI and other reporting tools.
• Monitor ETL jobs, troubleshoot failures, and optimise pipeline performance.
• Participate in Agile/Scrum ceremonies including sprint planning, stand-ups, reviews, and retrospectives.
• Contribute ideas for improving data engineering processes and automation.
Skills, Knowledge & Experience:
• Master’s degree in computer science (mandatory).
• 8+ years of experience in Data Engineering, Data Analysis, BI Development, or a similar data-focused role.
• Experience working with Snowflake or other cloud-based data warehouse platforms.
• Strong expertise in SQL development, query optimisation, and data modelling.
• Experience designing, developing, and maintaining ETL/ELT pipelines.
• Hands-on experience with Microsoft Azure data services, including Azure Data Factory, Azure SQL Database, Azure Databricks, Azure Data Lake Storage, and Azure Synapse Analytics.
• Working knowledge of Apache Spark and distributed data processing.
• Strong proficiency in Python, SQL, and data transformation techniques.
• Good understanding of data warehousing concepts, including Star Schema and Snowflake Schema.
• Experience with cloud storage solutions and reporting tools such as Power BI.
• Knowledge of data validation, data quality, reconciliation, and performance optimisation techniques.
• Experience working with ETL tools such as SSIS and cloud-based data integration platforms.
• Experience with version control tools such as Git or SVN.
• Good stakeholder communication and collaboration skills with the ability to work effectively across technical and business teams.
• Experience working in Agile/Scrum development environments.
Desirable Skills:
• Exposure to Snowflake or other cloud data warehouse technologies.
• Knowledge of Azure AI or data analytics services.
• Experience developing interactive dashboards using Power BI.
• Familiarity with data migration and cloud transformation projects.
• Understanding of database performance tuning and query optimisation.
• Experience working with large and complex datasets.
• Ability to troubleshoot and resolve data-related issues efficiently.
• Willingness to learn and adopt new cloud technologies and data engineering tools.
• Strong attention to detail and commitment to data quality.
