Job Description

Job Title : Azure Data Engineer

Location : Charlotte, NC (Onsite)

Position : Contract

Job Description

We are seeking an experienced Azure Data Engineer to design, develop, and maintain scalable data pipelines and modern cloud-based data solutions using Microsoft Azure technologies. The candidate will work closely with data architects, analysts, application teams, and business stakeholders to build reliable data platforms and deliver high-quality data for analytics and reporting.

Must Have Technical/Functional Skills

• 5+ years of experience in Data Engineering , with strong hands-on experience in Microsoft Azure.
• Strong experience with Azure Data Factory (ADF) for designing and developing ETL/ELT pipelines.
• Strong proficiency in SQL and experience working with relational databases such as SQL Server, Oracle, or PostgreSQL.
• Hands-on experience with Azure Databricks and PySpark for large-scale data processing and transformation.
• Experience developing scalable ETL/ELT data pipelines and implementing data integration solutions.
• Strong experience with Azure Data Lake Storage Gen2 (ADLS) .
• Experience with Azure Synapse Analytics for data warehousing and analytical workloads.
• Strong Python programming skills for data processing and automation.
• Experience with Delta Lake and lakehouse architecture.
• Experience implementing incremental data loads, CDC, SCD Type 1/Type 2, and data partitioning.
• Experience with Azure Key Vault , managed identities, service principals, and Azure security concepts.
• Experience with Git/Azure DevOps for source control, CI/CD, and deployment automation.
• Experience monitoring and troubleshooting Azure data pipelines and production data workloads.
• Strong understanding of data modeling, data warehousing concepts, and dimensional modeling.

Responsibilities

• Design and develop scalable data pipelines using Azure Data Factory .
• Build data processing solutions using Azure Databricks, PySpark, and Python .
• Develop and optimize SQL queries, stored procedures, and data transformation logic.
• Ingest data from databases, APIs, files, and other enterprise sources into Azure Data Lake.
• Design and maintain ADLS Gen2, Databricks, and Synapse data solutions.
• Implement batch and incremental data processing frameworks.
• Develop reusable ETL/ELT frameworks and data integration components.
• Perform data validation, reconciliation, and quality checks.
• Optimize data pipelines and Spark jobs for performance and cost.
• Implement CI/CD pipelines using Azure DevOps and Git.
• Secure data pipelines using Azure Key Vault, managed identities, RBAC, and other Azure security mechanisms.
• Monitor production pipelines and troubleshoot failures and data issues.
• Collaborate with data architects, business analysts, BI developers, and other engineering teams.
• Document data pipelines, architecture, data mappings, and technical processes.

Job Tags

Similar Jobs