[Remote] Azure Data Engineer (Databricks, ETL, Azure, Pyspark)

Note: The job is a remote job and is open to candidates in USA. QData Inc is seeking a highly skilled Senior Azure Databricks Developer with strong Python expertise to join their dynamic team. The ideal candidate will have deep experience working in the Azure cloud ecosystem, particularly with Databricks and data engineering responsibilities including building scalable data pipelines and implementing ETL processes.

Responsibilities

• Building and maintaining scalable data pipelines, managing Azure Delta Lake architecture, and supporting analytics initiatives across the organization.
• Design, develop, and maintain data pipelines using Azure Databricks, Apache Spark, and Python.
• Collaborate with data engineering teams to integrate data from systems like EPIC and Clarity into Azure.
• Contribute to Lakehouse architecture using Azure Databricks and Delta Lake.
• Implement ETL/ELT processes to support data integration and transformation
• Expertise in Azure Data Platform: Azure Data Factory (ADF), Azure Databricks, Synapse Analytics, Azure Data Lake Storage, Event Hub, Azure Analysis Services, Power BI, Microsoft Fabric
• Ensure data governance, security, cost optimization, and performance within the Lakehouse environment.
• Serve as a subject-matter expert in PySpark and Scala.

Skills

• Need US Citizen for this position.
• Highly skilled Senior Azure Databricks Developer with strong Python expertise.
• Deep experience working in the Azure cloud ecosystem, particularly with Databricks, Unity Catalog, Delta live Tables.
• Strong background in data engineering and development using Python.
• Building and maintaining scalable data pipelines.
• Managing Azure Delta Lake architecture.
• Supporting analytics initiatives across the organization.
• Design, develop, and maintain data pipelines using Azure Databricks, Apache Spark, and Python.
• Collaborate with data engineering teams to integrate data from systems like EPIC and Clarity into Azure.
• Contribute to Lakehouse architecture using Azure Databricks and Delta Lake.
• Implement ETL/ELT processes to support data integration and transformation.
• Expertise in Azure Data Platform: Azure Data Factory (ADF), Azure Databricks, Synapse Analytics, Azure Data Lake Storage, Event Hub, Azure Analysis Services, Power BI, Microsoft Fabric.
• Ensure data governance, security, cost optimization, and performance within the Lakehouse environment.
• Serve as a subject-matter expert in PySpark and Scala.
• Strong background in Azure Databricks and data engineering.
• Experience with CI/CD, governance, and Lakehouse optimization.

Company Overview

• Q Data Incorporation is one of the most progressive organizations in the country providing Information Technology (IT) services in staffing and consulting through out the USA. It was founded in 2008, and is headquartered in Little Elm, Texas, USA, with a workforce of 11-50 employees. Its website is http://q-datainc.com.