Azure Data Bricks Engineer - Kafka/Spark/SQL

Job description

Azure Data Factory:

- Develop Azure Data Factory Objects - ADF pipeline, configuration, parameters, variables, Integration services runtime

- Hands-on knowledge of ADF activities(such as Copy, SP, lkp etc) and DataFlows

- ADF data Ingestion and Integration with other services

Azure Databricks:

- Experience in Big Data components such as Kafka, Spark SQL, Dataframes, HIVE DB etc implemented using Azure Data Bricks would be preferred.

- Azure Databricks integration with other services

- Read and write data in Azure Databricks

- Best practices in Azure Databricks

Synapse Analytics:

- Import data into Azure Synapse Analytics with and without using PolyBase

- Implement a Data Warehouse with Azure Synapse Analytics

- Query data in Azure Synapse Analytics