Senior Data Engineer - Azure Cloud Expert

Your contribution to something big: 

• Design, implement, and optimize Azure-based architectures for data platforms.
• Configure and manage Azure Databricks environments including development, monitoring, and performance tuning.
• Build and orchestrate data pipelines using tools such as Azure Data Factory, Delta Lake, and Databricks workflows.
• Apply strong security configuration practices, including the use of Azure Key Vault, RBAC, private endpoints, and network security settings.
• Ensure compliance with data governance standards and internal security policies.
• Analyze and troubleshoot cloud-based data workflows for performance and reliability.
• Define and implement Infrastructure as Code and CI/CD pipelines for deployment and lifecycle management of data components.

What distinguishes you:

• Azure Cloud (5+ years of experience): In-depth knowledge of the Azure ecosystem with hands-on experience in designing, deploying, and maintaining cloud-native data solutions. Skilled in cost optimization, automation, and secure resource management.
• Azure Databricks: Advanced expertise in building and orchestrating data pipelines, conducting data processing and transformation (batch and streaming), scripting in Python or Scala, configuring clusters, and optimizing workloads for performance and cost.
• Azure Data Factory: Proficient in creating and managing complex ETL/ELT workflows, with secure integration across hybrid and multi-cloud environments. Strong understanding of firewall rules, linked services, and data movement strategies.
• Azure Key Vault: Experienced in managing secrets, certificates, and encryption keys, with automated key rotation and seamless integration with other Azure services.
• Azure Storage: Deep understanding of Azure Storage Accounts, including Blob Storage and Data Lake Storage, with hands-on experience managing metadata, access tiers, lifecycle policies, and securing storage via SAS tokens and RBAC.
• Role-Based Access Control (RBAC): Skilled in designing and enforcing access controls through custom roles, resource scopes, and principle of least privilege strategies.
• Data Architecture & Security: Strong background in data governance, lineage tracking, and ensuring compliance and security in enterprise-grade data environments.
• Cost Optimization: Ability to monitor and optimize costs across Azure services, including compute, storage, and data workflows, using Azure Cost Management, budgets, and advisor recommendations.