Job Description

Senior Data Engineer

Key Accountabilities:

• Tech stack: Azure AD, Azure Key Vault, API Management, Azure Data Factor (ADF), Azure Databricks (DBX), Azure Storage, Azure SQL DB, Azure App Insights, Azure App Monitor, PowerBI (Power BI)
• Architects, designs, implements and maintains reliable and scalable data infrastructure
• Writes, deploys and maintains software to build, integrate, manage, maintain, and quality-assure data
• Design, develop, and deliver large-scale data ingestion, data processing, and data transformation projects on Azure
• Mentor and share knowledge with customers as well as provide architecture reviews, discussions, and prototypes
• Work with customers to deploy, manage, and audit best practices for cloud products
• Adheres to and advocates for software engineering best practices (e.g. technical design and review, unit testing, monitoring, alerting, checking in code, code review, documentation)
• Deploy secure and well-tested software that meets privacy and compliance requirements; develops, maintains and improves CI / CD pipeline
• Service reliability and following site-reliability engineering best practices: on-call rotations for services they maintain, responsible for defining and maintaining SLAs. Design, build, deploy and maintain infrastructure as code. Containerizes server deployments
• Actively contributes to improve developer velocity
• Work closely with other data engineers, software engineers, data scientists, data managers and business partners

Desirable Education and Experience:

• BS degree in computer science or related field

Required Criteria

• Deep and hands-on experience (typically 5+ years) designing, planning, productionizing, maintaining and documenting reliable and scalable data infrastructure and data products in complex environments
• Hands on experience with:
• Databricks and using Spark for data processing
• Configuring Delta Lake on Azure Databricks
• Python, Scala, SQL
• C#, ASP.NET, MVC,.NET Core,.Net Framework (4.6) JSON, and API development (optional)
• Azure Data Factory
• Azure Data Lake, Azure SQL DB, Synapse, and Cosmos DB
• Data Management Gateway, Azure Storage Options, Stream Analytics and Event Hubs
• Designing data solutions in Azure incl.

Job Tags

Similar Jobs