Description
The Cloud Data Engineer is responsible for designing, implementing, maintaining, and securing Azure-based data platforms. This role builds and manages data pipelines, data storage solutions, data processing frameworks, and cloud infrastructure to support enterprise reporting, analytics, and business intelligence initiatives.
The engineer will work closely with business analysts, Power BI developers, DBAs, and infrastructure teams to ensure reliable, scalable, and secure data solutions.
Data Pipeline Development
Design, develop, and maintain ETL/ELT pipelines.
Build automated batch and near real-time data integration processes.
Integrate data from on-premises and cloud systems.
Troubleshoot and optimize data workflows.
Data Storage & Modeling
Design and maintain data warehouse and data lake architectures.
Develop logical and physical data models.
Optimize database schemas, indexes, and partitioning strategies.
Support historical data retention and archival requirements.
Azure Platform Administration
Manage and support:
Azure Data Factory (ADF)
Azure Data Lake Storage (ADLS)
Azure SQL Database / Azure PostgreSQL
Azure ExpressRoute
Gateway Servers
Monitoring & Logging Solutions
Configure networking, security groups, and access controls.
Database Administration
Database installation and configuration.
Performance tuning and query optimization.
Monitoring and maintenance.
Backup and recovery management.
High Availability (HA) and disaster recovery planning.
Replication and failover configuration.
Infrastructure & Automation
Develop scripts and automation for operational tasks.
Support CI/CD deployment processes.
Automate monitoring, alerting, and maintenance activities.
Monitoring & Support
Monitor platform availability and performance.
Resolve production incidents and root causes.
Maintain SLA and operational standards.
Provide technical support to business and development teams.
Complete tasks assigned by management.