Job Overview
Associate Data Integration Engineer is responsible for designing, developing, and maintaining cloud-based integration solutions using Microsoft Azure services. This role focuses on building scalable integration architectures, implementing API-driven workflows, orchestrating system communication, and ensuring high availability, performance, and security across integration platforms.
The engineer will work closely with application teams, data engineers, and architects to deliver enterprise-grade integration solutions.
Key Responsibilities
1. Solution Design
- Design and implement integration solutions using Azure services such as:
- Azure Logic Apps (Standard & Consumption)
- Azure Service Bus (Queues, Topics, DLQ)
- Azure API Management
- Event Grid / Event Hub
- Azure Functions
- Translate functional requirements into scalable integration architectures.
- Build robust retry, error-handling, dead-lettering, and monitoring patterns.
2. Development & Implementation
- Develop integration workflows using Logic Apps (stateful and stateless).
- Implement synchronous and asynchronous messaging patterns.
- Build APIs and connectors for internal/external system integrations.
- Implement CI/CD pipelines for integration components (Azure DevOps/GitHub).
- Build reusable components, templates, and enterprise integration patterns.
3. Service Bus & Messaging
- Configure queues, topics, subscriptions, and rules.
- Implement DLQ handling, repair & replay, and quarantine logic.
- Ensure message security, idempotency, and guaranteed delivery.
4. API Management
- Publish, secure, and monitor APIs using Azure API Management.
- Implement policies (rate limiting, caching, transformation, authentication).
- Manage API lifecycle and developer onboarding.
5. Monitoring & Support
- Implement alerting and observability using:
- Application Insights
- Log Analytics
- Azure Monitor
- Troubleshoot integration failures, performance issues, and message dead-lettering.
- Support production workloads, ensure platform reliability, and optimize cost.
6. Security & Governance
- Apply best practices for identity and access management (Azure AD).
- Implement security standards: Managed Identity, OAuth2, RBAC, Key Vault.
- Ensure compliance with company governance and Azure landing zone policies.